-- Logs begin at Wed 2021-12-15 12:47:23 UTC, end at Wed 2021-12-15 13:56:18 UTC. -- Dec 15 13:17:53.010044 dv-cinder-813227-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Dec 15 13:17:53.017291 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 13:17:53 2021] *** Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: nodename: dv-cinder-813227-4-iscsi Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: machine: x86_64 Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: clock source: unix Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: pcre jit disabled Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: detected number of CPU cores: 4 Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: current working directory: / Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: detected binary path: /usr/bin/uwsgi-core Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: your processes number limit is 47680 Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: your memory page size is 4096 bytes Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: detected max file descriptor number: 2048 Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: lock engine: pthread robust mutexes Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: thunder lock: enabled Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 15 13:17:53.021597 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 13:17:53.067983 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: Python main interpreter initialized at 0x55a3940dd9c0 Dec 15 13:17:53.067983 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: python threads support enabled Dec 15 13:17:53.067983 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: your server socket listen backlog is limited to 100 connections Dec 15 13:17:53.067983 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: your mercy for graceful operations on workers is 90 seconds Dec 15 13:17:53.068341 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 13:17:53.068406 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: *** Operational MODE: preforking *** Dec 15 13:17:53.068707 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: *** uWSGI is running in multiple interpreter mode *** Dec 15 13:17:53.068707 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: spawned uWSGI master process (pid: 79047) Dec 15 13:17:53.068923 dv-cinder-813227-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Dec 15 13:17:53.070882 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: spawned uWSGI worker 1 (pid: 79063, cores: 1) Dec 15 13:17:53.070882 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: spawned uWSGI worker 2 (pid: 79064, cores: 1) Dec 15 13:17:53.070882 dv-cinder-813227-4-iscsi devstack@keystone.service[79047]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 13:17:58.410150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:17:58.410150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: from cryptography.utils import int_from_bytes Dec 15 13:17:58.411012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:17:58.411012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: from cryptography.utils import int_from_bytes Dec 15 13:17:58.414710 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:17:58.414710 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: from cryptography.utils import int_from_bytes Dec 15 13:17:58.415341 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:17:58.415341 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: from cryptography.utils import int_from_bytes Dec 15 13:17:58.461498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:17:58.461683 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:17:58.461868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] command line args: [] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:17:58.462140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:17:58.462319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ================================================================================ {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:17:58.462576 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] admin_token = **** {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.462824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] config_dir = [] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.463045 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.463230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] config_source = [] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.463412 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] debug = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.463613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.463861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:17:58.463861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:17:58.463976 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.464045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] command line args: [] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:17:58.464198 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.464311 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:17:58.464390 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.464489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ================================================================================ {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:17:58.464636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.464759 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] admin_token = **** {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.464855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] list_limit = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.464978 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] config_dir = [] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.465088 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] log_config_append = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.465190 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.465298 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.465406 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] config_source = [] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.465501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] log_dir = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.465600 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] debug = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.465708 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] log_file = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.465810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.465961 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.466047 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.466169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.466250 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.466364 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.466444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.466528 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.466608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.466729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.466815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.466976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] list_limit = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.467102 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] log_config_append = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.467183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.467254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.467332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.467403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] log_dir = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.467516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.467601 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] log_file = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.467718 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.467801 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.467952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.468078 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.468187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.468275 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.468432 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.468534 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.468613 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.468678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.468785 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.469031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.469113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.469278 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.469538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.469654 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.469747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] publish_errors = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.469823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.469930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.470072 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.470251 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.470896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.471023 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.471152 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.471277 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.471403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.471479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.471603 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.471679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] standard_threads = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.471858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.471992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.472105 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.472260 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] publish_errors = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.472342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.472412 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.472491 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] use_journal = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.472614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] use_json = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.472719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.472797 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] use_stderr = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.472904 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.472987 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] use_syslog = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.473158 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.473240 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.473397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.473479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.473633 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] standard_threads = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.473709 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.473870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.473954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.474116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.474192 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.474296 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.474373 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.474475 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] use_journal = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.474594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.474677 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] use_json = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.474816 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] use_stderr = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.474921 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.475022 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] use_syslog = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.475108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.475257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:17:58.475333 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.475516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.475593 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.475756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.475909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.476020 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.476097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.476263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.476339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.476500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.476583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.476752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.476834 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.477002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.477077 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.477241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.477327 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.477495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.477578 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.477746 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.477829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.477993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.478079 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.478231 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.478306 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.478481 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.478557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.478721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.478804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.479005 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.479093 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.479259 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.479333 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.479493 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.479577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.479729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.479811 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.479962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.480037 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.480201 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.480285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.480454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.480535 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.480706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.480782 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.480939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.481017 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.481172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.481248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.481427 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.481502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.481665 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.481741 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.481910 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.481992 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.482128 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.482203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.482365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.482441 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.482604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.482685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.482869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.482949 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.483099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.483176 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.483332 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.483407 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.483566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.483641 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.483799 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.483881 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.484038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.484113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.484287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.484368 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.484520 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.484596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.484759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.484835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.484991 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.485072 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.485223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.485305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.485459 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.485539 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.485692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.485935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.486027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.486099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.486168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.486272 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.486411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.486524 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.486666 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.486772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.486891 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.487002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.487108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.487214 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.487346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.487427 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.487584 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.487663 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.487823 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.487915 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.488061 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.488143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.488293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.488378 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.488530 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.488616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.488770 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.488905 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.488989 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.489062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.489228 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.489468 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.489551 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.489734 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.489813 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.489973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.490062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.490221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.490338 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.490455 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.490533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.490693 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.490777 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.490952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.491039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.491190 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.491272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.491433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.491568 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.491669 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.491745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.491906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.491985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.492140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.492218 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.492401 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.492476 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.492642 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.492719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.492879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.492955 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.493109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.493184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.493329 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.493403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.493560 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.493636 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.493795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.493873 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.494026 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.494105 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.494265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.494352 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.494498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.494575 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.494747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.494825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.495007 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.495085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.495251 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.495330 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.495488 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.495566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.495723 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.495809 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.495957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.496033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] auth.external = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.496186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.496271 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.496417 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.496500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.496668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.496752 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.496905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.496994 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] auth.password = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.497142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] auth.token = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.497220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.497383 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.497460 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.497620 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.497705 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.497870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.497947 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.498103 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.498185 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.498348 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] auth.external = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.498440 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.498583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.498660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.498811 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.498904 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.499070 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] credential.caching = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.499158 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.499317 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.499395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] auth.password = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.499566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.499649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] auth.token = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.499805 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.499889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.500041 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.500144 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.500287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.500365 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.500523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.500609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.500771 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.500860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.501018 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.501094 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.501254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.501337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.501519 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] credential.caching = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.501611 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.501773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.501850 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.502025 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.502102 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.502276 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.502362 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.502516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.502593 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.502760 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.502838 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.503020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] federation.caching = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.503109 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.503269 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.503346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.503516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.503598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.503753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.503838 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.503985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.504063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.504235 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.504312 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.504474 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.504553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.504731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.504817 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.504970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.505056 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.505226 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.505306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.505463 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] federation.caching = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.505540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.505710 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.505789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.505948 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity.caching = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.506027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.506195 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.506272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.506427 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.506503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.506669 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.506747 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.506930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.507013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.507181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.507258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.507428 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.507511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.507639 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.507724 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.507889 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.507973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.508137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.508216 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.508370 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.508447 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity.caching = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.508601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.508678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.508833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.508913 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.509080 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.509157 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.509320 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.509397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.509568 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.509646 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.509799 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.509875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.510039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.510116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.510292 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.510371 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.510544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.510622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.510774 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.510864 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.511029 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.511182 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.511263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.511335 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.511494 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.511572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.511732 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.511811 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.511974 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.512052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.512215 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.512293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.512464 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.512544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.512696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.512773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.512944 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.513029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.513189 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.513265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.513423 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.513507 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.513661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.513747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.513896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.513974 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.514127 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.514203 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.514366 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.514455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.514598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.514675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.514836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.514932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.515093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.515186 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.515337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.515415 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.515577 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.515654 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.515816 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.515910 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.516065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.516142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.516311 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.516387 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.516543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.516629 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.516772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.516850 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.517522 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.517606 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.517767 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.517853 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.518002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.518080 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.518239 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.518316 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.518475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.518561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.518708 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.518787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.518972 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.519052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.519226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.519319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.519458 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.519536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.519690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.519766 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.519940 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.520025 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.520187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.520320 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.520442 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.520562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.520684 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.520811 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.520934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.521055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.521187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.521309 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.521429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.521558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.521681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.521803 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.521923 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.522043 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.522163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.522291 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.522413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.522534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.522656 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.522785 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.522927 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.523060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.523182 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.523303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.523423 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.523543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.523665 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.523793 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.523914 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.524034 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.524154 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.524273 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.524392 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.524531 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.524655 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.524775 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.524896 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.525015 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.525135 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.525265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.525388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.525508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.525629 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.525756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.525878 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.526006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.526128 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.526257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.526378 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.526498 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.526619 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.526748 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.526930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.527053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.527178 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.527301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.527424 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.527557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.527682 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.527806 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.527939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] resource.caching = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.528063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.528186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.528317 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.528441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.528563 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.528687 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.528810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.528933 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.529068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.529193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.529317 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.529440 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.529562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.529704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.529828 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.529952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.530076 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.530199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.530323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.530454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] role.caching = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.530577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] resource.caching = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.530699 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] role.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.530822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.530962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.531038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.531192 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.531269 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.531340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.531410 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.531480 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.531550 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.531628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.531706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.531779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.531849 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.531919 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.531990 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.532067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.532140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.532210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.532280 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] role.caching = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.532350 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.532419 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] role.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.532496 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.532569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.532639 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.533340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.533414 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.533485 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.533660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.533741 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.533956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.534039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.534208 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.534287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.534459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.534539 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.534718 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.534795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.534996 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.535077 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.535238 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.535318 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.535472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.535549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.535725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.535803 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.535974 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.536053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.536212 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.536289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.536447 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.536605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.536685 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.536845 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.536922 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.537104 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.537181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.537358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.537438 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.537609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.537692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.537848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.537925 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.538082 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.538161 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.538311 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.538388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.538549 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] token.caching = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.538626 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.538786 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.538892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.539055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.539132 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.539290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.539375 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.539525 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.539606 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.539779 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.539856 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.540039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.540116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.540282 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.540361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.540521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.540597 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.540767 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.540844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.540999 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.541078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.541235 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.541312 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] token.caching = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.541471 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.541548 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.541719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.541797 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.541960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.542038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.542188 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.542264 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.542431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.542512 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.542959 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.543042 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.543209 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.543286 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.connection = **** {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.543456 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.543536 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.543702 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.543778 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.543938 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.544014 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.544176 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.544255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.544429 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.544541 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.544653 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.544785 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.544914 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.545040 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.545165 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.545289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.545411 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.545533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.545667 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.545799 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.545932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.546057 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.connection = **** {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.546192 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.546317 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.546440 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.546572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.546698 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.546823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.546966 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.547100 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.547224 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.547357 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.547481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.547605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.547728 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.547852 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.547983 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:17:58.548114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.548114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.548369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.548501 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.548680 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.548932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.549172 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.549420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.549653 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.549897 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.550135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:17:58.550308 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:17:58.576974 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.577205 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.577433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.578576 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.578812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.579069 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.586703 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.588348 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.616085 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.616317 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.617926 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.618160 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.669737 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.669945 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.719396 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.719631 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.720168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.720410 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.786255 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.786484 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.786627 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.786776 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.786905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.786985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.787059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.787144 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.787221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.787351 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.787435 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.787596 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.810457 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.810688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.810787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.810936 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.811020 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.811161 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.811243 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.811382 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.811466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.811598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.811679 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.811813 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.811903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.812055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.823572 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.823954 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.836785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.837038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.837185 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.837270 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.837426 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.837507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.837655 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.837745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.837870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.837950 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.838087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.838168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.838304 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.838519 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:17:58.855216 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.855423 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 13:17:58.855756 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.855905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.856002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 13:17:58.856120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 13:17:58.856201 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.856454 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.856543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.856658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 13:17:58.856741 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.856928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.857006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.857191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.857451 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.857709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.867547 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.867824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.868092 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.868325 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.868417 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.868609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.868877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.869159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.877003 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.877786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.880250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.880528 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.880807 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.881013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.881093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.881293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.881374 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.881570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.881649 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.881847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.881935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.882113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.882261 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.882375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.882454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.882640 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.882721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.882934 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.883014 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.883204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.883474 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.883742 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.909269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.910420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.910840 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.911143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.912039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.912319 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.916285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.917460 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.918428 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.918721 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.919641 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.919991 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.926526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.926808 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.927988 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.928274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.931222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.931510 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.931799 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.932093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.932371 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.932657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.932924 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.933005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.933193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.933285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.933497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.933783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.934059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.934345 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.934620 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.934916 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.952155 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.952431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.953834 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.954108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.956987 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.958755 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.960606 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.961010 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.962513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.962937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.965980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.967859 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.969537 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.971459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.974120 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.974417 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.974699 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.975009 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.975141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.975297 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.975475 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.975584 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.975782 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.976073 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.976354 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.976643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.997586 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.997872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.998139 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.998412 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.998647 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:58.998965 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.999236 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:58.999510 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.006851 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.008140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.008541 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.008817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.009830 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.010111 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.011961 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.012254 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.012535 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.012823 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.013108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.013230 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.013513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.013794 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.014075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.014359 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.026111 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.026390 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.026668 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.026976 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.027353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.027433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.027632 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.027715 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.027924 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.028005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.028243 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.028620 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.028908 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.029198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.045748 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.047213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.049477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.051237 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.052805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.054456 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.054539 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.056139 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.056223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.056425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.056706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.057763 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.058043 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.058326 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.063893 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.065931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.066013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.067580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.069098 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.069397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.069781 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.070064 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.070696 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.071026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.071420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.071708 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.078938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.079225 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.079529 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.080608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.080893 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.081200 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.087265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.087543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.087820 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.088095 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.088374 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.088757 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.088892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:17:59.089045 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.089174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.089316 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.089457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.089584 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.089733 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.089862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.090017 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.090131 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.090399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.090479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.090676 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.090756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.090964 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.091048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.091236 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.091527 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.091802 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.092075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.092355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.092616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:17:59.128824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a3940dd9c0 pid: 79063 (default app) Dec 15 13:17:59.130688 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a3940dd9c0 pid: 79064 (default app) Dec 15 13:17:59.132311 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85015b-6c35-4e6c-ae94-583a1566315a None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:17:59.132605 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85015b-6c35-4e6c-ae94-583a1566315a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:17:59.132885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85015b-6c35-4e6c-ae94-583a1566315a None None] PATH_INFO: `/v3` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:17:59.137067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Wed Dec 15 13:17:59 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:07.027582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2ca45-86ad-48ae-8b3c-539724ef5fcb None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:07.028084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2ca45-86ad-48ae-8b3c-539724ef5fcb None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:07.028189 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2ca45-86ad-48ae-8b3c-539724ef5fcb None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:07.033640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:07 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:18:07.039530 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb5c51-0cf5-49b2-a8d3-e272be25f55c None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:07.039932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb5c51-0cf5-49b2-a8d3-e272be25f55c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:07.040084 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb5c51-0cf5-49b2-a8d3-e272be25f55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:07.081297 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG oslo_db.sqlalchemy.engines [None req-0ecb5c51-0cf5-49b2-a8d3-e272be25f55c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:18:07.281453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG passlib.handlers.bcrypt [None req-0ecb5c51-0cf5-49b2-a8d3-e272be25f55c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79063) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 15 13:18:07.281809 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG passlib.handlers.bcrypt [None req-0ecb5c51-0cf5-49b2-a8d3-e272be25f55c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79063) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 15 13:18:07.337293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-0ecb5c51-0cf5-49b2-a8d3-e272be25f55c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:07.339163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0ecb5c51-0cf5-49b2-a8d3-e272be25f55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:07.467083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:07.606651 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2ca45-86ad-48ae-8b3c-539724ef5fcb None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:07.641988 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG oslo_db.sqlalchemy.engines [None req-c3f2ca45-86ad-48ae-8b3c-539724ef5fcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79064) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:18:07.774647 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2ca45-86ad-48ae-8b3c-539724ef5fcb None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:07.778833 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824e474-e24d-4c8c-929a-eb082da8e1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:07.779515 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824e474-e24d-4c8c-929a-eb082da8e1de admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:07.779800 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824e474-e24d-4c8c-929a-eb082da8e1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:07.780080 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824e474-e24d-4c8c-929a-eb082da8e1de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:07.788926 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824e474-e24d-4c8c-929a-eb082da8e1de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:07.844198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1824e474-e24d-4c8c-929a-eb082da8e1de admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 15 13:18:07.844549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824e474-e24d-4c8c-929a-eb082da8e1de admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:07.854218 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:07.860678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb5c51-0cf5-49b2-a8d3-e272be25f55c None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:07.874593 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb5c51-0cf5-49b2-a8d3-e272be25f55c None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:07.879612 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d26c1-9ecc-4b02-9d38-ab6ec479b53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:07.880721 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d26c1-9ecc-4b02-9d38-ab6ec479b53c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:07.881010 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d26c1-9ecc-4b02-9d38-ab6ec479b53c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:07.881291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d26c1-9ecc-4b02-9d38-ab6ec479b53c admin admin] PATH_INFO: `/v3/projects/b8bb67e688614ccb9ee5454c18356750` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:07.882810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d26c1-9ecc-4b02-9d38-ab6ec479b53c admin admin] RBAC: Authorizing `identity:get_project(project_id=b8bb67e688614ccb9ee5454c18356750)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:07.935686 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.common.rbac_enforcer.enforcer [None req-425d26c1-9ecc-4b02-9d38-ab6ec479b53c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 15 13:18:07.936032 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d26c1-9ecc-4b02-9d38-ab6ec479b53c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:07.941235 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:07 2021] GET /identity/v3/projects/b8bb67e688614ccb9ee5454c18356750 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:10.291976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a4292-10d9-425f-a594-79033b7e0838 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:10.292487 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a4292-10d9-425f-a594-79033b7e0838 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:10.292594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a4292-10d9-425f-a594-79033b7e0838 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:10.299549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:10 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:18:10.305977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3393ab-ae94-4603-84a4-58f1a9613751 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:10.306452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3393ab-ae94-4603-84a4-58f1a9613751 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:10.306535 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3393ab-ae94-4603-84a4-58f1a9613751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:10.325784 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-6c3393ab-ae94-4603-84a4-58f1a9613751 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:10.327361 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-6c3393ab-ae94-4603-84a4-58f1a9613751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:10.336279 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:10.364252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a4292-10d9-425f-a594-79033b7e0838 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:10.376338 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a4292-10d9-425f-a594-79033b7e0838 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:10.380529 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdb082-9694-41bd-b0a3-9f52082043ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:10.381168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdb082-9694-41bd-b0a3-9f52082043ec admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:10.381453 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdb082-9694-41bd-b0a3-9f52082043ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:10.381733 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdb082-9694-41bd-b0a3-9f52082043ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:10.389227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdb082-9694-41bd-b0a3-9f52082043ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:10.391545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdb082-9694-41bd-b0a3-9f52082043ec admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:10.400086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:10.405886 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3393ab-ae94-4603-84a4-58f1a9613751 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:10.415589 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3393ab-ae94-4603-84a4-58f1a9613751 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:10.420199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b7896-01ee-4bb6-87fc-717255ef4578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:10.421059 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7896-01ee-4bb6-87fc-717255ef4578 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:10.421344 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7896-01ee-4bb6-87fc-717255ef4578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:10.421626 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7896-01ee-4bb6-87fc-717255ef4578 admin admin] PATH_INFO: `/v3/users/851ea07e9b2c466298b37f0fddcbf9c5` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:10.423088 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b7896-01ee-4bb6-87fc-717255ef4578 admin admin] RBAC: Authorizing `identity:get_user(user_id=851ea07e9b2c466298b37f0fddcbf9c5)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:10.424910 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b7896-01ee-4bb6-87fc-717255ef4578 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:10.426466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:10 2021] GET /identity/v3/users/851ea07e9b2c466298b37f0fddcbf9c5 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:12.845187 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19d0a1-b6b9-4344-8289-32e608e7057c None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:12.845709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19d0a1-b6b9-4344-8289-32e608e7057c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:12.845792 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19d0a1-b6b9-4344-8289-32e608e7057c None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:12.847526 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:12.849041 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe695a-d5a2-4bb1-82a5-5ed7404ce681 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:12.849445 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe695a-d5a2-4bb1-82a5-5ed7404ce681 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:12.849604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe695a-d5a2-4bb1-82a5-5ed7404ce681 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:12.851893 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:18:12.852752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f7dc2-6a42-43f6-b16b-908aaeda66e7 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:12.853041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f7dc2-6a42-43f6-b16b-908aaeda66e7 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:12.853321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f7dc2-6a42-43f6-b16b-908aaeda66e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:12.857141 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f032f8-5b49-4bca-90a7-5c123c2564eb None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:12.857427 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f032f8-5b49-4bca-90a7-5c123c2564eb None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:12.857709 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f032f8-5b49-4bca-90a7-5c123c2564eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:12.875472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-c0f032f8-5b49-4bca-90a7-5c123c2564eb None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:12.876643 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c0f032f8-5b49-4bca-90a7-5c123c2564eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:12.884137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 7/12] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:12.894297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG passlib.handlers.bcrypt [None req-7d2f7dc2-6a42-43f6-b16b-908aaeda66e7 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79064) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 15 13:18:12.894722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG passlib.handlers.bcrypt [None req-7d2f7dc2-6a42-43f6-b16b-908aaeda66e7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79064) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 15 13:18:12.906787 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f032f8-5b49-4bca-90a7-5c123c2564eb None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:12.917240 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f032f8-5b49-4bca-90a7-5c123c2564eb None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:12.923239 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94933d41-78c0-4595-b237-ac14fbc86109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:12.923882 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94933d41-78c0-4595-b237-ac14fbc86109 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:12.924163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94933d41-78c0-4595-b237-ac14fbc86109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:12.924566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94933d41-78c0-4595-b237-ac14fbc86109 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:12.934627 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94933d41-78c0-4595-b237-ac14fbc86109 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:12.936456 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94933d41-78c0-4595-b237-ac14fbc86109 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:12.941675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-7d2f7dc2-6a42-43f6-b16b-908aaeda66e7 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:12.943294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-7d2f7dc2-6a42-43f6-b16b-908aaeda66e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:12.945133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 8/13] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:18:12.951142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94933d41-78c0-4595-b237-ac14fbc86109 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:12.959272 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94933d41-78c0-4595-b237-ac14fbc86109 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:12.963538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387dfce-f8bc-42f5-8615-eea7f26aaa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:12.964279 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387dfce-f8bc-42f5-8615-eea7f26aaa0e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:12.964557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387dfce-f8bc-42f5-8615-eea7f26aaa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:12.964786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 6/14] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:12.964892 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387dfce-f8bc-42f5-8615-eea7f26aaa0e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:12.965977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387dfce-f8bc-42f5-8615-eea7f26aaa0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:12.967705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387dfce-f8bc-42f5-8615-eea7f26aaa0e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:12.969898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 9/15] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:12.990026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f7dc2-6a42-43f6-b16b-908aaeda66e7 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:12.999968 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f7dc2-6a42-43f6-b16b-908aaeda66e7 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:13.004599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957580b-b4e5-4f81-a634-e502b72fb200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:13.005766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957580b-b4e5-4f81-a634-e502b72fb200 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:13.006054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957580b-b4e5-4f81-a634-e502b72fb200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:13.006335 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957580b-b4e5-4f81-a634-e502b72fb200 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:13.022795 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957580b-b4e5-4f81-a634-e502b72fb200 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:13.029964 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-e957580b-b4e5-4f81-a634-e502b72fb200 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:18:13.031888 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 7/16] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:18:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:13.038540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387dfce-f8bc-42f5-8615-eea7f26aaa0e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:13.049377 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387dfce-f8bc-42f5-8615-eea7f26aaa0e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:13.053847 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a44d7-ac1c-4a5e-8d18-ed30bec351f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:13.054525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a44d7-ac1c-4a5e-8d18-ed30bec351f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:13.054807 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a44d7-ac1c-4a5e-8d18-ed30bec351f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:13.055118 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a44d7-ac1c-4a5e-8d18-ed30bec351f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:13.055902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a44d7-ac1c-4a5e-8d18-ed30bec351f7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:13.056211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a44d7-ac1c-4a5e-8d18-ed30bec351f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:13.058047 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-2f6a44d7-ac1c-4a5e-8d18-ed30bec351f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:13.058047 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:18:13.058047 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:18:13.059004 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a44d7-ac1c-4a5e-8d18-ed30bec351f7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:13.074685 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 10/17] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:13.080777 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957580b-b4e5-4f81-a634-e502b72fb200 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:13.090696 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957580b-b4e5-4f81-a634-e502b72fb200 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:13.095987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58e33c-7edf-41ca-92fd-567beb7951da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:13.097370 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58e33c-7edf-41ca-92fd-567beb7951da admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:13.097370 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58e33c-7edf-41ca-92fd-567beb7951da admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:13.097577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58e33c-7edf-41ca-92fd-567beb7951da admin admin] PATH_INFO: `/v3/users/851ea07e9b2c466298b37f0fddcbf9c5` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:13.100052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58e33c-7edf-41ca-92fd-567beb7951da admin admin] RBAC: Authorizing `identity:get_user(user_id=851ea07e9b2c466298b37f0fddcbf9c5)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:13.102097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58e33c-7edf-41ca-92fd-567beb7951da admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:13.103859 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 8/18] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:13 2021] GET /identity/v3/users/851ea07e9b2c466298b37f0fddcbf9c5 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:13.110577 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a44d7-ac1c-4a5e-8d18-ed30bec351f7 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:13.120887 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a44d7-ac1c-4a5e-8d18-ed30bec351f7 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:13.127530 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e5871-d442-4a01-b56c-b4b13b7c9947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:13.128810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e5871-d442-4a01-b56c-b4b13b7c9947 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:13.129242 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e5871-d442-4a01-b56c-b4b13b7c9947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:13.129525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e5871-d442-4a01-b56c-b4b13b7c9947 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:13.131927 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e5871-d442-4a01-b56c-b4b13b7c9947 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:13.133710 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e5871-d442-4a01-b56c-b4b13b7c9947 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:13.135495 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 11/19] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:13.142530 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58e33c-7edf-41ca-92fd-567beb7951da admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:13.154625 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58e33c-7edf-41ca-92fd-567beb7951da admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:13.159657 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff968f-e468-4eb0-94e8-6186bfdcde2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:13.160321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff968f-e468-4eb0-94e8-6186bfdcde2c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:13.160609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff968f-e468-4eb0-94e8-6186bfdcde2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:13.160887 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff968f-e468-4eb0-94e8-6186bfdcde2c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:13.161749 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff968f-e468-4eb0-94e8-6186bfdcde2c admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.domain.id=default, user.id=851ea07e9b2c466298b37f0fddcbf9c5) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:13.162057 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff968f-e468-4eb0-94e8-6186bfdcde2c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:13.163887 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-12ff968f-e468-4eb0-94e8-6186bfdcde2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:13.163887 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:18:13.163887 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:18:13.165053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff968f-e468-4eb0-94e8-6186bfdcde2c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:13.174697 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 9/20] 10.222.0.60 () {56 vars in 1343 bytes} [Wed Dec 15 13:18:13 2021] GET /identity/v3/role_assignments?user.id=851ea07e9b2c466298b37f0fddcbf9c5&scope.domain.id=default&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 233 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:15.959495 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0e17-6178-4d82-929f-0b73295f721a None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:15.960454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0e17-6178-4d82-929f-0b73295f721a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:15.960958 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0e17-6178-4d82-929f-0b73295f721a None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:15.963297 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 12/21] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:15.969576 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ad16c-fdf5-4a99-b772-36b428806c6c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:15.970419 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ad16c-fdf5-4a99-b772-36b428806c6c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:15.970937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ad16c-fdf5-4a99-b772-36b428806c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:15.984102 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aaa1b-a8a3-4e40-9075-63bc3b845a46 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:15.985205 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aaa1b-a8a3-4e40-9075-63bc3b845a46 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:15.985684 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aaa1b-a8a3-4e40-9075-63bc3b845a46 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:15.988026 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 13/22] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:15.993183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e220c2-6a0d-46a6-9143-d68dd00cc0f2 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:15.993733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e220c2-6a0d-46a6-9143-d68dd00cc0f2 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:15.994216 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e220c2-6a0d-46a6-9143-d68dd00cc0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.004168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-772ad16c-fdf5-4a99-b772-36b428806c6c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:16.005373 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-772ad16c-fdf5-4a99-b772-36b428806c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:16.013326 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 10/23] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:16.016825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-65e220c2-6a0d-46a6-9143-d68dd00cc0f2 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:16.018193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-65e220c2-6a0d-46a6-9143-d68dd00cc0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:16.026194 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 14/24] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:16.050320 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ad16c-fdf5-4a99-b772-36b428806c6c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:16.059797 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ad16c-fdf5-4a99-b772-36b428806c6c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:16.060945 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e220c2-6a0d-46a6-9143-d68dd00cc0f2 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:16.069850 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d51097-1cb6-471c-8cc4-8ac3985cadd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:16.070915 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d51097-1cb6-471c-8cc4-8ac3985cadd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:16.072444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d51097-1cb6-471c-8cc4-8ac3985cadd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:16.072913 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d51097-1cb6-471c-8cc4-8ac3985cadd3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.079354 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e220c2-6a0d-46a6-9143-d68dd00cc0f2 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:16.086184 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839a5e4-a86c-426e-a98d-9f7d94fbdcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:16.087179 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839a5e4-a86c-426e-a98d-9f7d94fbdcb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:16.087658 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839a5e4-a86c-426e-a98d-9f7d94fbdcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:16.088124 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839a5e4-a86c-426e-a98d-9f7d94fbdcb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.089097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839a5e4-a86c-426e-a98d-9f7d94fbdcb8 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:16.090299 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-6839a5e4-a86c-426e-a98d-9f7d94fbdcb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:16.090299 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:18:16.090299 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:18:16.091558 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839a5e4-a86c-426e-a98d-9f7d94fbdcb8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:16.092042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d51097-1cb6-471c-8cc4-8ac3985cadd3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:16.103837 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-d3d51097-1cb6-471c-8cc4-8ac3985cadd3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:18:16.105464 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 11/25] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:18:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:16.112720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d51097-1cb6-471c-8cc4-8ac3985cadd3 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:16.129365 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d51097-1cb6-471c-8cc4-8ac3985cadd3 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:16.150564 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fb530-bbbb-4e6e-afb3-788b17f000ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:16.151577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb530-bbbb-4e6e-afb3-788b17f000ff admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:16.152013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb530-bbbb-4e6e-afb3-788b17f000ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:16.152446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb530-bbbb-4e6e-afb3-788b17f000ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.153391 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fb530-bbbb-4e6e-afb3-788b17f000ff admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:16.153853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fb530-bbbb-4e6e-afb3-788b17f000ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:16.155103 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-0b7fb530-bbbb-4e6e-afb3-788b17f000ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:16.155103 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:18:16.155103 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:18:16.156913 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fb530-bbbb-4e6e-afb3-788b17f000ff admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:16.172748 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 12/26] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:16.174391 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee632a58-f2e4-4159-8c8f-627542d2bb5a None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:16.174891 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee632a58-f2e4-4159-8c8f-627542d2bb5a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:16.175320 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee632a58-f2e4-4159-8c8f-627542d2bb5a None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.177635 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:16.178595 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee632a58-f2e4-4159-8c8f-627542d2bb5a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:16.196329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee632a58-f2e4-4159-8c8f-627542d2bb5a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:16.201164 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb6c19-a40c-48d2-8467-1d3ef8e0d02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:16.202255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb6c19-a40c-48d2-8467-1d3ef8e0d02a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:16.202691 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb6c19-a40c-48d2-8467-1d3ef8e0d02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:16.203676 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb6c19-a40c-48d2-8467-1d3ef8e0d02a admin admin] PATH_INFO: `/v3/users/851ea07e9b2c466298b37f0fddcbf9c5` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.205141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb6c19-a40c-48d2-8467-1d3ef8e0d02a admin admin] RBAC: Authorizing `identity:get_user(user_id=851ea07e9b2c466298b37f0fddcbf9c5)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:16.207253 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb6c19-a40c-48d2-8467-1d3ef8e0d02a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:16.209490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 14/28] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:16 2021] GET /identity/v3/users/851ea07e9b2c466298b37f0fddcbf9c5 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:16.219336 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60667e0-1cbe-4ffb-b726-d7c2f8fd6beb None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:16.219908 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60667e0-1cbe-4ffb-b726-d7c2f8fd6beb None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:16.220338 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60667e0-1cbe-4ffb-b726-d7c2f8fd6beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.252922 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-f60667e0-1cbe-4ffb-b726-d7c2f8fd6beb None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:16.254385 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-f60667e0-1cbe-4ffb-b726-d7c2f8fd6beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:16.278700 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 15/29] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:16.279792 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60667e0-1cbe-4ffb-b726-d7c2f8fd6beb None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:16.296244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60667e0-1cbe-4ffb-b726-d7c2f8fd6beb None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:16.317006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674f5b8-ee6d-439b-86d2-79e212cb7e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:16.318023 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674f5b8-ee6d-439b-86d2-79e212cb7e97 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:16.318453 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674f5b8-ee6d-439b-86d2-79e212cb7e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:16.318912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674f5b8-ee6d-439b-86d2-79e212cb7e97 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.320487 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674f5b8-ee6d-439b-86d2-79e212cb7e97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:16.322385 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674f5b8-ee6d-439b-86d2-79e212cb7e97 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:16.325807 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 16/30] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:16.326787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674f5b8-ee6d-439b-86d2-79e212cb7e97 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:16.330763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 15/31] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:18:16 2021] POST /identity/v3/roles => generated 225 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:18:16.336274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839a5e4-a86c-426e-a98d-9f7d94fbdcb8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:16.337918 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674f5b8-ee6d-439b-86d2-79e212cb7e97 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:16.347571 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839a5e4-a86c-426e-a98d-9f7d94fbdcb8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:16.358692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8b3f-573a-4a08-807b-82096d35fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:16.359580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5a876-9136-45f6-9085-828568fbeb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:16.360172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8b3f-573a-4a08-807b-82096d35fcbd admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:16.360393 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5a876-9136-45f6-9085-828568fbeb53 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:16.360687 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5a876-9136-45f6-9085-828568fbeb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:16.360881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8b3f-573a-4a08-807b-82096d35fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:16.360981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5a876-9136-45f6-9085-828568fbeb53 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.361430 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8b3f-573a-4a08-807b-82096d35fcbd admin admin] PATH_INFO: `/v3/domains/default/users/851ea07e9b2c466298b37f0fddcbf9c5/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.363980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd8b3f-573a-4a08-807b-82096d35fcbd admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=851ea07e9b2c466298b37f0fddcbf9c5, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:16.365358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-35cd8b3f-573a-4a08-807b-82096d35fcbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:16.365358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:18:16.365358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:18:16.367867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd8b3f-573a-4a08-807b-82096d35fcbd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:16.387716 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5a876-9136-45f6-9085-828568fbeb53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:16.389609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5a876-9136-45f6-9085-828568fbeb53 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:16.390129 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 16/32] 10.222.0.60 () {58 vars in 1382 bytes} [Wed Dec 15 13:18:16 2021] PUT /identity/v3/domains/default/users/851ea07e9b2c466298b37f0fddcbf9c5/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:18:16.425811 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-cba5a876-9136-45f6-9085-828568fbeb53 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:18:16.427145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 17/33] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:16.433614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8b3f-573a-4a08-807b-82096d35fcbd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:16.524444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8b3f-573a-4a08-807b-82096d35fcbd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:16.529140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11a7e8-bc9f-4b4a-bf6b-95ea194e0e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:16.529966 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11a7e8-bc9f-4b4a-bf6b-95ea194e0e03 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:16.530394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11a7e8-bc9f-4b4a-bf6b-95ea194e0e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:16.531366 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11a7e8-bc9f-4b4a-bf6b-95ea194e0e03 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.532276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11a7e8-bc9f-4b4a-bf6b-95ea194e0e03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:16.532733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11a7e8-bc9f-4b4a-bf6b-95ea194e0e03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:16.533914 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-ba11a7e8-bc9f-4b4a-bf6b-95ea194e0e03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:16.533914 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:18:16.533914 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:18:16.535161 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11a7e8-bc9f-4b4a-bf6b-95ea194e0e03 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:16.566712 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 17/34] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:18:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:16.573113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5a876-9136-45f6-9085-828568fbeb53 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:16.588729 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5a876-9136-45f6-9085-828568fbeb53 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:16.605300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84812356-abdc-41f9-a0e5-fea432b04975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:16.605986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84812356-abdc-41f9-a0e5-fea432b04975 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:16.606270 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84812356-abdc-41f9-a0e5-fea432b04975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:16.606545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84812356-abdc-41f9-a0e5-fea432b04975 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.607380 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84812356-abdc-41f9-a0e5-fea432b04975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:16.608408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-84812356-abdc-41f9-a0e5-fea432b04975 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:16.608408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:18:16.608408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:18:16.610299 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84812356-abdc-41f9-a0e5-fea432b04975 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:16.629030 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e67e6-962d-48d4-8463-f7e4385c810b None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:16.629551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e67e6-962d-48d4-8463-f7e4385c810b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:16.630003 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e67e6-962d-48d4-8463-f7e4385c810b None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.632018 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 18/35] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:18:16.638406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ccced-553f-43c3-b7ef-2b43e4df4a34 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:16.638947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ccced-553f-43c3-b7ef-2b43e4df4a34 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:16.639610 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ccced-553f-43c3-b7ef-2b43e4df4a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.676217 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a78ccced-553f-43c3-b7ef-2b43e4df4a34 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:16.678115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a78ccced-553f-43c3-b7ef-2b43e4df4a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:16.703548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 19/36] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:16.743135 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ccced-553f-43c3-b7ef-2b43e4df4a34 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:16.761651 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ccced-553f-43c3-b7ef-2b43e4df4a34 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:16.776430 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c52cb-4aad-494b-a73c-e93b3b3494f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:16.777045 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c52cb-4aad-494b-a73c-e93b3b3494f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:16.777333 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c52cb-4aad-494b-a73c-e93b3b3494f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:16.777615 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c52cb-4aad-494b-a73c-e93b3b3494f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:16.778471 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c52cb-4aad-494b-a73c-e93b3b3494f4 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:16.780193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c52cb-4aad-494b-a73c-e93b3b3494f4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:16.805419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 20/37] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:18:16 2021] POST /identity/v3/roles => generated 219 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:18:16.883231 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 18/38] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Dec 15 13:18:16 2021] POST /identity/v3/projects => generated 301 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:18:17.278734 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be085cd9-5f13-498e-8efa-57d6d285df37 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:17.279320 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be085cd9-5f13-498e-8efa-57d6d285df37 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:17.279320 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be085cd9-5f13-498e-8efa-57d6d285df37 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:17.281838 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 21/39] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:17.287653 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04fc7c-f439-481b-b16c-02563a7a44c6 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:17.288019 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04fc7c-f439-481b-b16c-02563a7a44c6 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:17.288227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04fc7c-f439-481b-b16c-02563a7a44c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:17.307361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-aa04fc7c-f439-481b-b16c-02563a7a44c6 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:17.309054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-aa04fc7c-f439-481b-b16c-02563a7a44c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:17.376229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 19/40] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:17.399626 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be085cd9-5f13-498e-8efa-57d6d285df37 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:17.411815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be085cd9-5f13-498e-8efa-57d6d285df37 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:17.416079 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0a0ef-14a3-492f-9e60-bf673cdc4a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:17.416996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0a0ef-14a3-492f-9e60-bf673cdc4a29 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:17.417282 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0a0ef-14a3-492f-9e60-bf673cdc4a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:17.417562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0a0ef-14a3-492f-9e60-bf673cdc4a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:17.418338 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0a0ef-14a3-492f-9e60-bf673cdc4a29 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:17.420018 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0a0ef-14a3-492f-9e60-bf673cdc4a29 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:17.434155 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 22/41] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:18:17 2021] POST /identity/v3/roles => generated 223 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:18:17.635563 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3617e-208e-4627-9ad0-61e313d29c7c None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:17.635793 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3617e-208e-4627-9ad0-61e313d29c7c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:17.636272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3617e-208e-4627-9ad0-61e313d29c7c None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:17.638132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 20/42] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:17.644582 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca12e0-d8ab-44c6-b3a5-fbccfc402b5b None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:17.644882 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca12e0-d8ab-44c6-b3a5-fbccfc402b5b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:17.645159 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca12e0-d8ab-44c6-b3a5-fbccfc402b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:17.663791 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ccca12e0-d8ab-44c6-b3a5-fbccfc402b5b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:17.664998 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ccca12e0-d8ab-44c6-b3a5-fbccfc402b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:17.673442 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 23/43] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:17.697894 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3617e-208e-4627-9ad0-61e313d29c7c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:17.710078 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3617e-208e-4627-9ad0-61e313d29c7c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:17.714391 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ef213-0ba6-4e39-8d0d-fd47cd6b55f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:17.715225 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ef213-0ba6-4e39-8d0d-fd47cd6b55f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:17.715511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ef213-0ba6-4e39-8d0d-fd47cd6b55f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:17.715792 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ef213-0ba6-4e39-8d0d-fd47cd6b55f6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:17.716983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ef213-0ba6-4e39-8d0d-fd47cd6b55f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:17.718905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ef213-0ba6-4e39-8d0d-fd47cd6b55f6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:17.720568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 21/44] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:17.726409 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca12e0-d8ab-44c6-b3a5-fbccfc402b5b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:17.735947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca12e0-d8ab-44c6-b3a5-fbccfc402b5b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:17.740381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86a604-4fe0-495a-bfb0-73d3d18ced9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:17.741021 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86a604-4fe0-495a-bfb0-73d3d18ced9f admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:17.741305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86a604-4fe0-495a-bfb0-73d3d18ced9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:17.741580 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86a604-4fe0-495a-bfb0-73d3d18ced9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:17.742316 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86a604-4fe0-495a-bfb0-73d3d18ced9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:17.743397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-9a86a604-4fe0-495a-bfb0-73d3d18ced9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:17.743397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:18:17.743397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:18:17.744654 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86a604-4fe0-495a-bfb0-73d3d18ced9f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:17.772080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 24/45] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Dec 15 13:18:17 2021] POST /identity/v3/projects => generated 312 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:18:19.173153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae721d4-a481-4c03-9ff0-cf949cfec2fb None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:19.173666 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae721d4-a481-4c03-9ff0-cf949cfec2fb None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:19.173773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae721d4-a481-4c03-9ff0-cf949cfec2fb None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:19.175571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 22/46] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:19.181704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc61a54-7ef4-453f-9ac8-327bfde240cb None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:19.182127 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc61a54-7ef4-453f-9ac8-327bfde240cb None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:19.182281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc61a54-7ef4-453f-9ac8-327bfde240cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:19.200430 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-6cc61a54-7ef4-453f-9ac8-327bfde240cb None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:19.201663 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-6cc61a54-7ef4-453f-9ac8-327bfde240cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:19.264130 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 25/47] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:19.289176 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae721d4-a481-4c03-9ff0-cf949cfec2fb None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:19.301277 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae721d4-a481-4c03-9ff0-cf949cfec2fb None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:19.305553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e3552-00d9-44c7-9faa-f5c0bc52aa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:19.306317 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3552-00d9-44c7-9faa-f5c0bc52aa4e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:19.306769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3552-00d9-44c7-9faa-f5c0bc52aa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:19.307059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3552-00d9-44c7-9faa-f5c0bc52aa4e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:19.318018 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e3552-00d9-44c7-9faa-f5c0bc52aa4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:19.324915 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-407e3552-00d9-44c7-9faa-f5c0bc52aa4e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:18:19.326058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 23/48] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:18:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:19.332541 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc61a54-7ef4-453f-9ac8-327bfde240cb None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:19.342381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc61a54-7ef4-453f-9ac8-327bfde240cb None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:19.347353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcb5ca-8372-4310-94e9-7fee692c6ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:19.348007 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcb5ca-8372-4310-94e9-7fee692c6ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:19.348295 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcb5ca-8372-4310-94e9-7fee692c6ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:19.348583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcb5ca-8372-4310-94e9-7fee692c6ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:19.349359 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcb5ca-8372-4310-94e9-7fee692c6ac2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:19.349671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcb5ca-8372-4310-94e9-7fee692c6ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:19.351340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcb5ca-8372-4310-94e9-7fee692c6ac2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:19.359532 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 26/49] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:19.365087 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e3552-00d9-44c7-9faa-f5c0bc52aa4e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:19.374392 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e3552-00d9-44c7-9faa-f5c0bc52aa4e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:19.378811 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b29e0-c25d-4136-899b-3dfd8483b27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:19.379697 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b29e0-c25d-4136-899b-3dfd8483b27b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:19.379986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b29e0-c25d-4136-899b-3dfd8483b27b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:19.380269 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b29e0-c25d-4136-899b-3dfd8483b27b admin admin] PATH_INFO: `/v3/users/851ea07e9b2c466298b37f0fddcbf9c5` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:19.381487 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b29e0-c25d-4136-899b-3dfd8483b27b admin admin] RBAC: Authorizing `identity:get_user(user_id=851ea07e9b2c466298b37f0fddcbf9c5)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:19.383351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b29e0-c25d-4136-899b-3dfd8483b27b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:19.385062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 24/50] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:19 2021] GET /identity/v3/users/851ea07e9b2c466298b37f0fddcbf9c5 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:19.390875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcb5ca-8372-4310-94e9-7fee692c6ac2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:19.400232 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcb5ca-8372-4310-94e9-7fee692c6ac2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:19.404840 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb396631-98e5-4526-aeff-cffc1f45020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:19.405602 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb396631-98e5-4526-aeff-cffc1f45020b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:19.405948 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb396631-98e5-4526-aeff-cffc1f45020b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:19.406751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb396631-98e5-4526-aeff-cffc1f45020b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:19.408255 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb396631-98e5-4526-aeff-cffc1f45020b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:19.409946 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb396631-98e5-4526-aeff-cffc1f45020b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:19.411536 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 27/51] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:19.417450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b29e0-c25d-4136-899b-3dfd8483b27b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:19.426955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b29e0-c25d-4136-899b-3dfd8483b27b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:19.431281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98a482-cf0b-4ac2-8fc7-03b5229d6501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:19.431909 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98a482-cf0b-4ac2-8fc7-03b5229d6501 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:19.432200 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98a482-cf0b-4ac2-8fc7-03b5229d6501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:19.432482 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98a482-cf0b-4ac2-8fc7-03b5229d6501 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:19.433327 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98a482-cf0b-4ac2-8fc7-03b5229d6501 admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.domain.id=default, user.id=851ea07e9b2c466298b37f0fddcbf9c5) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:19.433644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98a482-cf0b-4ac2-8fc7-03b5229d6501 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:19.435614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98a482-cf0b-4ac2-8fc7-03b5229d6501 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:19.441516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 25/52] 10.222.0.60 () {56 vars in 1343 bytes} [Wed Dec 15 13:18:19 2021] GET /identity/v3/role_assignments?user.id=851ea07e9b2c466298b37f0fddcbf9c5&scope.domain.id=default&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:20.110670 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8fcae-7839-4c87-89ee-22deee3c4432 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:20.111003 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8fcae-7839-4c87-89ee-22deee3c4432 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:20.111291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8fcae-7839-4c87-89ee-22deee3c4432 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:20.113093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 28/53] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:20.118816 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e28d84-4302-4694-a14e-78789a052fd5 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:20.119145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e28d84-4302-4694-a14e-78789a052fd5 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:20.119436 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e28d84-4302-4694-a14e-78789a052fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:20.137618 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-55e28d84-4302-4694-a14e-78789a052fd5 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:20.138823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-55e28d84-4302-4694-a14e-78789a052fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:20.146276 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 26/54] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:20.169674 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8fcae-7839-4c87-89ee-22deee3c4432 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:20.181967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8fcae-7839-4c87-89ee-22deee3c4432 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:20.186251 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4a250-a17f-49d8-b2d1-e0967fc79f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:20.187074 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a250-a17f-49d8-b2d1-e0967fc79f8a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:20.187917 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a250-a17f-49d8-b2d1-e0967fc79f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:20.188202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a250-a17f-49d8-b2d1-e0967fc79f8a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:20.189395 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4a250-a17f-49d8-b2d1-e0967fc79f8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:20.191134 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4a250-a17f-49d8-b2d1-e0967fc79f8a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:20.192692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 29/55] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:20.197956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e28d84-4302-4694-a14e-78789a052fd5 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:20.206601 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e28d84-4302-4694-a14e-78789a052fd5 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:20.210971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40e54b-eb92-49ba-9c20-be3cc9365060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:20.211636 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40e54b-eb92-49ba-9c20-be3cc9365060 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:20.211924 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40e54b-eb92-49ba-9c20-be3cc9365060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:20.212207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40e54b-eb92-49ba-9c20-be3cc9365060 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:20.212924 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40e54b-eb92-49ba-9c20-be3cc9365060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:20.214838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40e54b-eb92-49ba-9c20-be3cc9365060 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:20.238838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 27/56] 10.222.0.60 () {60 vars in 1161 bytes} [Wed Dec 15 13:18:20 2021] POST /identity/v3/projects => generated 298 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:18:22.582382 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c211637-d318-48a8-87ac-d91f79339184 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:22.582932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c211637-d318-48a8-87ac-d91f79339184 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:22.583019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c211637-d318-48a8-87ac-d91f79339184 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:22.584817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 30/57] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:22.590426 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d4983-aaa8-4cb1-85cb-a178187ecc07 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:22.590864 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d4983-aaa8-4cb1-85cb-a178187ecc07 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:22.591026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d4983-aaa8-4cb1-85cb-a178187ecc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:22.610303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-cf3d4983-aaa8-4cb1-85cb-a178187ecc07 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:22.611534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-cf3d4983-aaa8-4cb1-85cb-a178187ecc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:22.666085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 28/58] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:22.691344 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c211637-d318-48a8-87ac-d91f79339184 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:22.703036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c211637-d318-48a8-87ac-d91f79339184 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:22.707252 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d829f-afad-4c82-9975-b335b30c2df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:22.708020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d829f-afad-4c82-9975-b335b30c2df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:22.708303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d829f-afad-4c82-9975-b335b30c2df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:22.708583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d829f-afad-4c82-9975-b335b30c2df5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:22.709758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d829f-afad-4c82-9975-b335b30c2df5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:22.711485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d829f-afad-4c82-9975-b335b30c2df5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:22.713035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 31/59] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:22 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:22.718833 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d4983-aaa8-4cb1-85cb-a178187ecc07 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:22.727327 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d4983-aaa8-4cb1-85cb-a178187ecc07 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:22.731621 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13e400-9612-4ef3-8514-da3189525a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:22.732266 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13e400-9612-4ef3-8514-da3189525a0b admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:22.732549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13e400-9612-4ef3-8514-da3189525a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:22.732827 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13e400-9612-4ef3-8514-da3189525a0b admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:22.733552 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13e400-9612-4ef3-8514-da3189525a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:22.735203 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-ef13e400-9612-4ef3-8514-da3189525a0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:22.735203 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:18:22.735203 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:18:22.736418 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13e400-9612-4ef3-8514-da3189525a0b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:22.759287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 29/60] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:18:22 2021] POST /identity/v3/users => generated 275 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:18:26.170115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8f0f6-709a-49ef-967d-42767edfed4f None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.171232 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8f0f6-709a-49ef-967d-42767edfed4f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.171759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8f0f6-709a-49ef-967d-42767edfed4f None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.174061 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 32/61] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:26.179693 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7beda7-eedf-4930-9952-6c096745e3f7 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.180560 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7beda7-eedf-4930-9952-6c096745e3f7 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.181059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7beda7-eedf-4930-9952-6c096745e3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.207681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-9c7beda7-eedf-4930-9952-6c096745e3f7 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:26.208891 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9c7beda7-eedf-4930-9952-6c096745e3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:26.223455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 30/62] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:26.259623 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8f0f6-709a-49ef-967d-42767edfed4f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.281706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8f0f6-709a-49ef-967d-42767edfed4f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.286725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0ce29-5b0e-4ed7-acd8-416d914d3663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.287833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0ce29-5b0e-4ed7-acd8-416d914d3663 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.288319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0ce29-5b0e-4ed7-acd8-416d914d3663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.288791 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0ce29-5b0e-4ed7-acd8-416d914d3663 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.309928 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0ce29-5b0e-4ed7-acd8-416d914d3663 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:26.317718 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-0db0ce29-5b0e-4ed7-acd8-416d914d3663 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:18:26.319511 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 33/63] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:26.325371 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7beda7-eedf-4930-9952-6c096745e3f7 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.339926 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7beda7-eedf-4930-9952-6c096745e3f7 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.350727 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946885c-3c28-4841-90bc-ff28263714dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.351443 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946885c-3c28-4841-90bc-ff28263714dd admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.351733 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946885c-3c28-4841-90bc-ff28263714dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.352013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946885c-3c28-4841-90bc-ff28263714dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.352877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946885c-3c28-4841-90bc-ff28263714dd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:26.353192 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946885c-3c28-4841-90bc-ff28263714dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:26.354834 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946885c-3c28-4841-90bc-ff28263714dd admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:26.373367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 31/64] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:26.379844 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0ce29-5b0e-4ed7-acd8-416d914d3663 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.395858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0ce29-5b0e-4ed7-acd8-416d914d3663 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.406622 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33090f4-2fda-4703-8aad-b70839d1af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.407772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33090f4-2fda-4703-8aad-b70839d1af32 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.408261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33090f4-2fda-4703-8aad-b70839d1af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.408738 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33090f4-2fda-4703-8aad-b70839d1af32 admin admin] PATH_INFO: `/v3/users/24492a62183b4771b1a11c25752c83c7` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.432535 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b19fd-bf21-4273-a3c6-6a356dcda78a None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.432904 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33090f4-2fda-4703-8aad-b70839d1af32 admin admin] RBAC: Authorizing `identity:get_user(user_id=24492a62183b4771b1a11c25752c83c7)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:26.433330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b19fd-bf21-4273-a3c6-6a356dcda78a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.433807 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b19fd-bf21-4273-a3c6-6a356dcda78a None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.435122 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33090f4-2fda-4703-8aad-b70839d1af32 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:26.436280 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 32/65] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:18:26.439278 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 34/66] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/users/24492a62183b4771b1a11c25752c83c7 => generated 275 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:26.443057 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22fbc6-4378-4ea5-9480-0a026b8e4344 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.443557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22fbc6-4378-4ea5-9480-0a026b8e4344 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.444033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22fbc6-4378-4ea5-9480-0a026b8e4344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.444947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33090f4-2fda-4703-8aad-b70839d1af32 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.457749 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33090f4-2fda-4703-8aad-b70839d1af32 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.467337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-4a22fbc6-4378-4ea5-9480-0a026b8e4344 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:26.468558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-4a22fbc6-4378-4ea5-9480-0a026b8e4344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:26.471788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90a590-a23e-42ee-9a35-eca401c21cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.472437 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90a590-a23e-42ee-9a35-eca401c21cee admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.472720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90a590-a23e-42ee-9a35-eca401c21cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.472999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90a590-a23e-42ee-9a35-eca401c21cee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.485948 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90a590-a23e-42ee-9a35-eca401c21cee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:26.487842 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90a590-a23e-42ee-9a35-eca401c21cee admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:26.494073 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 33/67] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:26.507485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 35/68] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:18:26.513646 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22fbc6-4378-4ea5-9480-0a026b8e4344 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.520557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90a590-a23e-42ee-9a35-eca401c21cee admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.531337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90a590-a23e-42ee-9a35-eca401c21cee admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.534395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22fbc6-4378-4ea5-9480-0a026b8e4344 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.539119 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6151f-e114-4fd0-8d92-d1cd1366e84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.540148 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6151f-e114-4fd0-8d92-d1cd1366e84a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.540569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6151f-e114-4fd0-8d92-d1cd1366e84a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.540981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6151f-e114-4fd0-8d92-d1cd1366e84a admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.542580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6151f-e114-4fd0-8d92-d1cd1366e84a admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:26.544824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6151f-e114-4fd0-8d92-d1cd1366e84a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:26.546665 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:26.547873 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96aca5-1503-479f-8861-b9fec448a1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.549042 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96aca5-1503-479f-8861-b9fec448a1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.549411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96aca5-1503-479f-8861-b9fec448a1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.549688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96aca5-1503-479f-8861-b9fec448a1d5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.553613 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6151f-e114-4fd0-8d92-d1cd1366e84a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.570200 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6151f-e114-4fd0-8d92-d1cd1366e84a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.571012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96aca5-1503-479f-8861-b9fec448a1d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:26.578609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-bd96aca5-1503-479f-8861-b9fec448a1d5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:18:26.583438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d4d28-60c5-4b1d-a67a-dee5d9be08cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.584347 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d4d28-60c5-4b1d-a67a-dee5d9be08cf admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.584826 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d4d28-60c5-4b1d-a67a-dee5d9be08cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.585295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d4d28-60c5-4b1d-a67a-dee5d9be08cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.586358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d4d28-60c5-4b1d-a67a-dee5d9be08cf admin admin] RBAC: Adding query filter params (role.id=e734a22c1b2c40feb0147271d002bdee, scope.project.id=d9bef98222d5424aa293398d503f422d, user.id=24492a62183b4771b1a11c25752c83c7) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:26.586883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d4d28-60c5-4b1d-a67a-dee5d9be08cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:26.588946 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d4d28-60c5-4b1d-a67a-dee5d9be08cf admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:26.590680 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 36/70] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:18:26.599252 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96aca5-1503-479f-8861-b9fec448a1d5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.601528 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/role_assignments?user.id=24492a62183b4771b1a11c25752c83c7&scope.project.id=d9bef98222d5424aa293398d503f422d&role.id=e734a22c1b2c40feb0147271d002bdee => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:26.615100 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96aca5-1503-479f-8861-b9fec448a1d5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.620081 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754d748-12f5-43d8-8131-8c19deb9a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.620984 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754d748-12f5-43d8-8131-8c19deb9a246 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.621474 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754d748-12f5-43d8-8131-8c19deb9a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.621979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754d748-12f5-43d8-8131-8c19deb9a246 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.622993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754d748-12f5-43d8-8131-8c19deb9a246 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:26.623523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754d748-12f5-43d8-8131-8c19deb9a246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:26.625863 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754d748-12f5-43d8-8131-8c19deb9a246 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:26.636118 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 37/72] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:26.644191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d4d28-60c5-4b1d-a67a-dee5d9be08cf admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.667004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d4d28-60c5-4b1d-a67a-dee5d9be08cf admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.671998 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0524e-2bbd-4d38-b504-fadcd56371b6 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.672614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0524e-2bbd-4d38-b504-fadcd56371b6 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.673097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0524e-2bbd-4d38-b504-fadcd56371b6 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.675245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 38/73] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:18:26.678005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335fe84-c57a-4d5b-87c6-cbc761a85bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.679330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335fe84-c57a-4d5b-87c6-cbc761a85bee admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.679825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335fe84-c57a-4d5b-87c6-cbc761a85bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.681447 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84f71f-bcbc-40b5-9422-aff16d2da619 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.681978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84f71f-bcbc-40b5-9422-aff16d2da619 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.682459 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84f71f-bcbc-40b5-9422-aff16d2da619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.685608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335fe84-c57a-4d5b-87c6-cbc761a85bee admin admin] PATH_INFO: `/v3/users/851ea07e9b2c466298b37f0fddcbf9c5` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.694639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335fe84-c57a-4d5b-87c6-cbc761a85bee admin admin] RBAC: Authorizing `identity:get_user(user_id=851ea07e9b2c466298b37f0fddcbf9c5)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:26.698402 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335fe84-c57a-4d5b-87c6-cbc761a85bee admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:26.703294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 36/74] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/users/851ea07e9b2c466298b37f0fddcbf9c5 => generated 247 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:26.711647 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335fe84-c57a-4d5b-87c6-cbc761a85bee admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.722662 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335fe84-c57a-4d5b-87c6-cbc761a85bee admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.727466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1ac93-c5c8-4684-a237-028b107cb6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.728124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1ac93-c5c8-4684-a237-028b107cb6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.728407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1ac93-c5c8-4684-a237-028b107cb6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.729274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1ac93-c5c8-4684-a237-028b107cb6e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.738056 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1ac93-c5c8-4684-a237-028b107cb6e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:26.739893 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1ac93-c5c8-4684-a237-028b107cb6e2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:26.740093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ef84f71f-bcbc-40b5-9422-aff16d2da619 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:26.741299 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ef84f71f-bcbc-40b5-9422-aff16d2da619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:26.750092 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 37/75] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:26.756173 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1ac93-c5c8-4684-a237-028b107cb6e2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.765872 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1ac93-c5c8-4684-a237-028b107cb6e2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.770462 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cef32-80a9-490f-b321-a7f6175ff825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.771379 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cef32-80a9-490f-b321-a7f6175ff825 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.771662 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cef32-80a9-490f-b321-a7f6175ff825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.771942 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cef32-80a9-490f-b321-a7f6175ff825 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.773192 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cef32-80a9-490f-b321-a7f6175ff825 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:26.775370 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cef32-80a9-490f-b321-a7f6175ff825 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:26.777641 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 38/76] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:26.779807 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 39/77] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:26.784426 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cef32-80a9-490f-b321-a7f6175ff825 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.794755 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cef32-80a9-490f-b321-a7f6175ff825 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.807001 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cf087-d254-418e-91af-8e033d38864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.807691 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cf087-d254-418e-91af-8e033d38864d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.807974 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cf087-d254-418e-91af-8e033d38864d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.808252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cf087-d254-418e-91af-8e033d38864d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.809131 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cf087-d254-418e-91af-8e033d38864d admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=d9bef98222d5424aa293398d503f422d, user.id=851ea07e9b2c466298b37f0fddcbf9c5) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:26.809443 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cf087-d254-418e-91af-8e033d38864d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:26.811611 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cf087-d254-418e-91af-8e033d38864d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:26.811913 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84f71f-bcbc-40b5-9422-aff16d2da619 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.818775 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 39/78] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/role_assignments?user.id=851ea07e9b2c466298b37f0fddcbf9c5&scope.project.id=d9bef98222d5424aa293398d503f422d&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:26.829419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84f71f-bcbc-40b5-9422-aff16d2da619 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.832301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c0844-253f-4dd6-9e6d-0db5ada308a1 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.832577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c0844-253f-4dd6-9e6d-0db5ada308a1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.832865 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c0844-253f-4dd6-9e6d-0db5ada308a1 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.834705 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 40/79] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:18:26.838371 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2a9ee-f0e4-4f05-a41b-abf8e3168984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.839211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a9ee-f0e4-4f05-a41b-abf8e3168984 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.839494 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a9ee-f0e4-4f05-a41b-abf8e3168984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.839768 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a9ee-f0e4-4f05-a41b-abf8e3168984 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.844669 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b4ed7-416e-4260-b986-58cc950e7d1e None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.844998 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b4ed7-416e-4260-b986-58cc950e7d1e None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.845226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b4ed7-416e-4260-b986-58cc950e7d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.863923 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2a9ee-f0e4-4f05-a41b-abf8e3168984 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:26.864110 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-8d9b4ed7-416e-4260-b986-58cc950e7d1e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:26.865306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8d9b4ed7-416e-4260-b986-58cc950e7d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:26.872050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-03f2a9ee-f0e4-4f05-a41b-abf8e3168984 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:18:26.878916 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 41/80] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:26.880131 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 40/81] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:26.886084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b4ed7-416e-4260-b986-58cc950e7d1e None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.900646 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b4ed7-416e-4260-b986-58cc950e7d1e None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.905462 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee99ed-6669-4b2d-a06e-be68a5a3756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.907875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee99ed-6669-4b2d-a06e-be68a5a3756c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.908165 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee99ed-6669-4b2d-a06e-be68a5a3756c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.908444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee99ed-6669-4b2d-a06e-be68a5a3756c admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.909234 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee99ed-6669-4b2d-a06e-be68a5a3756c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:26.909544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee99ed-6669-4b2d-a06e-be68a5a3756c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:26.911260 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee99ed-6669-4b2d-a06e-be68a5a3756c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:26.918448 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2a9ee-f0e4-4f05-a41b-abf8e3168984 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.922063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 42/82] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:26.928173 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee99ed-6669-4b2d-a06e-be68a5a3756c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.940425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2a9ee-f0e4-4f05-a41b-abf8e3168984 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.943159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee99ed-6669-4b2d-a06e-be68a5a3756c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.950451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dbcbb-1522-42c5-880a-ab454a90b611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.951293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dbcbb-1522-42c5-880a-ab454a90b611 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.951578 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dbcbb-1522-42c5-880a-ab454a90b611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.951856 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dbcbb-1522-42c5-880a-ab454a90b611 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.953471 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90fe18-aa14-4d16-92c6-35565cab8562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.954340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90fe18-aa14-4d16-92c6-35565cab8562 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.954616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90fe18-aa14-4d16-92c6-35565cab8562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.954910 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90fe18-aa14-4d16-92c6-35565cab8562 admin admin] PATH_INFO: `/v3/users/24492a62183b4771b1a11c25752c83c7` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.957706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90fe18-aa14-4d16-92c6-35565cab8562 admin admin] RBAC: Authorizing `identity:get_user(user_id=24492a62183b4771b1a11c25752c83c7)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:26.960095 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90fe18-aa14-4d16-92c6-35565cab8562 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:26.961721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 43/83] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/users/24492a62183b4771b1a11c25752c83c7 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:26.967772 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90fe18-aa14-4d16-92c6-35565cab8562 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:26.976747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dbcbb-1522-42c5-880a-ab454a90b611 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:26.978684 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90fe18-aa14-4d16-92c6-35565cab8562 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:26.986955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039c6a1-45b0-4d24-8a3d-be494ea0e17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:26.986955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039c6a1-45b0-4d24-8a3d-be494ea0e17f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.986955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039c6a1-45b0-4d24-8a3d-be494ea0e17f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.986955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039c6a1-45b0-4d24-8a3d-be494ea0e17f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.993315 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-c03dbcbb-1522-42c5-880a-ab454a90b611 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:18:26.994675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 41/84] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:18:26.996084 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae875ce-2cdc-4673-9a86-cd1c3c563712 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:26.996378 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae875ce-2cdc-4673-9a86-cd1c3c563712 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:26.996665 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae875ce-2cdc-4673-9a86-cd1c3c563712 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:26.997126 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039c6a1-45b0-4d24-8a3d-be494ea0e17f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:26.998477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 42/85] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:26.998982 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039c6a1-45b0-4d24-8a3d-be494ea0e17f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:27.009732 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 44/86] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:18:27.011983 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae875ce-2cdc-4673-9a86-cd1c3c563712 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:27.017020 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dab17e-008e-4f59-8cb4-9f457f6028db None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:27.017436 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dab17e-008e-4f59-8cb4-9f457f6028db None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:27.017785 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dab17e-008e-4f59-8cb4-9f457f6028db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:27.028622 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae875ce-2cdc-4673-9a86-cd1c3c563712 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:27.034254 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0c42-0f82-43ff-a0ac-955761b6c6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:27.034959 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0c42-0f82-43ff-a0ac-955761b6c6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:27.035244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0c42-0f82-43ff-a0ac-955761b6c6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:27.035520 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0c42-0f82-43ff-a0ac-955761b6c6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:27.036297 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f0c42-0f82-43ff-a0ac-955761b6c6a8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:27.036661 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f0c42-0f82-43ff-a0ac-955761b6c6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:27.038266 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-78dab17e-008e-4f59-8cb4-9f457f6028db None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:27.038386 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f0c42-0f82-43ff-a0ac-955761b6c6a8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:27.039540 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-78dab17e-008e-4f59-8cb4-9f457f6028db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:27.048165 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 43/87] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:18:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:27.048574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 45/88] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:27.049134 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0c42-0f82-43ff-a0ac-955761b6c6a8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:27.054710 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dab17e-008e-4f59-8cb4-9f457f6028db None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:27.066238 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dab17e-008e-4f59-8cb4-9f457f6028db None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:27.068485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0c42-0f82-43ff-a0ac-955761b6c6a8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:27.071420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12c324-0e59-4d4f-9300-108ac8cfc33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:27.072603 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12c324-0e59-4d4f-9300-108ac8cfc33f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:27.072986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12c324-0e59-4d4f-9300-108ac8cfc33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:27.073088 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5369b9c-8a23-450d-b3bb-b3805536e048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:27.073275 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12c324-0e59-4d4f-9300-108ac8cfc33f admin admin] PATH_INFO: `/v3/users/24492a62183b4771b1a11c25752c83c7` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:27.073852 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5369b9c-8a23-450d-b3bb-b3805536e048 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:27.074146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5369b9c-8a23-450d-b3bb-b3805536e048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:27.074424 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5369b9c-8a23-450d-b3bb-b3805536e048 admin admin] PATH_INFO: `/v3/projects/71a84f59a6894c9bbce546f44f0d7d84` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:27.074578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12c324-0e59-4d4f-9300-108ac8cfc33f admin admin] RBAC: Authorizing `identity:get_user(user_id=24492a62183b4771b1a11c25752c83c7)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:27.075681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5369b9c-8a23-450d-b3bb-b3805536e048 admin admin] RBAC: Authorizing `identity:get_project(project_id=71a84f59a6894c9bbce546f44f0d7d84)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:27.076825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12c324-0e59-4d4f-9300-108ac8cfc33f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:27.078796 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5369b9c-8a23-450d-b3bb-b3805536e048 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:27.079052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 46/89] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:27 2021] GET /identity/v3/users/24492a62183b4771b1a11c25752c83c7 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:27.080972 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 44/90] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:27 2021] GET /identity/v3/projects/71a84f59a6894c9bbce546f44f0d7d84 => generated 312 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:27.084150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12c324-0e59-4d4f-9300-108ac8cfc33f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:27.084949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5369b9c-8a23-450d-b3bb-b3805536e048 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:27.096649 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5369b9c-8a23-450d-b3bb-b3805536e048 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:27.099544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12c324-0e59-4d4f-9300-108ac8cfc33f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:27.102169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ba4a3-956f-42e5-9c28-aa45f1662adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:27.102811 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ba4a3-956f-42e5-9c28-aa45f1662adf admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:27.103166 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ba4a3-956f-42e5-9c28-aa45f1662adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:27.103449 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ba4a3-956f-42e5-9c28-aa45f1662adf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:27.109526 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd1d54-01fb-4eb0-b961-ed8e6d5e0a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:27.111213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd1d54-01fb-4eb0-b961-ed8e6d5e0a79 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:27.111994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd1d54-01fb-4eb0-b961-ed8e6d5e0a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:27.112500 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd1d54-01fb-4eb0-b961-ed8e6d5e0a79 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:27.112601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ba4a3-956f-42e5-9c28-aa45f1662adf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:27.114004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd1d54-01fb-4eb0-b961-ed8e6d5e0a79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:27.114350 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ba4a3-956f-42e5-9c28-aa45f1662adf admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:27.116175 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd1d54-01fb-4eb0-b961-ed8e6d5e0a79 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:27.118009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 47/91] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:27.119023 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd1d54-01fb-4eb0-b961-ed8e6d5e0a79 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:27.130674 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 45/92] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:18:27.131804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ba4a3-956f-42e5-9c28-aa45f1662adf admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:27.132421 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd1d54-01fb-4eb0-b961-ed8e6d5e0a79 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:27.137063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f33bdc-cc0f-4b3e-9290-4cd4bd529fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:27.137704 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33bdc-cc0f-4b3e-9290-4cd4bd529fef admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:27.137991 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33bdc-cc0f-4b3e-9290-4cd4bd529fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:27.138272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33bdc-cc0f-4b3e-9290-4cd4bd529fef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:27.139265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f33bdc-cc0f-4b3e-9290-4cd4bd529fef admin admin] RBAC: Adding query filter params (role.id=e734a22c1b2c40feb0147271d002bdee, scope.project.id=71a84f59a6894c9bbce546f44f0d7d84, user.id=24492a62183b4771b1a11c25752c83c7) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:27.139588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f33bdc-cc0f-4b3e-9290-4cd4bd529fef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:27.142032 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f33bdc-cc0f-4b3e-9290-4cd4bd529fef admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:27.145504 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ba4a3-956f-42e5-9c28-aa45f1662adf admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:27.147792 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 48/93] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:27 2021] GET /identity/v3/role_assignments?user.id=24492a62183b4771b1a11c25752c83c7&scope.project.id=71a84f59a6894c9bbce546f44f0d7d84&role.id=e734a22c1b2c40feb0147271d002bdee => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:27.150839 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a319f5-3c70-460e-ae0b-e56f51612119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:27.151811 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a319f5-3c70-460e-ae0b-e56f51612119 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:27.152351 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a319f5-3c70-460e-ae0b-e56f51612119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:27.152831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a319f5-3c70-460e-ae0b-e56f51612119 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:27.153835 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a319f5-3c70-460e-ae0b-e56f51612119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:27.155167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-d8a319f5-3c70-460e-ae0b-e56f51612119 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:27.155167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:18:27.155167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:18:27.155825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f33bdc-cc0f-4b3e-9290-4cd4bd529fef admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:27.157314 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a319f5-3c70-460e-ae0b-e56f51612119 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:27.177518 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f33bdc-cc0f-4b3e-9290-4cd4bd529fef admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:27.190134 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 46/94] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:18:27 2021] POST /identity/v3/users => generated 289 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:18:27.199935 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7937a-7831-4544-b7c2-39217e9e333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:27.200662 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7937a-7831-4544-b7c2-39217e9e333d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:27.200948 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7937a-7831-4544-b7c2-39217e9e333d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:27.201237 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7937a-7831-4544-b7c2-39217e9e333d admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:27.202586 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7937a-7831-4544-b7c2-39217e9e333d admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:27.205322 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7937a-7831-4544-b7c2-39217e9e333d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:27.207339 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 49/95] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:27 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:27.213744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a319f5-3c70-460e-ae0b-e56f51612119 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:27.225907 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a319f5-3c70-460e-ae0b-e56f51612119 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:27.231278 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2eae13-0121-45b5-81ea-0a5986df462b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:27.232357 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eae13-0121-45b5-81ea-0a5986df462b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:27.232853 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eae13-0121-45b5-81ea-0a5986df462b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:27.233332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eae13-0121-45b5-81ea-0a5986df462b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:27.234558 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2eae13-0121-45b5-81ea-0a5986df462b admin admin] RBAC: Adding query filter params (role.id=f4edd7aabe7e416f95ab6833aa478f07, scope.project.id=d9bef98222d5424aa293398d503f422d, user.id=24492a62183b4771b1a11c25752c83c7) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:27.235131 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2eae13-0121-45b5-81ea-0a5986df462b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:27.236522 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-9f2eae13-0121-45b5-81ea-0a5986df462b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:27.236522 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:18:27.236522 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:18:27.238251 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2eae13-0121-45b5-81ea-0a5986df462b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:27.247328 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 47/96] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:27 2021] GET /identity/v3/role_assignments?user.id=24492a62183b4771b1a11c25752c83c7&scope.project.id=d9bef98222d5424aa293398d503f422d&role.id=f4edd7aabe7e416f95ab6833aa478f07 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:29.193692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f0b5b-4bd6-42b1-a2d0-2433af5cbd72 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:29.194252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f0b5b-4bd6-42b1-a2d0-2433af5cbd72 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:29.194252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f0b5b-4bd6-42b1-a2d0-2433af5cbd72 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:29.196060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 50/97] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:29.202092 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6388d7-0766-492a-bcd1-272ac2fbef5d None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:29.203013 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6388d7-0766-492a-bcd1-272ac2fbef5d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:29.203541 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6388d7-0766-492a-bcd1-272ac2fbef5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:29.229199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ea6388d7-0766-492a-bcd1-272ac2fbef5d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:29.230745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ea6388d7-0766-492a-bcd1-272ac2fbef5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:29.243564 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 48/98] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:29.278994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f0b5b-4bd6-42b1-a2d0-2433af5cbd72 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:29.296235 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f0b5b-4bd6-42b1-a2d0-2433af5cbd72 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:29.301502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c826e8-97ce-46c7-894e-12bd7c10089c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:29.302543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c826e8-97ce-46c7-894e-12bd7c10089c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:29.303077 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c826e8-97ce-46c7-894e-12bd7c10089c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:29.303591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c826e8-97ce-46c7-894e-12bd7c10089c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:29.320073 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c826e8-97ce-46c7-894e-12bd7c10089c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:29.333570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-a3c826e8-97ce-46c7-894e-12bd7c10089c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:18:29.335888 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 51/99] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:29.342240 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6388d7-0766-492a-bcd1-272ac2fbef5d None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:29.352805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6388d7-0766-492a-bcd1-272ac2fbef5d None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:29.357857 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7a7c0-3733-425f-b65a-93bde27acd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:29.362883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7a7c0-3733-425f-b65a-93bde27acd14 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:29.363466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7a7c0-3733-425f-b65a-93bde27acd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:29.363979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7a7c0-3733-425f-b65a-93bde27acd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:29.364990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7a7c0-3733-425f-b65a-93bde27acd14 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:29.365528 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7a7c0-3733-425f-b65a-93bde27acd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:29.367396 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7a7c0-3733-425f-b65a-93bde27acd14 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:29.377212 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 49/100] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:29.382971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c826e8-97ce-46c7-894e-12bd7c10089c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:29.394619 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c826e8-97ce-46c7-894e-12bd7c10089c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:29.399497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1160b18-2502-4839-bee8-52b2e739b04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:29.400620 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1160b18-2502-4839-bee8-52b2e739b04d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:29.401119 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1160b18-2502-4839-bee8-52b2e739b04d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:29.401616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1160b18-2502-4839-bee8-52b2e739b04d admin admin] PATH_INFO: `/v3/users/24492a62183b4771b1a11c25752c83c7` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:29.403051 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1160b18-2502-4839-bee8-52b2e739b04d admin admin] RBAC: Authorizing `identity:get_user(user_id=24492a62183b4771b1a11c25752c83c7)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:29.405507 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1160b18-2502-4839-bee8-52b2e739b04d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:29.407901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 52/101] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:29 2021] GET /identity/v3/users/24492a62183b4771b1a11c25752c83c7 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:29.413877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7a7c0-3733-425f-b65a-93bde27acd14 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:29.424871 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7a7c0-3733-425f-b65a-93bde27acd14 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:29.429554 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f7c0d-3854-433d-a2ea-568dc35af935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:29.430642 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f7c0d-3854-433d-a2ea-568dc35af935 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:29.435244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f7c0d-3854-433d-a2ea-568dc35af935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:29.435774 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f7c0d-3854-433d-a2ea-568dc35af935 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:29.437280 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f7c0d-3854-433d-a2ea-568dc35af935 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:29.439688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f7c0d-3854-433d-a2ea-568dc35af935 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:29.441585 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 50/102] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:29 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:29.447598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1160b18-2502-4839-bee8-52b2e739b04d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:29.457677 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1160b18-2502-4839-bee8-52b2e739b04d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:29.462435 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cecb5d-8181-4d91-b8be-b4d91f4d47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:29.467658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cecb5d-8181-4d91-b8be-b4d91f4d47fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:29.468173 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cecb5d-8181-4d91-b8be-b4d91f4d47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:29.469187 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cecb5d-8181-4d91-b8be-b4d91f4d47fe admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d/users/24492a62183b4771b1a11c25752c83c7/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:29.471466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cecb5d-8181-4d91-b8be-b4d91f4d47fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9bef98222d5424aa293398d503f422d, user_id=24492a62183b4771b1a11c25752c83c7, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:29.472720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-c0cecb5d-8181-4d91-b8be-b4d91f4d47fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:29.472720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:18:29.472720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:18:29.475065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cecb5d-8181-4d91-b8be-b4d91f4d47fe admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:29.500138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 53/103] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:18:29 2021] PUT /identity/v3/projects/d9bef98222d5424aa293398d503f422d/users/24492a62183b4771b1a11c25752c83c7/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:18:29.838666 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b40613-0290-4dfb-a5a5-27786521d648 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:29.839431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b40613-0290-4dfb-a5a5-27786521d648 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:29.839926 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b40613-0290-4dfb-a5a5-27786521d648 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:29.841934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 51/104] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:29.848643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f4eed-b240-4130-b2d1-50b6ec1a397d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:29.849277 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f4eed-b240-4130-b2d1-50b6ec1a397d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:29.849776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f4eed-b240-4130-b2d1-50b6ec1a397d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:29.871431 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-5b9f4eed-b240-4130-b2d1-50b6ec1a397d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:29.873031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5b9f4eed-b240-4130-b2d1-50b6ec1a397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:29.943399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 54/105] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:29.983871 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b40613-0290-4dfb-a5a5-27786521d648 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:30.001050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b40613-0290-4dfb-a5a5-27786521d648 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:30.005767 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fa5e0-cd14-449c-970d-ba81be86f4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:30.006779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fa5e0-cd14-449c-970d-ba81be86f4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.007339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fa5e0-cd14-449c-970d-ba81be86f4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.007829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fa5e0-cd14-449c-970d-ba81be86f4f4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:30.019937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fa5e0-cd14-449c-970d-ba81be86f4f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:30.027281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-2b5fa5e0-cd14-449c-970d-ba81be86f4f4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:18:30.028934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 52/106] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:18:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:30.036230 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f4eed-b240-4130-b2d1-50b6ec1a397d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:30.046114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f4eed-b240-4130-b2d1-50b6ec1a397d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:30.050606 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b152868-4889-490a-baa9-c8b02cc4a645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:30.051315 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b152868-4889-490a-baa9-c8b02cc4a645 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.051598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b152868-4889-490a-baa9-c8b02cc4a645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.051890 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b152868-4889-490a-baa9-c8b02cc4a645 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:30.052668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b152868-4889-490a-baa9-c8b02cc4a645 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:30.052984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b152868-4889-490a-baa9-c8b02cc4a645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:30.054598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b152868-4889-490a-baa9-c8b02cc4a645 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:30.067351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 55/107] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:30.073984 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fa5e0-cd14-449c-970d-ba81be86f4f4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:30.085767 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fa5e0-cd14-449c-970d-ba81be86f4f4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:30.090561 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d2861-04e5-4763-8480-168d6bdd2a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:30.095625 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d2861-04e5-4763-8480-168d6bdd2a26 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.095923 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d2861-04e5-4763-8480-168d6bdd2a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.096217 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d2861-04e5-4763-8480-168d6bdd2a26 admin admin] PATH_INFO: `/v3/users/851ea07e9b2c466298b37f0fddcbf9c5` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:30.097676 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d2861-04e5-4763-8480-168d6bdd2a26 admin admin] RBAC: Authorizing `identity:get_user(user_id=851ea07e9b2c466298b37f0fddcbf9c5)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:30.099625 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d2861-04e5-4763-8480-168d6bdd2a26 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:30.101764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 53/108] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:30 2021] GET /identity/v3/users/851ea07e9b2c466298b37f0fddcbf9c5 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:30.107782 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b152868-4889-490a-baa9-c8b02cc4a645 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:30.120104 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b152868-4889-490a-baa9-c8b02cc4a645 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:30.131075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075e125-41c8-4caa-ae03-b81fc8b8ac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:30.131945 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e125-41c8-4caa-ae03-b81fc8b8ac8b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.132232 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e125-41c8-4caa-ae03-b81fc8b8ac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.132514 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e125-41c8-4caa-ae03-b81fc8b8ac8b admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:30.135662 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075e125-41c8-4caa-ae03-b81fc8b8ac8b admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:30.137795 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075e125-41c8-4caa-ae03-b81fc8b8ac8b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:30.139890 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 56/109] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:30 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:30.146772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d2861-04e5-4763-8480-168d6bdd2a26 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:30.156794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d2861-04e5-4763-8480-168d6bdd2a26 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:30.161229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7d272-cf14-4c0e-9ffb-8514e4003458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:30.162115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7d272-cf14-4c0e-9ffb-8514e4003458 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.162406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7d272-cf14-4c0e-9ffb-8514e4003458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.162693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7d272-cf14-4c0e-9ffb-8514e4003458 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d/users/851ea07e9b2c466298b37f0fddcbf9c5/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:30.164725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7d272-cf14-4c0e-9ffb-8514e4003458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9bef98222d5424aa293398d503f422d, user_id=851ea07e9b2c466298b37f0fddcbf9c5, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:30.167744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7d272-cf14-4c0e-9ffb-8514e4003458 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:30.183880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 54/110] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:18:30 2021] PUT /identity/v3/projects/d9bef98222d5424aa293398d503f422d/users/851ea07e9b2c466298b37f0fddcbf9c5/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:18:30.335486 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e86f6-4a31-43f5-8055-2c479ca5e8d1 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.336135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e86f6-4a31-43f5-8055-2c479ca5e8d1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.336135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e86f6-4a31-43f5-8055-2c479ca5e8d1 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:30.338076 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 57/111] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:30.344394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354112a-c8d4-422c-af1d-b17c0b090789 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.345017 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354112a-c8d4-422c-af1d-b17c0b090789 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.345017 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354112a-c8d4-422c-af1d-b17c0b090789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:30.363590 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-4354112a-c8d4-422c-af1d-b17c0b090789 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:30.364825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4354112a-c8d4-422c-af1d-b17c0b090789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:30.427307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 55/112] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:30.451047 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e86f6-4a31-43f5-8055-2c479ca5e8d1 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:30.465064 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e86f6-4a31-43f5-8055-2c479ca5e8d1 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:30.469502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8a5cc-9a4e-4add-ab3e-563bb4460175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:30.470311 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8a5cc-9a4e-4add-ab3e-563bb4460175 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.470605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8a5cc-9a4e-4add-ab3e-563bb4460175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.470912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8a5cc-9a4e-4add-ab3e-563bb4460175 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:30.496010 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8a5cc-9a4e-4add-ab3e-563bb4460175 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:30.503754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-52c8a5cc-9a4e-4add-ab3e-563bb4460175 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:18:30.505248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 58/113] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:30.511343 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354112a-c8d4-422c-af1d-b17c0b090789 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:30.520833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354112a-c8d4-422c-af1d-b17c0b090789 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:30.525422 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e97d0b-2494-424a-b179-12ce9013618d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:30.526115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e97d0b-2494-424a-b179-12ce9013618d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.526405 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e97d0b-2494-424a-b179-12ce9013618d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.526695 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e97d0b-2494-424a-b179-12ce9013618d admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:30.531734 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e97d0b-2494-424a-b179-12ce9013618d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:30.532030 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e97d0b-2494-424a-b179-12ce9013618d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:30.533722 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e97d0b-2494-424a-b179-12ce9013618d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:30.543431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 56/114] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:30.549841 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8a5cc-9a4e-4add-ab3e-563bb4460175 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:30.564379 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8a5cc-9a4e-4add-ab3e-563bb4460175 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:30.568896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da640e-fd52-48e2-9e52-7cab6bfac800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:30.569769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da640e-fd52-48e2-9e52-7cab6bfac800 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.570059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da640e-fd52-48e2-9e52-7cab6bfac800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.570335 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da640e-fd52-48e2-9e52-7cab6bfac800 admin admin] PATH_INFO: `/v3/users/24492a62183b4771b1a11c25752c83c7` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:30.571583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da640e-fd52-48e2-9e52-7cab6bfac800 admin admin] RBAC: Authorizing `identity:get_user(user_id=24492a62183b4771b1a11c25752c83c7)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:30.573768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da640e-fd52-48e2-9e52-7cab6bfac800 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:30.575632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 59/115] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:30 2021] GET /identity/v3/users/24492a62183b4771b1a11c25752c83c7 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:30.581394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e97d0b-2494-424a-b179-12ce9013618d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:30.591293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e97d0b-2494-424a-b179-12ce9013618d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:30.595845 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb960-ef72-495f-9c27-81d94e5989ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:30.596646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb960-ef72-495f-9c27-81d94e5989ee admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.596935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb960-ef72-495f-9c27-81d94e5989ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.597218 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb960-ef72-495f-9c27-81d94e5989ee admin admin] PATH_INFO: `/v3/projects/71a84f59a6894c9bbce546f44f0d7d84` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:30.598432 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fb960-ef72-495f-9c27-81d94e5989ee admin admin] RBAC: Authorizing `identity:get_project(project_id=71a84f59a6894c9bbce546f44f0d7d84)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:30.604622 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fb960-ef72-495f-9c27-81d94e5989ee admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:30.606331 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 57/116] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:30 2021] GET /identity/v3/projects/71a84f59a6894c9bbce546f44f0d7d84 => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:30.612987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da640e-fd52-48e2-9e52-7cab6bfac800 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:30.628435 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da640e-fd52-48e2-9e52-7cab6bfac800 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:30.632912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc44d8e-a026-421d-8f09-ebed7a373cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:30.633800 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44d8e-a026-421d-8f09-ebed7a373cab admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.634088 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44d8e-a026-421d-8f09-ebed7a373cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.634369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44d8e-a026-421d-8f09-ebed7a373cab admin admin] PATH_INFO: `/v3/projects/71a84f59a6894c9bbce546f44f0d7d84/users/24492a62183b4771b1a11c25752c83c7/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:30.636397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc44d8e-a026-421d-8f09-ebed7a373cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a84f59a6894c9bbce546f44f0d7d84, user_id=24492a62183b4771b1a11c25752c83c7, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:30.639109 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc44d8e-a026-421d-8f09-ebed7a373cab admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:30.657923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 60/117] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:18:30 2021] PUT /identity/v3/projects/71a84f59a6894c9bbce546f44f0d7d84/users/24492a62183b4771b1a11c25752c83c7/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:18:30.812824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cceca-753e-487f-bbed-a1dda5895ae6 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.813118 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cceca-753e-487f-bbed-a1dda5895ae6 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.813407 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cceca-753e-487f-bbed-a1dda5895ae6 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:30.815500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 58/118] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:30.827364 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dd22a-95d8-4db5-a7cd-5d940445d402 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.827766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dd22a-95d8-4db5-a7cd-5d940445d402 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.827969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dd22a-95d8-4db5-a7cd-5d940445d402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:30.852108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-303dd22a-95d8-4db5-a7cd-5d940445d402 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:30.853243 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-303dd22a-95d8-4db5-a7cd-5d940445d402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:30.929121 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 61/119] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:30.961085 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cceca-753e-487f-bbed-a1dda5895ae6 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:30.980744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cceca-753e-487f-bbed-a1dda5895ae6 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:30.986360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dfee0-cb32-4f3f-b155-220b51afbe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:30.987256 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfee0-cb32-4f3f-b155-220b51afbe79 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:30.987538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfee0-cb32-4f3f-b155-220b51afbe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:30.987865 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfee0-cb32-4f3f-b155-220b51afbe79 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.003085 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dfee0-cb32-4f3f-b155-220b51afbe79 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:31.010770 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-af5dfee0-cb32-4f3f-b155-220b51afbe79 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:18:31.012169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 59/120] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:18:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:31.018974 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dd22a-95d8-4db5-a7cd-5d940445d402 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:31.029046 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dd22a-95d8-4db5-a7cd-5d940445d402 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:31.035622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e1c05-f814-4d3d-8f66-f590ddf870ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:31.036317 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e1c05-f814-4d3d-8f66-f590ddf870ac admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.036610 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e1c05-f814-4d3d-8f66-f590ddf870ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.036897 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e1c05-f814-4d3d-8f66-f590ddf870ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.037693 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e1c05-f814-4d3d-8f66-f590ddf870ac admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:31.038009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e1c05-f814-4d3d-8f66-f590ddf870ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:31.039728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e1c05-f814-4d3d-8f66-f590ddf870ac admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:31.055321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 62/121] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:18:31 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:31.061680 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dfee0-cb32-4f3f-b155-220b51afbe79 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:31.076257 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dfee0-cb32-4f3f-b155-220b51afbe79 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:31.088298 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd94815-1f19-40ed-b222-c29724113895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:31.089234 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94815-1f19-40ed-b222-c29724113895 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.089560 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94815-1f19-40ed-b222-c29724113895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.089925 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94815-1f19-40ed-b222-c29724113895 admin admin] PATH_INFO: `/v3/users/24492a62183b4771b1a11c25752c83c7` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.092208 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd94815-1f19-40ed-b222-c29724113895 admin admin] RBAC: Authorizing `identity:get_user(user_id=24492a62183b4771b1a11c25752c83c7)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:31.095198 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd94815-1f19-40ed-b222-c29724113895 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:31.097011 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 60/122] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:31 2021] GET /identity/v3/users/24492a62183b4771b1a11c25752c83c7 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:31.102834 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e1c05-f814-4d3d-8f66-f590ddf870ac admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:31.115884 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e1c05-f814-4d3d-8f66-f590ddf870ac admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:31.120580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36856703-31c6-4b9e-9b53-839a9758e30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:31.121635 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36856703-31c6-4b9e-9b53-839a9758e30b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.122102 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36856703-31c6-4b9e-9b53-839a9758e30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.122560 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36856703-31c6-4b9e-9b53-839a9758e30b admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.124001 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36856703-31c6-4b9e-9b53-839a9758e30b admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:31.126321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36856703-31c6-4b9e-9b53-839a9758e30b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:31.128227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 63/123] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:31 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:31.134365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd94815-1f19-40ed-b222-c29724113895 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:31.150467 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd94815-1f19-40ed-b222-c29724113895 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:31.157377 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2981d2-543d-4e11-b3c4-661c9fa3ea63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:31.158270 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2981d2-543d-4e11-b3c4-661c9fa3ea63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.158603 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2981d2-543d-4e11-b3c4-661c9fa3ea63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.158905 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2981d2-543d-4e11-b3c4-661c9fa3ea63 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d/users/24492a62183b4771b1a11c25752c83c7/roles/f4edd7aabe7e416f95ab6833aa478f07` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.161749 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2981d2-543d-4e11-b3c4-661c9fa3ea63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9bef98222d5424aa293398d503f422d, user_id=24492a62183b4771b1a11c25752c83c7, role_id=f4edd7aabe7e416f95ab6833aa478f07)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:31.164595 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2981d2-543d-4e11-b3c4-661c9fa3ea63 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:31.183624 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 61/124] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:18:31 2021] PUT /identity/v3/projects/d9bef98222d5424aa293398d503f422d/users/24492a62183b4771b1a11c25752c83c7/roles/f4edd7aabe7e416f95ab6833aa478f07 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:18:31.547229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e6cc-822b-4484-bc05-0c355e0752b8 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.548238 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e6cc-822b-4484-bc05-0c355e0752b8 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.548731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e6cc-822b-4484-bc05-0c355e0752b8 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.551008 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 64/125] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:31.556939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a4c94-b865-4134-a537-603d274e175e None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.557749 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a4c94-b865-4134-a537-603d274e175e None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.558237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a4c94-b865-4134-a537-603d274e175e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.586973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e11a4c94-b865-4134-a537-603d274e175e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:31.588547 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e11a4c94-b865-4134-a537-603d274e175e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:31.658151 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 62/126] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:31.695978 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61e6cc-822b-4484-bc05-0c355e0752b8 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:31.711120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61e6cc-822b-4484-bc05-0c355e0752b8 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:31.715798 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a285ca-554c-45fc-b40b-038b7b5bb76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:31.716836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a285ca-554c-45fc-b40b-038b7b5bb76a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.717326 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a285ca-554c-45fc-b40b-038b7b5bb76a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.717823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a285ca-554c-45fc-b40b-038b7b5bb76a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.732003 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a285ca-554c-45fc-b40b-038b7b5bb76a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:31.739302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-77a285ca-554c-45fc-b40b-038b7b5bb76a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:18:31.740729 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 65/127] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:31 2021] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:31.747055 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a4c94-b865-4134-a537-603d274e175e None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:31.759877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a4c94-b865-4134-a537-603d274e175e None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:31.764614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ca1f6-134f-497e-9d3c-f15e37b576bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:31.765612 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ca1f6-134f-497e-9d3c-f15e37b576bc admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.766599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ca1f6-134f-497e-9d3c-f15e37b576bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.767112 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ca1f6-134f-497e-9d3c-f15e37b576bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.768104 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ca1f6-134f-497e-9d3c-f15e37b576bc admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:31.768623 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ca1f6-134f-497e-9d3c-f15e37b576bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:31.770473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ca1f6-134f-497e-9d3c-f15e37b576bc admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:31.782588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 63/128] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:31 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:31.788813 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a285ca-554c-45fc-b40b-038b7b5bb76a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:31.804067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a285ca-554c-45fc-b40b-038b7b5bb76a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:31.806968 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b417b0-ed74-41ab-9013-97ef9856546c None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.807511 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b417b0-ed74-41ab-9013-97ef9856546c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.808002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b417b0-ed74-41ab-9013-97ef9856546c None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.810001 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 64/129] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:31.814340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939ee7-762f-4875-932d-b3a854850a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:31.816292 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc137fd-1ddc-4499-966c-5f926cd0f57f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.816802 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc137fd-1ddc-4499-966c-5f926cd0f57f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.817279 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc137fd-1ddc-4499-966c-5f926cd0f57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.819626 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939ee7-762f-4875-932d-b3a854850a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.820653 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939ee7-762f-4875-932d-b3a854850a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.822207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939ee7-762f-4875-932d-b3a854850a90 admin admin] PATH_INFO: `/v3/users/6c9cd9ffcd5044b09cd17da6004f8544` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.845631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c939ee7-762f-4875-932d-b3a854850a90 admin admin] RBAC: Authorizing `identity:get_user(user_id=6c9cd9ffcd5044b09cd17da6004f8544)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:31.847839 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c939ee7-762f-4875-932d-b3a854850a90 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:31.849588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 66/130] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:31 2021] GET /identity/v3/users/6c9cd9ffcd5044b09cd17da6004f8544 => generated 289 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:31.849899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-6cc137fd-1ddc-4499-966c-5f926cd0f57f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:31.851334 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-6cc137fd-1ddc-4499-966c-5f926cd0f57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:31.863361 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 65/131] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:31.866953 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939ee7-762f-4875-932d-b3a854850a90 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:31.885140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939ee7-762f-4875-932d-b3a854850a90 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:31.900080 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d14f1-e5d6-4a08-bc5e-78afdf811a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:31.900746 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d14f1-e5d6-4a08-bc5e-78afdf811a15 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.901031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d14f1-e5d6-4a08-bc5e-78afdf811a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.901312 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d14f1-e5d6-4a08-bc5e-78afdf811a15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.905596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc137fd-1ddc-4499-966c-5f926cd0f57f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:31.918806 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d14f1-e5d6-4a08-bc5e-78afdf811a15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:31.920614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d14f1-e5d6-4a08-bc5e-78afdf811a15 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:31.921395 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc137fd-1ddc-4499-966c-5f926cd0f57f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:31.926604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ef1c8-69d4-42ac-b969-f8f0c10e80a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:31.927671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef1c8-69d4-42ac-b969-f8f0c10e80a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.928177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef1c8-69d4-42ac-b969-f8f0c10e80a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.928652 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef1c8-69d4-42ac-b969-f8f0c10e80a5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.935708 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ef1c8-69d4-42ac-b969-f8f0c10e80a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:31.936223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 67/132] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:31.938507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ef1c8-69d4-42ac-b969-f8f0c10e80a5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:31.940654 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 66/133] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:31.946498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ef1c8-69d4-42ac-b969-f8f0c10e80a5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:31.946647 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d14f1-e5d6-4a08-bc5e-78afdf811a15 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:31.959723 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d14f1-e5d6-4a08-bc5e-78afdf811a15 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:31.960579 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ef1c8-69d4-42ac-b969-f8f0c10e80a5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:31.965605 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5b29b-8db2-424a-beb7-5d427612a067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:31.966970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5b29b-8db2-424a-beb7-5d427612a067 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.967562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5b29b-8db2-424a-beb7-5d427612a067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.967908 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49063271-70d8-4dfe-948e-14e5cdb54d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:31.968287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5b29b-8db2-424a-beb7-5d427612a067 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.968561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49063271-70d8-4dfe-948e-14e5cdb54d73 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:31.968883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49063271-70d8-4dfe-948e-14e5cdb54d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:31.974870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49063271-70d8-4dfe-948e-14e5cdb54d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:31.974870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49063271-70d8-4dfe-948e-14e5cdb54d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:31.974870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49063271-70d8-4dfe-948e-14e5cdb54d73 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:31.976461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5b29b-8db2-424a-beb7-5d427612a067 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:31.978765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5b29b-8db2-424a-beb7-5d427612a067 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:31.980885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 67/134] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:31 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:31.987636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5b29b-8db2-424a-beb7-5d427612a067 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:31.999784 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5b29b-8db2-424a-beb7-5d427612a067 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:32.009210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e87d1-ceb9-4892-b66a-37080e7a9d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:32.010136 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e87d1-ceb9-4892-b66a-37080e7a9d11 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:32.010628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e87d1-ceb9-4892-b66a-37080e7a9d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:32.011128 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e87d1-ceb9-4892-b66a-37080e7a9d11 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:32.012183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e87d1-ceb9-4892-b66a-37080e7a9d11 admin admin] RBAC: Adding query filter params (role.id=726ace838f324527844cb0c0a21a0fbf, scope.project.id=d9bef98222d5424aa293398d503f422d, user.id=6c9cd9ffcd5044b09cd17da6004f8544) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:32.012678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e87d1-ceb9-4892-b66a-37080e7a9d11 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:32.014749 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e87d1-ceb9-4892-b66a-37080e7a9d11 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:32.025820 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 68/135] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:31 2021] GET /identity/v3/role_assignments?user.id=6c9cd9ffcd5044b09cd17da6004f8544&scope.project.id=d9bef98222d5424aa293398d503f422d&role.id=726ace838f324527844cb0c0a21a0fbf => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:32.026017 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 68/136] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Dec 15 13:18:31 2021] POST /identity/v3/projects => generated 302 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:18:33.082029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a81c9-7f0d-4bad-929b-b8325e2284f8 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:33.082648 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a81c9-7f0d-4bad-929b-b8325e2284f8 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:33.082648 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a81c9-7f0d-4bad-929b-b8325e2284f8 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:33.084669 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 69/137] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:33.089996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9bba2-ca1e-4818-8897-626070c2a4ba None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:33.090806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9bba2-ca1e-4818-8897-626070c2a4ba None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:33.091309 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9bba2-ca1e-4818-8897-626070c2a4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:33.117420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-cff9bba2-ca1e-4818-8897-626070c2a4ba None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:33.118971 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-cff9bba2-ca1e-4818-8897-626070c2a4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:33.190900 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 69/138] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:33.227448 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a81c9-7f0d-4bad-929b-b8325e2284f8 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:33.240645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a81c9-7f0d-4bad-929b-b8325e2284f8 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:33.247692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1414296-da5c-4ac0-9ad1-bec2054f97d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:33.248712 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1414296-da5c-4ac0-9ad1-bec2054f97d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:33.249191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1414296-da5c-4ac0-9ad1-bec2054f97d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:33.249687 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1414296-da5c-4ac0-9ad1-bec2054f97d2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:33.264920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1414296-da5c-4ac0-9ad1-bec2054f97d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:33.272138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-f1414296-da5c-4ac0-9ad1-bec2054f97d2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:18:33.273840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 70/139] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:33.280047 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9bba2-ca1e-4818-8897-626070c2a4ba None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:33.290000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9bba2-ca1e-4818-8897-626070c2a4ba None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:33.299655 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed9cc8-018e-4d72-b1db-5959bb9d7fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:33.300631 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed9cc8-018e-4d72-b1db-5959bb9d7fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:33.301110 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed9cc8-018e-4d72-b1db-5959bb9d7fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:33.301597 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed9cc8-018e-4d72-b1db-5959bb9d7fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:33.302622 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed9cc8-018e-4d72-b1db-5959bb9d7fd8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:33.303167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed9cc8-018e-4d72-b1db-5959bb9d7fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:33.305062 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed9cc8-018e-4d72-b1db-5959bb9d7fd8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:33.321223 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 70/140] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:33.327744 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1414296-da5c-4ac0-9ad1-bec2054f97d2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:33.345130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1414296-da5c-4ac0-9ad1-bec2054f97d2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:33.354614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b36be0-14e4-4f42-afd1-025e2b15714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:33.355785 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b36be0-14e4-4f42-afd1-025e2b15714a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:33.356287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b36be0-14e4-4f42-afd1-025e2b15714a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:33.356756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b36be0-14e4-4f42-afd1-025e2b15714a admin admin] PATH_INFO: `/v3/users/24492a62183b4771b1a11c25752c83c7` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:33.365188 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b36be0-14e4-4f42-afd1-025e2b15714a admin admin] RBAC: Authorizing `identity:get_user(user_id=24492a62183b4771b1a11c25752c83c7)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:33.370106 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b36be0-14e4-4f42-afd1-025e2b15714a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:33.373487 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 71/141] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:33 2021] GET /identity/v3/users/24492a62183b4771b1a11c25752c83c7 => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:33.379868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed9cc8-018e-4d72-b1db-5959bb9d7fd8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:33.397237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed9cc8-018e-4d72-b1db-5959bb9d7fd8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:33.411676 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b0c9a-752e-48b9-bdd2-ae4a7db5039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:33.412368 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b0c9a-752e-48b9-bdd2-ae4a7db5039f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:33.412656 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b0c9a-752e-48b9-bdd2-ae4a7db5039f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:33.412937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b0c9a-752e-48b9-bdd2-ae4a7db5039f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:33.427263 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b0c9a-752e-48b9-bdd2-ae4a7db5039f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:33.429168 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b0c9a-752e-48b9-bdd2-ae4a7db5039f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:33.445223 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 71/142] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:18:33.451472 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b36be0-14e4-4f42-afd1-025e2b15714a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:33.468434 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b36be0-14e4-4f42-afd1-025e2b15714a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:33.478493 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395fd8c-7620-4576-bb1f-c6c19ac61cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:33.479657 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395fd8c-7620-4576-bb1f-c6c19ac61cec admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:33.480140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395fd8c-7620-4576-bb1f-c6c19ac61cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:33.480605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395fd8c-7620-4576-bb1f-c6c19ac61cec admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:33.484414 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395fd8c-7620-4576-bb1f-c6c19ac61cec admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:33.486703 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395fd8c-7620-4576-bb1f-c6c19ac61cec admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:33.488612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 72/143] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:33 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:33.495032 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b0c9a-752e-48b9-bdd2-ae4a7db5039f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:33.507833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b0c9a-752e-48b9-bdd2-ae4a7db5039f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:33.514975 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735904f9-6275-41f0-ad28-aa00b08cfcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:33.516153 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735904f9-6275-41f0-ad28-aa00b08cfcd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:33.516443 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735904f9-6275-41f0-ad28-aa00b08cfcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:33.516723 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735904f9-6275-41f0-ad28-aa00b08cfcd0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:33.517582 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735904f9-6275-41f0-ad28-aa00b08cfcd0 admin admin] RBAC: Adding query filter params (role.id=e734a22c1b2c40feb0147271d002bdee, scope.project.id=d9bef98222d5424aa293398d503f422d, user.id=24492a62183b4771b1a11c25752c83c7) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:33.517899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735904f9-6275-41f0-ad28-aa00b08cfcd0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:33.519814 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735904f9-6275-41f0-ad28-aa00b08cfcd0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:33.532179 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 72/144] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:33 2021] GET /identity/v3/role_assignments?user.id=24492a62183b4771b1a11c25752c83c7&scope.project.id=d9bef98222d5424aa293398d503f422d&role.id=e734a22c1b2c40feb0147271d002bdee => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:33.820787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b364d9c-4428-4449-b68a-78dc4a8a9b3e None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:33.821505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b364d9c-4428-4449-b68a-78dc4a8a9b3e None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:33.822015 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b364d9c-4428-4449-b68a-78dc4a8a9b3e None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:33.824056 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 73/145] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:33.833876 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8a1c-4047-40ea-9a93-7a1e103823f1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:33.834523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8a1c-4047-40ea-9a93-7a1e103823f1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:33.835101 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8a1c-4047-40ea-9a93-7a1e103823f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:33.859091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-0b3a8a1c-4047-40ea-9a93-7a1e103823f1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:33.860685 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0b3a8a1c-4047-40ea-9a93-7a1e103823f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:33.873404 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 73/146] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:33.910613 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b364d9c-4428-4449-b68a-78dc4a8a9b3e None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:33.923744 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b364d9c-4428-4449-b68a-78dc4a8a9b3e None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:33.928525 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06a564-71e0-4a84-969b-225938952a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:33.929551 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06a564-71e0-4a84-969b-225938952a7e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:33.930054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06a564-71e0-4a84-969b-225938952a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:33.930532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06a564-71e0-4a84-969b-225938952a7e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:33.942600 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06a564-71e0-4a84-969b-225938952a7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:33.950007 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-9a06a564-71e0-4a84-969b-225938952a7e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:18:33.951566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 74/147] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:18:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:33.963641 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a8a1c-4047-40ea-9a93-7a1e103823f1 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:33.975315 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a8a1c-4047-40ea-9a93-7a1e103823f1 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:33.981125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab9f6b-49a1-409a-a99d-f0942ed162a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:33.982353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab9f6b-49a1-409a-a99d-f0942ed162a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:33.982839 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab9f6b-49a1-409a-a99d-f0942ed162a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:33.983342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab9f6b-49a1-409a-a99d-f0942ed162a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:33.984533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab9f6b-49a1-409a-a99d-f0942ed162a7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:33.985084 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab9f6b-49a1-409a-a99d-f0942ed162a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:33.987073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab9f6b-49a1-409a-a99d-f0942ed162a7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:34.003269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 74/148] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:34.009483 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06a564-71e0-4a84-969b-225938952a7e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:34.021115 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06a564-71e0-4a84-969b-225938952a7e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:34.026660 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966e566-54e1-4495-8c30-ed28adb0df92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:34.027845 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966e566-54e1-4495-8c30-ed28adb0df92 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:34.028332 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966e566-54e1-4495-8c30-ed28adb0df92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:34.028840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966e566-54e1-4495-8c30-ed28adb0df92 admin admin] PATH_INFO: `/v3/users/851ea07e9b2c466298b37f0fddcbf9c5` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:34.030549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966e566-54e1-4495-8c30-ed28adb0df92 admin admin] RBAC: Authorizing `identity:get_user(user_id=851ea07e9b2c466298b37f0fddcbf9c5)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:34.032720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966e566-54e1-4495-8c30-ed28adb0df92 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:34.034595 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 75/149] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:34 2021] GET /identity/v3/users/851ea07e9b2c466298b37f0fddcbf9c5 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:34.040754 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab9f6b-49a1-409a-a99d-f0942ed162a7 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:34.053275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab9f6b-49a1-409a-a99d-f0942ed162a7 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:34.058187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3bc74-fa7c-4867-bb95-073f8d22c1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:34.059110 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3bc74-fa7c-4867-bb95-073f8d22c1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:34.059625 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3bc74-fa7c-4867-bb95-073f8d22c1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:34.060079 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3bc74-fa7c-4867-bb95-073f8d22c1e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:34.070791 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3bc74-fa7c-4867-bb95-073f8d22c1e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:34.072912 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3bc74-fa7c-4867-bb95-073f8d22c1e0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:34.084721 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 75/150] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:34.090350 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966e566-54e1-4495-8c30-ed28adb0df92 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:34.101591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966e566-54e1-4495-8c30-ed28adb0df92 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:34.109117 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd878e62-ed1a-450d-a23e-d6ae5fd7c3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:34.110227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd878e62-ed1a-450d-a23e-d6ae5fd7c3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:34.110750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd878e62-ed1a-450d-a23e-d6ae5fd7c3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:34.111222 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd878e62-ed1a-450d-a23e-d6ae5fd7c3a5 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:34.112772 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd878e62-ed1a-450d-a23e-d6ae5fd7c3a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:34.115107 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd878e62-ed1a-450d-a23e-d6ae5fd7c3a5 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:34.117108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 76/151] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:34 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:34.123484 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3bc74-fa7c-4867-bb95-073f8d22c1e0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:34.134143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3bc74-fa7c-4867-bb95-073f8d22c1e0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:34.140895 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72aad9d-07f0-4ad9-9972-385c57becba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:34.142274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aad9d-07f0-4ad9-9972-385c57becba8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:34.142738 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aad9d-07f0-4ad9-9972-385c57becba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:34.143233 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aad9d-07f0-4ad9-9972-385c57becba8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:34.144300 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72aad9d-07f0-4ad9-9972-385c57becba8 admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=d9bef98222d5424aa293398d503f422d, user.id=851ea07e9b2c466298b37f0fddcbf9c5) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:34.144879 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72aad9d-07f0-4ad9-9972-385c57becba8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:34.147100 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72aad9d-07f0-4ad9-9972-385c57becba8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:34.160194 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 76/152] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:34 2021] GET /identity/v3/role_assignments?user.id=851ea07e9b2c466298b37f0fddcbf9c5&scope.project.id=d9bef98222d5424aa293398d503f422d&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:34.253399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ed73-81c2-40aa-bab2-0ea32245228b None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:34.253976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ed73-81c2-40aa-bab2-0ea32245228b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:34.254441 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ed73-81c2-40aa-bab2-0ea32245228b None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:34.256476 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 77/153] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:34.269020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191f50-efc6-4391-8e7a-7b5c2583a83e None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:34.269630 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191f50-efc6-4391-8e7a-7b5c2583a83e None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:34.270088 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191f50-efc6-4391-8e7a-7b5c2583a83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:34.290840 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-3a191f50-efc6-4391-8e7a-7b5c2583a83e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:34.292716 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-3a191f50-efc6-4391-8e7a-7b5c2583a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:34.307824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 77/154] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:34.350890 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5ed73-81c2-40aa-bab2-0ea32245228b None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:34.367312 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5ed73-81c2-40aa-bab2-0ea32245228b None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:34.373093 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ff9f2-72c8-45af-98e5-fbc6fb6ba0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:34.374312 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ff9f2-72c8-45af-98e5-fbc6fb6ba0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:34.374858 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ff9f2-72c8-45af-98e5-fbc6fb6ba0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:34.375947 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ff9f2-72c8-45af-98e5-fbc6fb6ba0b4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:34.400031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ff9f2-72c8-45af-98e5-fbc6fb6ba0b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:34.407741 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-c30ff9f2-72c8-45af-98e5-fbc6fb6ba0b4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:18:34.409275 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 78/155] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:34.416055 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a191f50-efc6-4391-8e7a-7b5c2583a83e None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:34.426773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a191f50-efc6-4391-8e7a-7b5c2583a83e None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:34.438894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f3f4b-2c02-47fe-abdd-21a74f275156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:34.439899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f3f4b-2c02-47fe-abdd-21a74f275156 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:34.440363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f3f4b-2c02-47fe-abdd-21a74f275156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:34.440860 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f3f4b-2c02-47fe-abdd-21a74f275156 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:34.441827 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f3f4b-2c02-47fe-abdd-21a74f275156 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:34.442320 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f3f4b-2c02-47fe-abdd-21a74f275156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:34.444251 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f3f4b-2c02-47fe-abdd-21a74f275156 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:34.458493 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 78/156] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:34.465080 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ff9f2-72c8-45af-98e5-fbc6fb6ba0b4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:34.478463 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ff9f2-72c8-45af-98e5-fbc6fb6ba0b4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:34.485928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26962a72-0886-481e-8533-2ec72f1a2adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:34.487323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962a72-0886-481e-8533-2ec72f1a2adb admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:34.487817 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962a72-0886-481e-8533-2ec72f1a2adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:34.488293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962a72-0886-481e-8533-2ec72f1a2adb admin admin] PATH_INFO: `/v3/users/24492a62183b4771b1a11c25752c83c7` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:34.490632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26962a72-0886-481e-8533-2ec72f1a2adb admin admin] RBAC: Authorizing `identity:get_user(user_id=24492a62183b4771b1a11c25752c83c7)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:34.493260 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26962a72-0886-481e-8533-2ec72f1a2adb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:34.495331 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 79/157] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:34 2021] GET /identity/v3/users/24492a62183b4771b1a11c25752c83c7 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:34.503475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f3f4b-2c02-47fe-abdd-21a74f275156 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:34.514148 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f3f4b-2c02-47fe-abdd-21a74f275156 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:34.521279 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1f665-5a6e-49eb-b99e-33ee3ac14e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:34.521958 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1f665-5a6e-49eb-b99e-33ee3ac14e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:34.522252 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1f665-5a6e-49eb-b99e-33ee3ac14e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:34.522531 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1f665-5a6e-49eb-b99e-33ee3ac14e24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:34.531132 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1f665-5a6e-49eb-b99e-33ee3ac14e24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:34.533526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1f665-5a6e-49eb-b99e-33ee3ac14e24 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:34.543102 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 79/158] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:34.549933 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26962a72-0886-481e-8533-2ec72f1a2adb admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:34.560695 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26962a72-0886-481e-8533-2ec72f1a2adb admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:34.565625 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8a293-ab16-4c1a-89ef-232791a105fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:34.566698 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8a293-ab16-4c1a-89ef-232791a105fc admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:34.567212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8a293-ab16-4c1a-89ef-232791a105fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:34.567665 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8a293-ab16-4c1a-89ef-232791a105fc admin admin] PATH_INFO: `/v3/projects/71a84f59a6894c9bbce546f44f0d7d84` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:34.569087 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8a293-ab16-4c1a-89ef-232791a105fc admin admin] RBAC: Authorizing `identity:get_project(project_id=71a84f59a6894c9bbce546f44f0d7d84)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:34.571562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8a293-ab16-4c1a-89ef-232791a105fc admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:34.573848 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 80/159] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:34 2021] GET /identity/v3/projects/71a84f59a6894c9bbce546f44f0d7d84 => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:34.580724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1f665-5a6e-49eb-b99e-33ee3ac14e24 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:34.590367 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1f665-5a6e-49eb-b99e-33ee3ac14e24 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:34.595786 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17df5c1-924e-438a-baab-b41f37c6bff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:34.596659 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17df5c1-924e-438a-baab-b41f37c6bff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:34.597164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17df5c1-924e-438a-baab-b41f37c6bff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:34.597614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17df5c1-924e-438a-baab-b41f37c6bff9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:34.598776 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17df5c1-924e-438a-baab-b41f37c6bff9 admin admin] RBAC: Adding query filter params (role.id=e734a22c1b2c40feb0147271d002bdee, scope.project.id=71a84f59a6894c9bbce546f44f0d7d84, user.id=24492a62183b4771b1a11c25752c83c7) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:34.599285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17df5c1-924e-438a-baab-b41f37c6bff9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:34.601719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17df5c1-924e-438a-baab-b41f37c6bff9 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:34.613760 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 80/160] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:34 2021] GET /identity/v3/role_assignments?user.id=24492a62183b4771b1a11c25752c83c7&scope.project.id=71a84f59a6894c9bbce546f44f0d7d84&role.id=e734a22c1b2c40feb0147271d002bdee => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:34.926572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f554a-bc65-4245-937c-a22a05c2b48b None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:34.926931 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f554a-bc65-4245-937c-a22a05c2b48b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:34.927127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f554a-bc65-4245-937c-a22a05c2b48b None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:34.929025 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 81/161] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:34.934921 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855e6bb-30d2-439b-9ac2-b26b7c5bbebc None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:34.935215 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855e6bb-30d2-439b-9ac2-b26b7c5bbebc None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:34.935498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855e6bb-30d2-439b-9ac2-b26b7c5bbebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:34.953861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-8855e6bb-30d2-439b-9ac2-b26b7c5bbebc None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:34.955046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-8855e6bb-30d2-439b-9ac2-b26b7c5bbebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:34.962890 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 81/162] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:34.987430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f554a-bc65-4245-937c-a22a05c2b48b None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:34.999686 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f554a-bc65-4245-937c-a22a05c2b48b None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:35.004642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf112c4-8d23-42ec-9611-c785f3233d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:35.005461 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf112c4-8d23-42ec-9611-c785f3233d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.005740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf112c4-8d23-42ec-9611-c785f3233d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.006014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf112c4-8d23-42ec-9611-c785f3233d3c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.018012 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf112c4-8d23-42ec-9611-c785f3233d3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:35.025495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-edf112c4-8d23-42ec-9611-c785f3233d3c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:18:35.026987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 82/163] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:18:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:35.032932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855e6bb-30d2-439b-9ac2-b26b7c5bbebc None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:35.041788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855e6bb-30d2-439b-9ac2-b26b7c5bbebc None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:35.046292 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732ad16-e106-4da7-98ac-d6b4df2e16e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:35.047497 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732ad16-e106-4da7-98ac-d6b4df2e16e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.047777 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732ad16-e106-4da7-98ac-d6b4df2e16e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.048044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732ad16-e106-4da7-98ac-d6b4df2e16e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.048805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732ad16-e106-4da7-98ac-d6b4df2e16e2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:35.049108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732ad16-e106-4da7-98ac-d6b4df2e16e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:35.050731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732ad16-e106-4da7-98ac-d6b4df2e16e2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:35.059478 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 82/164] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:18:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:35.065593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf112c4-8d23-42ec-9611-c785f3233d3c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:35.075198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf112c4-8d23-42ec-9611-c785f3233d3c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:35.079393 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8debc-755c-47f3-8170-c1373fc412a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:35.080234 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8debc-755c-47f3-8170-c1373fc412a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.080512 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8debc-755c-47f3-8170-c1373fc412a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.080780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8debc-755c-47f3-8170-c1373fc412a7 admin admin] PATH_INFO: `/v3/users/24492a62183b4771b1a11c25752c83c7` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.082037 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8debc-755c-47f3-8170-c1373fc412a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=24492a62183b4771b1a11c25752c83c7)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:35.084244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8debc-755c-47f3-8170-c1373fc412a7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:35.086303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 83/165] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:35 2021] GET /identity/v3/users/24492a62183b4771b1a11c25752c83c7 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:35.092150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732ad16-e106-4da7-98ac-d6b4df2e16e2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:35.101866 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732ad16-e106-4da7-98ac-d6b4df2e16e2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:35.106092 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c3ff0-5ed0-40b0-97bd-30724a384721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:35.106719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c3ff0-5ed0-40b0-97bd-30724a384721 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.107030 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c3ff0-5ed0-40b0-97bd-30724a384721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.107312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c3ff0-5ed0-40b0-97bd-30724a384721 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.115674 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c3ff0-5ed0-40b0-97bd-30724a384721 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:35.117486 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c3ff0-5ed0-40b0-97bd-30724a384721 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:35.126989 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 83/166] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:35.132641 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8debc-755c-47f3-8170-c1373fc412a7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:35.142739 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8debc-755c-47f3-8170-c1373fc412a7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:35.147050 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d580ee-3a09-418e-b268-8560f581173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:35.147875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d580ee-3a09-418e-b268-8560f581173d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.148155 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d580ee-3a09-418e-b268-8560f581173d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.148428 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d580ee-3a09-418e-b268-8560f581173d admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.149592 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d580ee-3a09-418e-b268-8560f581173d admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:35.151672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d580ee-3a09-418e-b268-8560f581173d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:35.153508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 84/167] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:35 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:35.159579 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c3ff0-5ed0-40b0-97bd-30724a384721 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:35.168549 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c3ff0-5ed0-40b0-97bd-30724a384721 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:35.173365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e561166-028f-4058-a9e3-b26d3c6acae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:35.173998 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e561166-028f-4058-a9e3-b26d3c6acae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.174276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e561166-028f-4058-a9e3-b26d3c6acae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.174575 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e561166-028f-4058-a9e3-b26d3c6acae8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.175428 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e561166-028f-4058-a9e3-b26d3c6acae8 admin admin] RBAC: Adding query filter params (role.id=f4edd7aabe7e416f95ab6833aa478f07, scope.project.id=d9bef98222d5424aa293398d503f422d, user.id=24492a62183b4771b1a11c25752c83c7) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:35.175737 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e561166-028f-4058-a9e3-b26d3c6acae8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:35.177650 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e561166-028f-4058-a9e3-b26d3c6acae8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:35.183937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 84/168] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:35 2021] GET /identity/v3/role_assignments?user.id=24492a62183b4771b1a11c25752c83c7&scope.project.id=d9bef98222d5424aa293398d503f422d&role.id=f4edd7aabe7e416f95ab6833aa478f07 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:35.407707 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ec73f-91ca-423c-b00d-2eaa35a3ee0c None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.408232 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ec73f-91ca-423c-b00d-2eaa35a3ee0c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.408514 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ec73f-91ca-423c-b00d-2eaa35a3ee0c None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.410303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 85/169] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:18:35.417024 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee631a-13ad-4489-9042-177b2f7ee57b None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.417320 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee631a-13ad-4489-9042-177b2f7ee57b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.417862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee631a-13ad-4489-9042-177b2f7ee57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.435833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-24ee631a-13ad-4489-9042-177b2f7ee57b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:35.436949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-24ee631a-13ad-4489-9042-177b2f7ee57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:35.445775 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 85/170] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:35.470502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ec73f-91ca-423c-b00d-2eaa35a3ee0c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:35.483004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ec73f-91ca-423c-b00d-2eaa35a3ee0c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:35.487286 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5feb46-c938-4cf8-8c74-a1c4c00ca44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:35.488070 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5feb46-c938-4cf8-8c74-a1c4c00ca44b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.488351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5feb46-c938-4cf8-8c74-a1c4c00ca44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.488628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5feb46-c938-4cf8-8c74-a1c4c00ca44b admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.498683 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5feb46-c938-4cf8-8c74-a1c4c00ca44b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:35.506097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-7e5feb46-c938-4cf8-8c74-a1c4c00ca44b admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:18:35.507297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 86/171] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:35 2021] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:35.513416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee631a-13ad-4489-9042-177b2f7ee57b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:35.522930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee631a-13ad-4489-9042-177b2f7ee57b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:35.527264 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d63133-2bce-4002-a415-79aa63922186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:35.527917 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d63133-2bce-4002-a415-79aa63922186 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.528200 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d63133-2bce-4002-a415-79aa63922186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.528505 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d63133-2bce-4002-a415-79aa63922186 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.529276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d63133-2bce-4002-a415-79aa63922186 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:35.529587 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d63133-2bce-4002-a415-79aa63922186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:35.531255 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d63133-2bce-4002-a415-79aa63922186 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:35.539481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 86/172] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:35 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:35.545732 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5feb46-c938-4cf8-8c74-a1c4c00ca44b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:35.555255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5feb46-c938-4cf8-8c74-a1c4c00ca44b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:35.559474 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf982a91-d477-4206-baa6-9a69853b859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:35.560316 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf982a91-d477-4206-baa6-9a69853b859d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.560600 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf982a91-d477-4206-baa6-9a69853b859d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.560879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf982a91-d477-4206-baa6-9a69853b859d admin admin] PATH_INFO: `/v3/users/6c9cd9ffcd5044b09cd17da6004f8544` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.562070 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf982a91-d477-4206-baa6-9a69853b859d admin admin] RBAC: Authorizing `identity:get_user(user_id=6c9cd9ffcd5044b09cd17da6004f8544)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:35.564751 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf982a91-d477-4206-baa6-9a69853b859d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:35.566321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 87/173] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:35 2021] GET /identity/v3/users/6c9cd9ffcd5044b09cd17da6004f8544 => generated 289 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:35.571983 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d63133-2bce-4002-a415-79aa63922186 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:35.582074 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d63133-2bce-4002-a415-79aa63922186 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:35.586563 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb6d61-5b94-4fbc-b311-77b5ff63a501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:35.587566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb6d61-5b94-4fbc-b311-77b5ff63a501 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.587916 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb6d61-5b94-4fbc-b311-77b5ff63a501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.588201 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb6d61-5b94-4fbc-b311-77b5ff63a501 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.589399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb6d61-5b94-4fbc-b311-77b5ff63a501 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:35.591501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb6d61-5b94-4fbc-b311-77b5ff63a501 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:35.593155 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 87/174] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:35 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:35.598792 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf982a91-d477-4206-baa6-9a69853b859d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:35.609126 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf982a91-d477-4206-baa6-9a69853b859d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:35.613345 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349dbaf5-b29d-422e-aafa-2667f16151ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:35.614196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dbaf5-b29d-422e-aafa-2667f16151ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.614475 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dbaf5-b29d-422e-aafa-2667f16151ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.614747 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dbaf5-b29d-422e-aafa-2667f16151ea admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d/users/6c9cd9ffcd5044b09cd17da6004f8544/roles/726ace838f324527844cb0c0a21a0fbf` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.616701 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349dbaf5-b29d-422e-aafa-2667f16151ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9bef98222d5424aa293398d503f422d, user_id=6c9cd9ffcd5044b09cd17da6004f8544, role_id=726ace838f324527844cb0c0a21a0fbf)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:35.619350 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349dbaf5-b29d-422e-aafa-2667f16151ea admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:35.632352 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 88/175] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:18:35 2021] PUT /identity/v3/projects/d9bef98222d5424aa293398d503f422d/users/6c9cd9ffcd5044b09cd17da6004f8544/roles/726ace838f324527844cb0c0a21a0fbf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:18:35.654193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19d59f-1d65-4288-9d94-f9886ad06b37 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.654498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19d59f-1d65-4288-9d94-f9886ad06b37 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.654753 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19d59f-1d65-4288-9d94-f9886ad06b37 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.656919 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 88/176] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:35.663033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c1f73-7a62-40eb-9c5e-0670cffa95b5 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.663327 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c1f73-7a62-40eb-9c5e-0670cffa95b5 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.663607 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c1f73-7a62-40eb-9c5e-0670cffa95b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.682706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-3b8c1f73-7a62-40eb-9c5e-0670cffa95b5 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:35.683979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3b8c1f73-7a62-40eb-9c5e-0670cffa95b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:35.744323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 89/177] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:35.770239 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19d59f-1d65-4288-9d94-f9886ad06b37 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:35.782451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19d59f-1d65-4288-9d94-f9886ad06b37 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:35.786750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d6bf1-8bbe-426e-ae45-ec0209a9eb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:35.787609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d6bf1-8bbe-426e-ae45-ec0209a9eb32 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.787888 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d6bf1-8bbe-426e-ae45-ec0209a9eb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.788161 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d6bf1-8bbe-426e-ae45-ec0209a9eb32 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.789347 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d6bf1-8bbe-426e-ae45-ec0209a9eb32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:35.791091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d6bf1-8bbe-426e-ae45-ec0209a9eb32 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:35.792986 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 89/178] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:35.799574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c1f73-7a62-40eb-9c5e-0670cffa95b5 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:35.808683 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c1f73-7a62-40eb-9c5e-0670cffa95b5 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:35.813628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1fb85-d860-4895-8bc6-0681e80ff818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:35.814302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1fb85-d860-4895-8bc6-0681e80ff818 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:35.814579 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1fb85-d860-4895-8bc6-0681e80ff818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:35.814864 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1fb85-d860-4895-8bc6-0681e80ff818 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:35.815618 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1fb85-d860-4895-8bc6-0681e80ff818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:35.817551 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1fb85-d860-4895-8bc6-0681e80ff818 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:35.841033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 90/179] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:18:35 2021] POST /identity/v3/users => generated 283 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:18:37.998269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09ec1-a99e-4cb9-a1fd-3bf4bf97efef None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:37.998781 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09ec1-a99e-4cb9-a1fd-3bf4bf97efef None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:37.998890 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09ec1-a99e-4cb9-a1fd-3bf4bf97efef None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.000689 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 90/180] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:38.006575 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb5160-cee6-45aa-aeac-aa01e11ccd8a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.007020 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb5160-cee6-45aa-aeac-aa01e11ccd8a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.007191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb5160-cee6-45aa-aeac-aa01e11ccd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.031219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-32fb5160-cee6-45aa-aeac-aa01e11ccd8a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:38.033037 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-32fb5160-cee6-45aa-aeac-aa01e11ccd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:38.041249 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 91/181] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:38.066307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f09ec1-a99e-4cb9-a1fd-3bf4bf97efef None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.079572 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f09ec1-a99e-4cb9-a1fd-3bf4bf97efef None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.083962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64f636-ddff-4d36-b8f9-0b263402f3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.084750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64f636-ddff-4d36-b8f9-0b263402f3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.085032 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64f636-ddff-4d36-b8f9-0b263402f3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.085311 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64f636-ddff-4d36-b8f9-0b263402f3b2 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.096557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64f636-ddff-4d36-b8f9-0b263402f3b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:38.103420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-6b64f636-ddff-4d36-b8f9-0b263402f3b2 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:18:38.104622 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 91/182] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:38.110879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb5160-cee6-45aa-aeac-aa01e11ccd8a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.119841 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb5160-cee6-45aa-aeac-aa01e11ccd8a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.124272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5dd73-0496-4f3e-8e37-f46ca488ecb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.124938 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5dd73-0496-4f3e-8e37-f46ca488ecb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.125219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5dd73-0496-4f3e-8e37-f46ca488ecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.125525 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5dd73-0496-4f3e-8e37-f46ca488ecb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.126297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5dd73-0496-4f3e-8e37-f46ca488ecb7 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:38.126603 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5dd73-0496-4f3e-8e37-f46ca488ecb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.128241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5dd73-0496-4f3e-8e37-f46ca488ecb7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.137124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 92/183] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:38.143530 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64f636-ddff-4d36-b8f9-0b263402f3b2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.153993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64f636-ddff-4d36-b8f9-0b263402f3b2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.159041 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77918c7-5ef5-4151-9028-61adb230ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.159898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77918c7-5ef5-4151-9028-61adb230ae5c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.160182 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77918c7-5ef5-4151-9028-61adb230ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.160462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77918c7-5ef5-4151-9028-61adb230ae5c admin admin] PATH_INFO: `/v3/users/6c9cd9ffcd5044b09cd17da6004f8544` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.161683 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77918c7-5ef5-4151-9028-61adb230ae5c admin admin] RBAC: Authorizing `identity:get_user(user_id=6c9cd9ffcd5044b09cd17da6004f8544)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.163896 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77918c7-5ef5-4151-9028-61adb230ae5c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.165535 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 92/184] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/users/6c9cd9ffcd5044b09cd17da6004f8544 => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:38.171859 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5dd73-0496-4f3e-8e37-f46ca488ecb7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.181608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5dd73-0496-4f3e-8e37-f46ca488ecb7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.185971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b39bf4-7ff8-4cae-9f8a-b2b15b8be6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.186609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b39bf4-7ff8-4cae-9f8a-b2b15b8be6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.186918 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b39bf4-7ff8-4cae-9f8a-b2b15b8be6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.187198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b39bf4-7ff8-4cae-9f8a-b2b15b8be6b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.194982 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b39bf4-7ff8-4cae-9f8a-b2b15b8be6b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.196724 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b39bf4-7ff8-4cae-9f8a-b2b15b8be6b5 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.206150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 93/185] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:38.212006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77918c7-5ef5-4151-9028-61adb230ae5c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.222294 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77918c7-5ef5-4151-9028-61adb230ae5c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.226717 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64acf2-1ce7-4e72-a537-be4a23fd739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.227590 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64acf2-1ce7-4e72-a537-be4a23fd739d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.227874 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64acf2-1ce7-4e72-a537-be4a23fd739d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.228150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64acf2-1ce7-4e72-a537-be4a23fd739d admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.229365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64acf2-1ce7-4e72-a537-be4a23fd739d admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.231500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64acf2-1ce7-4e72-a537-be4a23fd739d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.233199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 93/186] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:38.239491 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b39bf4-7ff8-4cae-9f8a-b2b15b8be6b5 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.248604 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b39bf4-7ff8-4cae-9f8a-b2b15b8be6b5 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.253071 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ec824-b61a-4ae9-842b-63067afee843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.253713 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ec824-b61a-4ae9-842b-63067afee843 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.253999 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ec824-b61a-4ae9-842b-63067afee843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.254274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ec824-b61a-4ae9-842b-63067afee843 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.255151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ec824-b61a-4ae9-842b-63067afee843 admin admin] RBAC: Adding query filter params (role.id=726ace838f324527844cb0c0a21a0fbf, scope.project.id=d9bef98222d5424aa293398d503f422d, user.id=6c9cd9ffcd5044b09cd17da6004f8544) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:38.255464 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ec824-b61a-4ae9-842b-63067afee843 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.257297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ec824-b61a-4ae9-842b-63067afee843 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.263301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 94/187] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/role_assignments?user.id=6c9cd9ffcd5044b09cd17da6004f8544&scope.project.id=d9bef98222d5424aa293398d503f422d&role.id=726ace838f324527844cb0c0a21a0fbf => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:38.313985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd9d3e-2105-445b-aa3f-6973782f23a6 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.314635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd9d3e-2105-445b-aa3f-6973782f23a6 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.315166 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd9d3e-2105-445b-aa3f-6973782f23a6 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.317194 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 94/188] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:38.323853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2883b8-050c-4758-a214-a72bc1c10031 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.324476 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2883b8-050c-4758-a214-a72bc1c10031 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.324978 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2883b8-050c-4758-a214-a72bc1c10031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.344847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-9e2883b8-050c-4758-a214-a72bc1c10031 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:38.346407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9e2883b8-050c-4758-a214-a72bc1c10031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:38.354554 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 95/189] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:38.379234 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd9d3e-2105-445b-aa3f-6973782f23a6 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.393821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd9d3e-2105-445b-aa3f-6973782f23a6 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.399693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4007840-7b17-4f2c-a381-46e26f6e7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.401022 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4007840-7b17-4f2c-a381-46e26f6e7052 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.401523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4007840-7b17-4f2c-a381-46e26f6e7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.402199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4007840-7b17-4f2c-a381-46e26f6e7052 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.418555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4007840-7b17-4f2c-a381-46e26f6e7052 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:38.426554 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-e4007840-7b17-4f2c-a381-46e26f6e7052 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:18:38.428186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 95/190] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:38.434753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2883b8-050c-4758-a214-a72bc1c10031 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.444532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2883b8-050c-4758-a214-a72bc1c10031 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.449491 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c8bfb-d94e-417b-b189-d36362923c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.450465 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c8bfb-d94e-417b-b189-d36362923c90 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.450983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c8bfb-d94e-417b-b189-d36362923c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.451456 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c8bfb-d94e-417b-b189-d36362923c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.452438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c8bfb-d94e-417b-b189-d36362923c90 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:38.452968 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c8bfb-d94e-417b-b189-d36362923c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.454880 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c8bfb-d94e-417b-b189-d36362923c90 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.464583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 96/191] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:38.473617 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4007840-7b17-4f2c-a381-46e26f6e7052 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.480794 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33a83e-3a9a-44ea-94b9-77be4ae15d59 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.481077 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33a83e-3a9a-44ea-94b9-77be4ae15d59 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.481360 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33a83e-3a9a-44ea-94b9-77be4ae15d59 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.483166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 97/192] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:38.485354 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4007840-7b17-4f2c-a381-46e26f6e7052 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.489889 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d52ffd-c191-426b-b31d-c0adee66edf5 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.490153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d52ffd-c191-426b-b31d-c0adee66edf5 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.490428 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d52ffd-c191-426b-b31d-c0adee66edf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.490588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d3de8-f4e0-45c9-abdf-711336692e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.491460 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d3de8-f4e0-45c9-abdf-711336692e5e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.491835 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d3de8-f4e0-45c9-abdf-711336692e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.492121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d3de8-f4e0-45c9-abdf-711336692e5e admin admin] PATH_INFO: `/v3/users/eab751ec05304288831f161a66704877` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.507183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d3de8-f4e0-45c9-abdf-711336692e5e admin admin] RBAC: Authorizing `identity:get_user(user_id=eab751ec05304288831f161a66704877)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.509301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b8d52ffd-c191-426b-b31d-c0adee66edf5 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:38.509641 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d3de8-f4e0-45c9-abdf-711336692e5e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.510700 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b8d52ffd-c191-426b-b31d-c0adee66edf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:38.511607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 96/193] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/users/eab751ec05304288831f161a66704877 => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:38.512720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d62d7-1cea-475c-ac0c-226bd2928cd5 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.512978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d62d7-1cea-475c-ac0c-226bd2928cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.513245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d62d7-1cea-475c-ac0c-226bd2928cd5 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.515342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 97/194] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:38.519721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 98/195] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:38.521716 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623a105-428b-418e-b07c-b9aa0758b649 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.522003 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623a105-428b-418e-b07c-b9aa0758b649 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.522294 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623a105-428b-418e-b07c-b9aa0758b649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.523737 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d52ffd-c191-426b-b31d-c0adee66edf5 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.537068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d52ffd-c191-426b-b31d-c0adee66edf5 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.541664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8336eb-989c-4453-8a7c-cec30667a57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.542304 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8336eb-989c-4453-8a7c-cec30667a57c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.542588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8336eb-989c-4453-8a7c-cec30667a57c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.543152 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8336eb-989c-4453-8a7c-cec30667a57c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.545989 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-c623a105-428b-418e-b07c-b9aa0758b649 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:38.547294 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c623a105-428b-418e-b07c-b9aa0758b649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:38.552244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8336eb-989c-4453-8a7c-cec30667a57c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.553959 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8336eb-989c-4453-8a7c-cec30667a57c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.555636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 98/196] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:38.556278 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623a105-428b-418e-b07c-b9aa0758b649 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.564396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 99/197] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:38.568742 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623a105-428b-418e-b07c-b9aa0758b649 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.570479 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8336eb-989c-4453-8a7c-cec30667a57c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.573115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfb161-98d3-4944-95ec-8baf34f48c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.573902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfb161-98d3-4944-95ec-8baf34f48c02 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.574263 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfb161-98d3-4944-95ec-8baf34f48c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.574452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfb161-98d3-4944-95ec-8baf34f48c02 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.578663 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8336eb-989c-4453-8a7c-cec30667a57c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.583438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ade19-c701-4a00-bd82-eb3e108c9010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.584368 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ade19-c701-4a00-bd82-eb3e108c9010 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.584550 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ade19-c701-4a00-bd82-eb3e108c9010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.584823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ade19-c701-4a00-bd82-eb3e108c9010 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.585902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfb161-98d3-4944-95ec-8baf34f48c02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:38.586004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ade19-c701-4a00-bd82-eb3e108c9010 admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.588068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ade19-c701-4a00-bd82-eb3e108c9010 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.590300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 100/198] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:38.591688 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ade19-c701-4a00-bd82-eb3e108c9010 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.592556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-b2cfb161-98d3-4944-95ec-8baf34f48c02 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:18:38.593911 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 99/199] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:38.596846 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfb161-98d3-4944-95ec-8baf34f48c02 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.602993 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ade19-c701-4a00-bd82-eb3e108c9010 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.607362 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfb161-98d3-4944-95ec-8baf34f48c02 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.607495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeed033-3a8b-4966-aa41-ac2826a6faeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.608204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeed033-3a8b-4966-aa41-ac2826a6faeb admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.608486 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeed033-3a8b-4966-aa41-ac2826a6faeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.608771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeed033-3a8b-4966-aa41-ac2826a6faeb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.610501 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeed033-3a8b-4966-aa41-ac2826a6faeb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.612212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeed033-3a8b-4966-aa41-ac2826a6faeb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.612485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7331c-3bdc-4b39-8021-ddba9fe59666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.613108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7331c-3bdc-4b39-8021-ddba9fe59666 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.613390 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7331c-3bdc-4b39-8021-ddba9fe59666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.613665 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7331c-3bdc-4b39-8021-ddba9fe59666 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.614063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 101/200] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:38.614517 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7331c-3bdc-4b39-8021-ddba9fe59666 admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=8dc4455f0ea9485aac8ec368a026004f, user.id=eab751ec05304288831f161a66704877) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:38.614824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeed033-3a8b-4966-aa41-ac2826a6faeb admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.614938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7331c-3bdc-4b39-8021-ddba9fe59666 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.616692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7331c-3bdc-4b39-8021-ddba9fe59666 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.623562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 100/201] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/role_assignments?user.id=eab751ec05304288831f161a66704877&scope.project.id=8dc4455f0ea9485aac8ec368a026004f&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:38.623967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeed033-3a8b-4966-aa41-ac2826a6faeb admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.624426 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7331c-3bdc-4b39-8021-ddba9fe59666 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.630820 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cab149-709d-4c11-b003-15ed40454d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.632100 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cab149-709d-4c11-b003-15ed40454d1a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.632534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cab149-709d-4c11-b003-15ed40454d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.632986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cab149-709d-4c11-b003-15ed40454d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.634059 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7331c-3bdc-4b39-8021-ddba9fe59666 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.634250 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cab149-709d-4c11-b003-15ed40454d1a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:38.634710 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cab149-709d-4c11-b003-15ed40454d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.636450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cab149-709d-4c11-b003-15ed40454d1a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.638702 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1ff6-2e45-4529-b421-5d703fb15c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.639429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1ff6-2e45-4529-b421-5d703fb15c96 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.639710 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1ff6-2e45-4529-b421-5d703fb15c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.639985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1ff6-2e45-4529-b421-5d703fb15c96 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.640730 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef1ff6-2e45-4529-b421-5d703fb15c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.643316 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef1ff6-2e45-4529-b421-5d703fb15c96 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.651650 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 102/202] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:38.653243 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cab149-709d-4c11-b003-15ed40454d1a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.666226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cab149-709d-4c11-b003-15ed40454d1a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.671209 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709930d-5439-4b02-aa1f-0cbd8fa65302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.672091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709930d-5439-4b02-aa1f-0cbd8fa65302 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.672307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 101/203] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:18:38 2021] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:18:38.675112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709930d-5439-4b02-aa1f-0cbd8fa65302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.675112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709930d-5439-4b02-aa1f-0cbd8fa65302 admin admin] PATH_INFO: `/v3/users/eab751ec05304288831f161a66704877` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.675784 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709930d-5439-4b02-aa1f-0cbd8fa65302 admin admin] RBAC: Authorizing `identity:get_user(user_id=eab751ec05304288831f161a66704877)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.677971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709930d-5439-4b02-aa1f-0cbd8fa65302 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.679823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 103/204] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/users/eab751ec05304288831f161a66704877 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:38.691394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1ff6-2e45-4529-b421-5d703fb15c96 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.702125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1ff6-2e45-4529-b421-5d703fb15c96 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.707428 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be68a9e-cc3a-49a5-ac47-66a4da58af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.708127 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68a9e-cc3a-49a5-ac47-66a4da58af20 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.708411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68a9e-cc3a-49a5-ac47-66a4da58af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.708688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68a9e-cc3a-49a5-ac47-66a4da58af20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.717804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be68a9e-cc3a-49a5-ac47-66a4da58af20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.719725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be68a9e-cc3a-49a5-ac47-66a4da58af20 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.729989 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 102/205] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:18:38.737030 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709930d-5439-4b02-aa1f-0cbd8fa65302 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.747694 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709930d-5439-4b02-aa1f-0cbd8fa65302 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.752459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02f6b1-f66f-41c3-9e0d-cb2889322c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.753343 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02f6b1-f66f-41c3-9e0d-cb2889322c1c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.753644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02f6b1-f66f-41c3-9e0d-cb2889322c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.753924 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02f6b1-f66f-41c3-9e0d-cb2889322c1c admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.755347 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02f6b1-f66f-41c3-9e0d-cb2889322c1c admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.757539 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02f6b1-f66f-41c3-9e0d-cb2889322c1c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.759589 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 104/206] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:38.766742 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be68a9e-cc3a-49a5-ac47-66a4da58af20 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:38.776272 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be68a9e-cc3a-49a5-ac47-66a4da58af20 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:38.780809 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb52ee-c20c-401c-819b-39f90b1359cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:38.781486 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb52ee-c20c-401c-819b-39f90b1359cf admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:38.782337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb52ee-c20c-401c-819b-39f90b1359cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:38.782620 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb52ee-c20c-401c-819b-39f90b1359cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:38.783522 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb52ee-c20c-401c-819b-39f90b1359cf admin admin] RBAC: Adding query filter params (role.id=f4edd7aabe7e416f95ab6833aa478f07, scope.project.id=8dc4455f0ea9485aac8ec368a026004f, user.id=eab751ec05304288831f161a66704877) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:38.783837 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb52ee-c20c-401c-819b-39f90b1359cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:38.785741 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb52ee-c20c-401c-819b-39f90b1359cf admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:38.792269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 103/207] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:38 2021] GET /identity/v3/role_assignments?user.id=eab751ec05304288831f161a66704877&scope.project.id=8dc4455f0ea9485aac8ec368a026004f&role.id=f4edd7aabe7e416f95ab6833aa478f07 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:41.017796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3e6ed-a6c3-44e6-bcf3-24a59c0fb72d None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.018306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3e6ed-a6c3-44e6-bcf3-24a59c0fb72d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.018408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3e6ed-a6c3-44e6-bcf3-24a59c0fb72d None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.020150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 105/208] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:41.026033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f36ab-c340-4726-95c8-7d25483bf0c2 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.026433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f36ab-c340-4726-95c8-7d25483bf0c2 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.026597 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f36ab-c340-4726-95c8-7d25483bf0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.044967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-9d1f36ab-c340-4726-95c8-7d25483bf0c2 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:41.046133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9d1f36ab-c340-4726-95c8-7d25483bf0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:41.054500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 104/209] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:41.077599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3e6ed-a6c3-44e6-bcf3-24a59c0fb72d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.089609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3e6ed-a6c3-44e6-bcf3-24a59c0fb72d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.094115 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad75883-a3cc-4518-98fd-1e70a999e92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.094961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad75883-a3cc-4518-98fd-1e70a999e92d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.095244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad75883-a3cc-4518-98fd-1e70a999e92d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.095514 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad75883-a3cc-4518-98fd-1e70a999e92d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.106195 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad75883-a3cc-4518-98fd-1e70a999e92d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:41.113452 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-1ad75883-a3cc-4518-98fd-1e70a999e92d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:18:41.114634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 106/210] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:41.121057 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f36ab-c340-4726-95c8-7d25483bf0c2 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.131031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f36ab-c340-4726-95c8-7d25483bf0c2 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.135424 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b7b47-842d-41f8-bc8d-f3d7af610340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.136076 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7b47-842d-41f8-bc8d-f3d7af610340 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.136354 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7b47-842d-41f8-bc8d-f3d7af610340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.136630 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7b47-842d-41f8-bc8d-f3d7af610340 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.137400 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b7b47-842d-41f8-bc8d-f3d7af610340 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:41.137704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b7b47-842d-41f8-bc8d-f3d7af610340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.139348 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b7b47-842d-41f8-bc8d-f3d7af610340 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.145982 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ced61-0dcb-4012-9848-03eca7d143af None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.146266 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ced61-0dcb-4012-9848-03eca7d143af None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.146544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ced61-0dcb-4012-9848-03eca7d143af None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.148493 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 107/211] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:18:41.150810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 105/212] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:41.156222 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7fc71-559d-4cba-b945-39cfd0a401ba None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.156509 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7fc71-559d-4cba-b945-39cfd0a401ba None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.156824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7fc71-559d-4cba-b945-39cfd0a401ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.159018 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b7b47-842d-41f8-bc8d-f3d7af610340 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.169709 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b7b47-842d-41f8-bc8d-f3d7af610340 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.175407 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f39cb0-0489-43ac-a6c2-7b1478ce659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.176260 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f39cb0-0489-43ac-a6c2-7b1478ce659b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.176548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f39cb0-0489-43ac-a6c2-7b1478ce659b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.176825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f39cb0-0489-43ac-a6c2-7b1478ce659b admin admin] PATH_INFO: `/v3/users/eab751ec05304288831f161a66704877` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.177827 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-48a7fc71-559d-4cba-b945-39cfd0a401ba None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:41.178042 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f39cb0-0489-43ac-a6c2-7b1478ce659b admin admin] RBAC: Authorizing `identity:get_user(user_id=eab751ec05304288831f161a66704877)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.179420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-48a7fc71-559d-4cba-b945-39cfd0a401ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:41.180222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f39cb0-0489-43ac-a6c2-7b1478ce659b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.181986 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 106/213] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/users/eab751ec05304288831f161a66704877 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:41.187566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f39cb0-0489-43ac-a6c2-7b1478ce659b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.189052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 108/214] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:41.197649 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f39cb0-0489-43ac-a6c2-7b1478ce659b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.202015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33eee9-b043-4ad4-b55b-3fddacb022fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.202855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33eee9-b043-4ad4-b55b-3fddacb022fe admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.203148 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33eee9-b043-4ad4-b55b-3fddacb022fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.203425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33eee9-b043-4ad4-b55b-3fddacb022fe admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.204879 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33eee9-b043-4ad4-b55b-3fddacb022fe admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.206417 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8652e0-c221-47ef-b5f5-de3fbe8fb752 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.206707 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8652e0-c221-47ef-b5f5-de3fbe8fb752 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.206990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33eee9-b043-4ad4-b55b-3fddacb022fe admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.207084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8652e0-c221-47ef-b5f5-de3fbe8fb752 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.208788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 107/215] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:41.208896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 109/216] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:41.215262 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab9892-1ca6-4b67-9c2a-7d8d94b3b6cb None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.215553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab9892-1ca6-4b67-9c2a-7d8d94b3b6cb None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.215871 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab9892-1ca6-4b67-9c2a-7d8d94b3b6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.216646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33eee9-b043-4ad4-b55b-3fddacb022fe admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.227511 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33eee9-b043-4ad4-b55b-3fddacb022fe admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.233083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e2a61-6b80-4b94-971f-58c5595915f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.233302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-a6ab9892-1ca6-4b67-9c2a-7d8d94b3b6cb None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:41.233974 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2a61-6b80-4b94-971f-58c5595915f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.234260 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2a61-6b80-4b94-971f-58c5595915f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.234477 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a6ab9892-1ca6-4b67-9c2a-7d8d94b3b6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:41.234566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2a61-6b80-4b94-971f-58c5595915f1 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f/users/eab751ec05304288831f161a66704877/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.237059 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e2a61-6b80-4b94-971f-58c5595915f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc4455f0ea9485aac8ec368a026004f, user_id=eab751ec05304288831f161a66704877, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.239832 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e2a61-6b80-4b94-971f-58c5595915f1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.242649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 110/217] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:41.243286 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab9892-1ca6-4b67-9c2a-7d8d94b3b6cb None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.258026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab9892-1ca6-4b67-9c2a-7d8d94b3b6cb None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.261252 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 108/218] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:18:41 2021] PUT /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f/users/eab751ec05304288831f161a66704877/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:18:41.262897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233362a7-90e3-4250-a4a7-5dca284df1ac None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.263395 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233362a7-90e3-4250-a4a7-5dca284df1ac None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.263867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233362a7-90e3-4250-a4a7-5dca284df1ac None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.265895 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 109/219] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:41.267696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233362a7-90e3-4250-a4a7-5dca284df1ac None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.327300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba26cc7-39a5-4286-a67d-ca2868bb6d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.328042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba26cc7-39a5-4286-a67d-ca2868bb6d02 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.328325 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba26cc7-39a5-4286-a67d-ca2868bb6d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.328628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba26cc7-39a5-4286-a67d-ca2868bb6d02 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.340130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba26cc7-39a5-4286-a67d-ca2868bb6d02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:41.343654 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233362a7-90e3-4250-a4a7-5dca284df1ac None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.349339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad550ff1-582e-45e5-ba5e-fb4ca0011e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.350801 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad550ff1-582e-45e5-ba5e-fb4ca0011e6e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.351131 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad550ff1-582e-45e5-ba5e-fb4ca0011e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.351449 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad550ff1-582e-45e5-ba5e-fb4ca0011e6e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.353236 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-6ba26cc7-39a5-4286-a67d-ca2868bb6d02 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:18:41.357267 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 111/220] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:41.358762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e772-a699-4d2e-a8af-5d3304603148 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.359136 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e772-a699-4d2e-a8af-5d3304603148 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.359369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e772-a699-4d2e-a8af-5d3304603148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.373318 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad550ff1-582e-45e5-ba5e-fb4ca0011e6e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:41.379256 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-8156e772-a699-4d2e-a8af-5d3304603148 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:41.380484 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8156e772-a699-4d2e-a8af-5d3304603148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:41.381043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-ad550ff1-582e-45e5-ba5e-fb4ca0011e6e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:18:41.382462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 110/221] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:18:41.388211 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 112/222] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:41.389276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad550ff1-582e-45e5-ba5e-fb4ca0011e6e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.389713 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156e772-a699-4d2e-a8af-5d3304603148 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.400406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad550ff1-582e-45e5-ba5e-fb4ca0011e6e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.401815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156e772-a699-4d2e-a8af-5d3304603148 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.405391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7b6b7-c48a-4b1c-aa3c-6b24d6eab8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.406282 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b6b7-c48a-4b1c-aa3c-6b24d6eab8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.406736 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b6b7-c48a-4b1c-aa3c-6b24d6eab8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.407772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b6b7-c48a-4b1c-aa3c-6b24d6eab8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.408158 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2a261-fdda-4c9a-a339-d1131c626586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.408848 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2a261-fdda-4c9a-a339-d1131c626586 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.409219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2a261-fdda-4c9a-a339-d1131c626586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.409319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7b6b7-c48a-4b1c-aa3c-6b24d6eab8a6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:41.409550 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2a261-fdda-4c9a-a339-d1131c626586 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.410024 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7b6b7-c48a-4b1c-aa3c-6b24d6eab8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.410433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2a261-fdda-4c9a-a339-d1131c626586 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:41.410791 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2a261-fdda-4c9a-a339-d1131c626586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.412358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7b6b7-c48a-4b1c-aa3c-6b24d6eab8a6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.412621 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2a261-fdda-4c9a-a339-d1131c626586 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.423397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 111/223] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:41.424275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7b6b7-c48a-4b1c-aa3c-6b24d6eab8a6 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.425589 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 113/224] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:41.429558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2a261-fdda-4c9a-a339-d1131c626586 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.441125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7b6b7-c48a-4b1c-aa3c-6b24d6eab8a6 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.442136 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2a261-fdda-4c9a-a339-d1131c626586 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.446997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de221255-77e2-4cac-8579-841067c1eee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.448037 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de221255-77e2-4cac-8579-841067c1eee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.448303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de221255-77e2-4cac-8579-841067c1eee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.448791 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de221255-77e2-4cac-8579-841067c1eee3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.449105 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fad04-ceee-4ad7-88b1-633c0542a628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.449988 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fad04-ceee-4ad7-88b1-633c0542a628 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.450270 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fad04-ceee-4ad7-88b1-633c0542a628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.450549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fad04-ceee-4ad7-88b1-633c0542a628 admin admin] PATH_INFO: `/v3/users/eab751ec05304288831f161a66704877` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.451056 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de221255-77e2-4cac-8579-841067c1eee3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.452404 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fad04-ceee-4ad7-88b1-633c0542a628 admin admin] RBAC: Authorizing `identity:get_user(user_id=eab751ec05304288831f161a66704877)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.454623 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fad04-ceee-4ad7-88b1-633c0542a628 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.455204 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de221255-77e2-4cac-8579-841067c1eee3 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.462071 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 114/225] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/users/eab751ec05304288831f161a66704877 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:41.462071 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fad04-ceee-4ad7-88b1-633c0542a628 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.462407 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 112/226] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:41.462900 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de221255-77e2-4cac-8579-841067c1eee3 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.473876 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fad04-ceee-4ad7-88b1-633c0542a628 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.474058 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de221255-77e2-4cac-8579-841067c1eee3 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.481283 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f22e6a-73b4-48f6-90be-56be2a18dbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.482160 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22e6a-73b4-48f6-90be-56be2a18dbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.483093 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22e6a-73b4-48f6-90be-56be2a18dbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.483093 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22e6a-73b4-48f6-90be-56be2a18dbb1 admin admin] PATH_INFO: `/v3/users/d0a1f9fb3d6943c88bbfe7c8c555fcb3` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.484533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801e05e-941e-43f0-a4de-5a76ef802656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.486176 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801e05e-941e-43f0-a4de-5a76ef802656 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.486638 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801e05e-941e-43f0-a4de-5a76ef802656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.487202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801e05e-941e-43f0-a4de-5a76ef802656 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.488643 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801e05e-941e-43f0-a4de-5a76ef802656 admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.490930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801e05e-941e-43f0-a4de-5a76ef802656 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.492795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 113/227] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:41.493374 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801e05e-941e-43f0-a4de-5a76ef802656 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.498098 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f22e6a-73b4-48f6-90be-56be2a18dbb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=d0a1f9fb3d6943c88bbfe7c8c555fcb3)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.500314 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f22e6a-73b4-48f6-90be-56be2a18dbb1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.502078 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 115/228] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/users/d0a1f9fb3d6943c88bbfe7c8c555fcb3 => generated 297 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:41.502818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f22e6a-73b4-48f6-90be-56be2a18dbb1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.502953 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801e05e-941e-43f0-a4de-5a76ef802656 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.507600 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c8691-9253-4751-a7a3-e6bc15e4e9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.508312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8691-9253-4751-a7a3-e6bc15e4e9ff admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.508603 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8691-9253-4751-a7a3-e6bc15e4e9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.508878 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8691-9253-4751-a7a3-e6bc15e4e9ff admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.509604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c8691-9253-4751-a7a3-e6bc15e4e9ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.511664 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c8691-9253-4751-a7a3-e6bc15e4e9ff admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.512121 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f22e6a-73b4-48f6-90be-56be2a18dbb1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.518092 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c9511-1404-4a3a-9365-814cb919b7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.519016 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c9511-1404-4a3a-9365-814cb919b7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.519304 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c9511-1404-4a3a-9365-814cb919b7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.519581 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c9511-1404-4a3a-9365-814cb919b7a1 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f/users/eab751ec05304288831f161a66704877/roles/f4edd7aabe7e416f95ab6833aa478f07` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.522883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c9511-1404-4a3a-9365-814cb919b7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc4455f0ea9485aac8ec368a026004f, user_id=eab751ec05304288831f161a66704877, role_id=f4edd7aabe7e416f95ab6833aa478f07)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.525528 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c9511-1404-4a3a-9365-814cb919b7a1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.535428 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 114/229] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:18:41 2021] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:18:41.536368 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c8691-9253-4751-a7a3-e6bc15e4e9ff admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.538460 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 116/230] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:18:41 2021] PUT /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f/users/eab751ec05304288831f161a66704877/roles/f4edd7aabe7e416f95ab6833aa478f07 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:18:41.557364 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c8691-9253-4751-a7a3-e6bc15e4e9ff admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.627586 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb876bd-3ee8-46f2-be48-1f9674862060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.628183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb876bd-3ee8-46f2-be48-1f9674862060 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.628468 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb876bd-3ee8-46f2-be48-1f9674862060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.628748 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb876bd-3ee8-46f2-be48-1f9674862060 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.638283 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb876bd-3ee8-46f2-be48-1f9674862060 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.640209 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb876bd-3ee8-46f2-be48-1f9674862060 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.651858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 115/231] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:41.659935 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c9511-1404-4a3a-9365-814cb919b7a1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.670598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c9511-1404-4a3a-9365-814cb919b7a1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.675333 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66771a-9a5c-4edf-a28a-d166e7dd5e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.676223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66771a-9a5c-4edf-a28a-d166e7dd5e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.676502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66771a-9a5c-4edf-a28a-d166e7dd5e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.676775 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66771a-9a5c-4edf-a28a-d166e7dd5e66 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.678084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66771a-9a5c-4edf-a28a-d166e7dd5e66 admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.680254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66771a-9a5c-4edf-a28a-d166e7dd5e66 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.682292 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 117/232] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:41.693872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb876bd-3ee8-46f2-be48-1f9674862060 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:41.703350 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb876bd-3ee8-46f2-be48-1f9674862060 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:41.708461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d4301-24bb-4051-8a0a-9aa6bd1de90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:41.709125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d4301-24bb-4051-8a0a-9aa6bd1de90d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:41.709405 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d4301-24bb-4051-8a0a-9aa6bd1de90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:41.709682 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d4301-24bb-4051-8a0a-9aa6bd1de90d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:41.710547 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d4301-24bb-4051-8a0a-9aa6bd1de90d admin admin] RBAC: Adding query filter params (role.id=e734a22c1b2c40feb0147271d002bdee, scope.project.id=8dc4455f0ea9485aac8ec368a026004f, user.id=d0a1f9fb3d6943c88bbfe7c8c555fcb3) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:41.710878 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d4301-24bb-4051-8a0a-9aa6bd1de90d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:41.712837 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d4301-24bb-4051-8a0a-9aa6bd1de90d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:41.719377 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 116/233] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:41 2021] GET /identity/v3/role_assignments?user.id=d0a1f9fb3d6943c88bbfe7c8c555fcb3&scope.project.id=8dc4455f0ea9485aac8ec368a026004f&role.id=e734a22c1b2c40feb0147271d002bdee => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:44.164162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1124cd-e930-4635-a41c-23db8aaa311d None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.165262 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1124cd-e930-4635-a41c-23db8aaa311d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.165756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1124cd-e930-4635-a41c-23db8aaa311d None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.168570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 118/234] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:44.176035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b3fed-ea38-4ba9-b6ff-9a4c417e555a None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.177013 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b3fed-ea38-4ba9-b6ff-9a4c417e555a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.177488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b3fed-ea38-4ba9-b6ff-9a4c417e555a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.207883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-533b3fed-ea38-4ba9-b6ff-9a4c417e555a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:44.209403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-533b3fed-ea38-4ba9-b6ff-9a4c417e555a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:44.217704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 117/235] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:44.261120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1124cd-e930-4635-a41c-23db8aaa311d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.276745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1124cd-e930-4635-a41c-23db8aaa311d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.284296 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412baeba-8f45-44c1-818f-4e42aa509137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.285375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412baeba-8f45-44c1-818f-4e42aa509137 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.285853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412baeba-8f45-44c1-818f-4e42aa509137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.286318 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412baeba-8f45-44c1-818f-4e42aa509137 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.301374 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412baeba-8f45-44c1-818f-4e42aa509137 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:44.308545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-412baeba-8f45-44c1-818f-4e42aa509137 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:18:44.310005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 119/236] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:44.316833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b3fed-ea38-4ba9-b6ff-9a4c417e555a None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.329800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b3fed-ea38-4ba9-b6ff-9a4c417e555a None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.340383 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c61d3-0f03-4965-923a-b44e5c79592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.341311 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c61d3-0f03-4965-923a-b44e5c79592e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.341762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c61d3-0f03-4965-923a-b44e5c79592e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.342201 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c61d3-0f03-4965-923a-b44e5c79592e admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.343166 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c61d3-0f03-4965-923a-b44e5c79592e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:44.343660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c61d3-0f03-4965-923a-b44e5c79592e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:44.345961 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c61d3-0f03-4965-923a-b44e5c79592e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:44.358327 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 118/237] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:44.365274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412baeba-8f45-44c1-818f-4e42aa509137 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.381358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412baeba-8f45-44c1-818f-4e42aa509137 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.390420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4469212-4fc3-4a84-8c32-5922b0b340ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.391717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4469212-4fc3-4a84-8c32-5922b0b340ef admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.392175 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4469212-4fc3-4a84-8c32-5922b0b340ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.392619 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4469212-4fc3-4a84-8c32-5922b0b340ef admin admin] PATH_INFO: `/v3/users/eab751ec05304288831f161a66704877` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.394127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4469212-4fc3-4a84-8c32-5922b0b340ef admin admin] RBAC: Authorizing `identity:get_user(user_id=eab751ec05304288831f161a66704877)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:44.396557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4469212-4fc3-4a84-8c32-5922b0b340ef admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:44.398494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 120/238] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/users/eab751ec05304288831f161a66704877 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:44.404858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c61d3-0f03-4965-923a-b44e5c79592e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.417540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c61d3-0f03-4965-923a-b44e5c79592e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.427851 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42fa41-31a5-4ddf-b0ce-153fa5d7080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.428739 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42fa41-31a5-4ddf-b0ce-153fa5d7080e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.429194 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42fa41-31a5-4ddf-b0ce-153fa5d7080e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.429640 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42fa41-31a5-4ddf-b0ce-153fa5d7080e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.443157 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42fa41-31a5-4ddf-b0ce-153fa5d7080e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:44.445164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42fa41-31a5-4ddf-b0ce-153fa5d7080e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:44.459363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 119/239] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:44.465475 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4469212-4fc3-4a84-8c32-5922b0b340ef admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.481281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4469212-4fc3-4a84-8c32-5922b0b340ef admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.486590 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37f30b-f497-4fda-9fae-e9dfd79a4628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.487698 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37f30b-f497-4fda-9fae-e9dfd79a4628 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.488171 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37f30b-f497-4fda-9fae-e9dfd79a4628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.488613 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37f30b-f497-4fda-9fae-e9dfd79a4628 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.491637 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37f30b-f497-4fda-9fae-e9dfd79a4628 admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:44.493879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37f30b-f497-4fda-9fae-e9dfd79a4628 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:44.495763 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 121/240] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:44.502214 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42fa41-31a5-4ddf-b0ce-153fa5d7080e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.511486 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42fa41-31a5-4ddf-b0ce-153fa5d7080e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.518831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d47ab-e305-43d0-ba96-67366d7d3329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.519691 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d47ab-e305-43d0-ba96-67366d7d3329 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.520145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d47ab-e305-43d0-ba96-67366d7d3329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.520615 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d47ab-e305-43d0-ba96-67366d7d3329 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.521635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d47ab-e305-43d0-ba96-67366d7d3329 admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=8dc4455f0ea9485aac8ec368a026004f, user.id=eab751ec05304288831f161a66704877) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:44.522116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d47ab-e305-43d0-ba96-67366d7d3329 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:44.524168 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d47ab-e305-43d0-ba96-67366d7d3329 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:44.535996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 120/241] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/role_assignments?user.id=eab751ec05304288831f161a66704877&scope.project.id=8dc4455f0ea9485aac8ec368a026004f&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:44.569724 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23071d86-9ab0-42bb-b005-97d3f0209dbf None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.570293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23071d86-9ab0-42bb-b005-97d3f0209dbf None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.570743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23071d86-9ab0-42bb-b005-97d3f0209dbf None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.572812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 122/242] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:44.579214 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1f444-e15b-4dc7-a529-e188deed5862 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.579506 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1f444-e15b-4dc7-a529-e188deed5862 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.579782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1f444-e15b-4dc7-a529-e188deed5862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.607755 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-f0a1f444-e15b-4dc7-a529-e188deed5862 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:44.608994 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f0a1f444-e15b-4dc7-a529-e188deed5862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:44.622420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 121/243] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:44.623964 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e755bc-d4c5-429c-b04a-879b8b3fc0a0 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.624354 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e755bc-d4c5-429c-b04a-879b8b3fc0a0 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.624738 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e755bc-d4c5-429c-b04a-879b8b3fc0a0 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.626756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 123/244] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:18:44.632938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0077b8a-7eb8-40e3-bb8e-53ea02cbaa4f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.633431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0077b8a-7eb8-40e3-bb8e-53ea02cbaa4f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.633875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0077b8a-7eb8-40e3-bb8e-53ea02cbaa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.655796 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-f0077b8a-7eb8-40e3-bb8e-53ea02cbaa4f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:44.657886 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f0077b8a-7eb8-40e3-bb8e-53ea02cbaa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:44.671114 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 122/245] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:44.681097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e755bc-d4c5-429c-b04a-879b8b3fc0a0 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.705162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e755bc-d4c5-429c-b04a-879b8b3fc0a0 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.708791 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0077b8a-7eb8-40e3-bb8e-53ea02cbaa4f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.713923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1952bb4-bb6c-4f82-8699-3861842a8f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.716290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1952bb4-bb6c-4f82-8699-3861842a8f21 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.717769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1952bb4-bb6c-4f82-8699-3861842a8f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.718269 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1952bb4-bb6c-4f82-8699-3861842a8f21 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.722077 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0077b8a-7eb8-40e3-bb8e-53ea02cbaa4f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.736295 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253232c-6800-45fa-b6ac-ea3e68313698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.737427 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253232c-6800-45fa-b6ac-ea3e68313698 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.737848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253232c-6800-45fa-b6ac-ea3e68313698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.738311 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253232c-6800-45fa-b6ac-ea3e68313698 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.741787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1952bb4-bb6c-4f82-8699-3861842a8f21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:44.756002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-d1952bb4-bb6c-4f82-8699-3861842a8f21 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:18:44.762894 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 124/246] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:44.767103 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253232c-6800-45fa-b6ac-ea3e68313698 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:44.774460 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-0253232c-6800-45fa-b6ac-ea3e68313698 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:18:44.776076 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 123/247] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/roles/reader => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:18:44.781484 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1952bb4-bb6c-4f82-8699-3861842a8f21 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.783421 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253232c-6800-45fa-b6ac-ea3e68313698 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.800462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253232c-6800-45fa-b6ac-ea3e68313698 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.803265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1952bb4-bb6c-4f82-8699-3861842a8f21 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.810558 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71305888-edac-42cd-8b25-7619c283a203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.811281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305888-edac-42cd-8b25-7619c283a203 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.811568 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305888-edac-42cd-8b25-7619c283a203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.811849 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305888-edac-42cd-8b25-7619c283a203 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.812647 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71305888-edac-42cd-8b25-7619c283a203 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:44.813516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974a21e-e4c5-4e31-b2e0-542c631a9b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.814184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974a21e-e4c5-4e31-b2e0-542c631a9b15 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.814464 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974a21e-e4c5-4e31-b2e0-542c631a9b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.814739 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974a21e-e4c5-4e31-b2e0-542c631a9b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.815544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974a21e-e4c5-4e31-b2e0-542c631a9b15 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:44.815853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974a21e-e4c5-4e31-b2e0-542c631a9b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:44.817489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974a21e-e4c5-4e31-b2e0-542c631a9b15 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:44.819191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71305888-edac-42cd-8b25-7619c283a203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:44.821145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71305888-edac-42cd-8b25-7619c283a203 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:44.832536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 125/249] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:44.832735 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 124/249] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:44.833394 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940ef8d-919a-41a0-bf5d-c111e7316872 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.833690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940ef8d-919a-41a0-bf5d-c111e7316872 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.833971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940ef8d-919a-41a0-bf5d-c111e7316872 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.835823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 126/250] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:44.837873 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71305888-edac-42cd-8b25-7619c283a203 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.844084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940ef8d-919a-41a0-bf5d-c111e7316872 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.850170 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71305888-edac-42cd-8b25-7619c283a203 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.855414 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44826bc6-04fd-4bde-9160-19573cd4d824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.856280 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44826bc6-04fd-4bde-9160-19573cd4d824 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.856562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44826bc6-04fd-4bde-9160-19573cd4d824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.856840 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44826bc6-04fd-4bde-9160-19573cd4d824 admin admin] PATH_INFO: `/v3/users/893216354d6c470f8531cf65b91ebad1` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.859752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940ef8d-919a-41a0-bf5d-c111e7316872 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.870650 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723b36c-aed1-44ae-90d3-88ce299f816f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.871894 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723b36c-aed1-44ae-90d3-88ce299f816f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.872364 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723b36c-aed1-44ae-90d3-88ce299f816f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.872715 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723b36c-aed1-44ae-90d3-88ce299f816f admin admin] PATH_INFO: `/v3/users/eab751ec05304288831f161a66704877` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.873399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44826bc6-04fd-4bde-9160-19573cd4d824 admin admin] RBAC: Authorizing `identity:get_user(user_id=893216354d6c470f8531cf65b91ebad1)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:44.873864 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723b36c-aed1-44ae-90d3-88ce299f816f admin admin] RBAC: Authorizing `identity:get_user(user_id=eab751ec05304288831f161a66704877)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:44.875591 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44826bc6-04fd-4bde-9160-19573cd4d824 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:44.876133 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723b36c-aed1-44ae-90d3-88ce299f816f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:44.877366 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 125/251] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/users/893216354d6c470f8531cf65b91ebad1 => generated 297 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:44.879478 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eea250-031a-4e8c-aeb8-fa1f48e0948f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.879766 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eea250-031a-4e8c-aeb8-fa1f48e0948f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.880049 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eea250-031a-4e8c-aeb8-fa1f48e0948f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.882546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 127/252] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/users/eab751ec05304288831f161a66704877 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:44.883676 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559759d-dcd4-4059-b017-9e160e0315d2 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.883960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559759d-dcd4-4059-b017-9e160e0315d2 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.884234 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559759d-dcd4-4059-b017-9e160e0315d2 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.885906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 128/253] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:44.886574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559759d-dcd4-4059-b017-9e160e0315d2 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.899898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-d0eea250-031a-4e8c-aeb8-fa1f48e0948f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:44.901082 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-d0eea250-031a-4e8c-aeb8-fa1f48e0948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:44.903101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559759d-dcd4-4059-b017-9e160e0315d2 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.908157 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193de81e-eeca-47bc-a5d3-0464f1d66e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.908795 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193de81e-eeca-47bc-a5d3-0464f1d66e67 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.909087 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193de81e-eeca-47bc-a5d3-0464f1d66e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.909347 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193de81e-eeca-47bc-a5d3-0464f1d66e67 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.909885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 126/254] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:44.914889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eea250-031a-4e8c-aeb8-fa1f48e0948f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.917498 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193de81e-eeca-47bc-a5d3-0464f1d66e67 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:44.919522 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193de81e-eeca-47bc-a5d3-0464f1d66e67 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:44.919775 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eea250-031a-4e8c-aeb8-fa1f48e0948f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.928430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 129/255] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:44.929178 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e552e-ecbb-4923-853e-79db10deb3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.929580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de696e2-df9f-4b54-a173-e482308a38ba None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.929865 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de696e2-df9f-4b54-a173-e482308a38ba None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.930140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de696e2-df9f-4b54-a173-e482308a38ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.930523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e552e-ecbb-4923-853e-79db10deb3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.930810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e552e-ecbb-4923-853e-79db10deb3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.931187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e552e-ecbb-4923-853e-79db10deb3a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.941363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e552e-ecbb-4923-853e-79db10deb3a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:44.943174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e552e-ecbb-4923-853e-79db10deb3a2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:44.950337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-2de696e2-df9f-4b54-a173-e482308a38ba None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:44.951543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2de696e2-df9f-4b54-a173-e482308a38ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:44.952771 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 127/256] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:44.953574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e552e-ecbb-4923-853e-79db10deb3a2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.959575 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 130/257] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:44.962911 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e552e-ecbb-4923-853e-79db10deb3a2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.963881 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de696e2-df9f-4b54-a173-e482308a38ba None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.967349 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec27411-fb84-48c3-8baa-c6b15d86b7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.968103 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec27411-fb84-48c3-8baa-c6b15d86b7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.968389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec27411-fb84-48c3-8baa-c6b15d86b7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.968668 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec27411-fb84-48c3-8baa-c6b15d86b7c7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.973813 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de696e2-df9f-4b54-a173-e482308a38ba None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.978058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360daa8-45ee-4624-954d-21003a55d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.978945 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360daa8-45ee-4624-954d-21003a55d439 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:44.979235 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360daa8-45ee-4624-954d-21003a55d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:44.979504 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360daa8-45ee-4624-954d-21003a55d439 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:44.980316 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec27411-fb84-48c3-8baa-c6b15d86b7c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:44.980667 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360daa8-45ee-4624-954d-21003a55d439 admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:44.982675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360daa8-45ee-4624-954d-21003a55d439 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:44.984670 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 131/258] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:44.985461 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360daa8-45ee-4624-954d-21003a55d439 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.987675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-bec27411-fb84-48c3-8baa-c6b15d86b7c7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:18:44.988955 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 128/259] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:44.989763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec27411-fb84-48c3-8baa-c6b15d86b7c7 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:44.994818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360daa8-45ee-4624-954d-21003a55d439 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:44.998989 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2daca9-9016-4bd4-85dc-94cf4600cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:44.999786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2daca9-9016-4bd4-85dc-94cf4600cac6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:45.000068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2daca9-9016-4bd4-85dc-94cf4600cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:45.000342 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2daca9-9016-4bd4-85dc-94cf4600cac6 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:45.001521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2daca9-9016-4bd4-85dc-94cf4600cac6 admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:45.003521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2daca9-9016-4bd4-85dc-94cf4600cac6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:45.003626 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec27411-fb84-48c3-8baa-c6b15d86b7c7 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:45.005117 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 132/260] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:45.005898 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2daca9-9016-4bd4-85dc-94cf4600cac6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:45.008063 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8e381-ca9a-4ca9-b187-7070c32dde06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:45.008789 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8e381-ca9a-4ca9-b187-7070c32dde06 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:45.009075 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8e381-ca9a-4ca9-b187-7070c32dde06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:45.009361 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8e381-ca9a-4ca9-b187-7070c32dde06 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:45.010746 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8e381-ca9a-4ca9-b187-7070c32dde06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:45.012487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8e381-ca9a-4ca9-b187-7070c32dde06 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:45.014047 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 129/261] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:45.014780 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8e381-ca9a-4ca9-b187-7070c32dde06 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:45.014966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2daca9-9016-4bd4-85dc-94cf4600cac6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:45.019702 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21824b5-aeb8-4750-8e47-cfd3436e44e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:45.020299 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21824b5-aeb8-4750-8e47-cfd3436e44e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:45.020578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21824b5-aeb8-4750-8e47-cfd3436e44e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:45.020847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21824b5-aeb8-4750-8e47-cfd3436e44e9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:45.021660 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21824b5-aeb8-4750-8e47-cfd3436e44e9 admin admin] RBAC: Adding query filter params (role.id=726ace838f324527844cb0c0a21a0fbf, scope.project.id=8dc4455f0ea9485aac8ec368a026004f, user.id=893216354d6c470f8531cf65b91ebad1) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:45.021965 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21824b5-aeb8-4750-8e47-cfd3436e44e9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:45.023748 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21824b5-aeb8-4750-8e47-cfd3436e44e9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:45.025315 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8e381-ca9a-4ca9-b187-7070c32dde06 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:45.029261 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 133/262] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:45 2021] GET /identity/v3/role_assignments?user.id=893216354d6c470f8531cf65b91ebad1&scope.project.id=8dc4455f0ea9485aac8ec368a026004f&role.id=726ace838f324527844cb0c0a21a0fbf => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:45.029723 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4779c0a-3a2c-4106-814a-7cd51dee1b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:45.030011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21824b5-aeb8-4750-8e47-cfd3436e44e9 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:45.030325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4779c0a-3a2c-4106-814a-7cd51dee1b4f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:45.030610 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4779c0a-3a2c-4106-814a-7cd51dee1b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:45.030935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4779c0a-3a2c-4106-814a-7cd51dee1b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:45.031681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4779c0a-3a2c-4106-814a-7cd51dee1b4f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:45.031991 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4779c0a-3a2c-4106-814a-7cd51dee1b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:45.034153 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4779c0a-3a2c-4106-814a-7cd51dee1b4f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:45.043263 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 130/263] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:45 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:45.044379 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4779c0a-3a2c-4106-814a-7cd51dee1b4f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:45.045019 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21824b5-aeb8-4750-8e47-cfd3436e44e9 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:45.049658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d27f8-793c-4809-b47b-8a1478819bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:45.050508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d27f8-793c-4809-b47b-8a1478819bef admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:45.050790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d27f8-793c-4809-b47b-8a1478819bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:45.051102 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d27f8-793c-4809-b47b-8a1478819bef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:45.052089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d27f8-793c-4809-b47b-8a1478819bef admin admin] RBAC: Adding query filter params (role.id=f4edd7aabe7e416f95ab6833aa478f07, scope.project.id=8dc4455f0ea9485aac8ec368a026004f, user.id=eab751ec05304288831f161a66704877) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:45.052355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d27f8-793c-4809-b47b-8a1478819bef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:45.054220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d27f8-793c-4809-b47b-8a1478819bef admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:45.054483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4779c0a-3a2c-4106-814a-7cd51dee1b4f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:45.060121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d941702-f9d7-43ef-9f95-e8a2f36b1850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:45.060804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941702-f9d7-43ef-9f95-e8a2f36b1850 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:45.061088 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941702-f9d7-43ef-9f95-e8a2f36b1850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:45.061328 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 134/264] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:45 2021] GET /identity/v3/role_assignments?user.id=eab751ec05304288831f161a66704877&scope.project.id=8dc4455f0ea9485aac8ec368a026004f&role.id=f4edd7aabe7e416f95ab6833aa478f07 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:45.061698 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941702-f9d7-43ef-9f95-e8a2f36b1850 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:45.062298 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d27f8-793c-4809-b47b-8a1478819bef admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:45.062499 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d941702-f9d7-43ef-9f95-e8a2f36b1850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:45.065172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d941702-f9d7-43ef-9f95-e8a2f36b1850 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:45.082075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d27f8-793c-4809-b47b-8a1478819bef admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:45.091266 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d392e7-39f8-42e4-a49c-804e7dfedc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:45.092168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d392e7-39f8-42e4-a49c-804e7dfedc74 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:45.092439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d392e7-39f8-42e4-a49c-804e7dfedc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:45.092714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d392e7-39f8-42e4-a49c-804e7dfedc74 admin admin] PATH_INFO: `/v3/users/d0a1f9fb3d6943c88bbfe7c8c555fcb3` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:45.096901 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 131/265] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:18:45 2021] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:18:45.097663 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d392e7-39f8-42e4-a49c-804e7dfedc74 admin admin] RBAC: Authorizing `identity:get_user(user_id=d0a1f9fb3d6943c88bbfe7c8c555fcb3)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:45.100035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d392e7-39f8-42e4-a49c-804e7dfedc74 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:45.102078 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 135/266] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:45 2021] GET /identity/v3/users/d0a1f9fb3d6943c88bbfe7c8c555fcb3 => generated 297 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:45.111125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d941702-f9d7-43ef-9f95-e8a2f36b1850 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:45.122283 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d941702-f9d7-43ef-9f95-e8a2f36b1850 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:45.127970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98e5cb-fcde-4c0c-b773-b2f4109e2e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:45.128934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e5cb-fcde-4c0c-b773-b2f4109e2e27 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:45.129219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e5cb-fcde-4c0c-b773-b2f4109e2e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:45.129503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e5cb-fcde-4c0c-b773-b2f4109e2e27 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:45.131213 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98e5cb-fcde-4c0c-b773-b2f4109e2e27 admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:45.133651 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98e5cb-fcde-4c0c-b773-b2f4109e2e27 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:45.136022 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 132/267] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:45 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:45.143473 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d392e7-39f8-42e4-a49c-804e7dfedc74 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:45.154661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d392e7-39f8-42e4-a49c-804e7dfedc74 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:45.159930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ade518-23f2-47e0-bf5f-d1a6b1bc7719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:45.160920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade518-23f2-47e0-bf5f-d1a6b1bc7719 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:45.161207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade518-23f2-47e0-bf5f-d1a6b1bc7719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:45.161586 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade518-23f2-47e0-bf5f-d1a6b1bc7719 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f/users/d0a1f9fb3d6943c88bbfe7c8c555fcb3/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:45.164221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ade518-23f2-47e0-bf5f-d1a6b1bc7719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc4455f0ea9485aac8ec368a026004f, user_id=d0a1f9fb3d6943c88bbfe7c8c555fcb3, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:45.167275 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ade518-23f2-47e0-bf5f-d1a6b1bc7719 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:45.184798 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 136/268] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:18:45 2021] PUT /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f/users/d0a1f9fb3d6943c88bbfe7c8c555fcb3/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:18:47.449544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ff9e-37ed-4f73-b32d-0adb8bf88042 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.450083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ff9e-37ed-4f73-b32d-0adb8bf88042 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.450083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ff9e-37ed-4f73-b32d-0adb8bf88042 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.451916 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 133/269] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:47.457758 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a901bc-2565-43b0-981e-89cb1e4be36d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.458161 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a901bc-2565-43b0-981e-89cb1e4be36d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.458347 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a901bc-2565-43b0-981e-89cb1e4be36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.477004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-71a901bc-2565-43b0-981e-89cb1e4be36d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:47.478178 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-71a901bc-2565-43b0-981e-89cb1e4be36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:47.540699 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 137/270] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:47.564652 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427ff9e-37ed-4f73-b32d-0adb8bf88042 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.576490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427ff9e-37ed-4f73-b32d-0adb8bf88042 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.580982 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfca4c-ce26-4638-a6fe-6c5919e836fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.581752 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfca4c-ce26-4638-a6fe-6c5919e836fe admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.582033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfca4c-ce26-4638-a6fe-6c5919e836fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.582309 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfca4c-ce26-4638-a6fe-6c5919e836fe admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.592996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfca4c-ce26-4638-a6fe-6c5919e836fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:47.600505 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-07cfca4c-ce26-4638-a6fe-6c5919e836fe admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:18:47.601714 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 134/271] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:47 2021] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:47.606037 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68423a53-8443-48a2-9dca-f3fb0deb8972 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.606429 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68423a53-8443-48a2-9dca-f3fb0deb8972 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.607150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68423a53-8443-48a2-9dca-f3fb0deb8972 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.607788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfca4c-ce26-4638-a6fe-6c5919e836fe admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.609372 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 138/272] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:47.614220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df08291-4409-49b7-b134-97f40cb87b8d None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.614513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df08291-4409-49b7-b134-97f40cb87b8d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.614797 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df08291-4409-49b7-b134-97f40cb87b8d None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.616583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 139/273] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:47.618969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714bb91-d15a-4d29-b783-a672a5e4ebdc None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.619468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714bb91-d15a-4d29-b783-a672a5e4ebdc None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.620116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714bb91-d15a-4d29-b783-a672a5e4ebdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.622366 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfca4c-ce26-4638-a6fe-6c5919e836fe admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.626575 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938edeb-982a-4b29-8b88-81f5eb4599ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.627320 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938edeb-982a-4b29-8b88-81f5eb4599ba admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.627601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938edeb-982a-4b29-8b88-81f5eb4599ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.627879 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938edeb-982a-4b29-8b88-81f5eb4599ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.628642 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938edeb-982a-4b29-8b88-81f5eb4599ba admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:47.628946 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938edeb-982a-4b29-8b88-81f5eb4599ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:47.630538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938edeb-982a-4b29-8b88-81f5eb4599ba admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:47.638554 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b714bb91-d15a-4d29-b783-a672a5e4ebdc None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:47.639576 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 135/274] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:47 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:47.639760 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b714bb91-d15a-4d29-b783-a672a5e4ebdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:47.640573 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44b612-2830-4637-8994-5db9e0b8f17d None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.646424 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44b612-2830-4637-8994-5db9e0b8f17d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.646722 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44b612-2830-4637-8994-5db9e0b8f17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.648281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 140/275] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:47.652041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714bb91-d15a-4d29-b783-a672a5e4ebdc None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.666133 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714bb91-d15a-4d29-b783-a672a5e4ebdc None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.670436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-fa44b612-2830-4637-8994-5db9e0b8f17d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:47.671515 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ede119-d41d-48f4-bf91-87d81c8d6173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.671758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-fa44b612-2830-4637-8994-5db9e0b8f17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:47.672830 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ede119-d41d-48f4-bf91-87d81c8d6173 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.673303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ede119-d41d-48f4-bf91-87d81c8d6173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.673685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ede119-d41d-48f4-bf91-87d81c8d6173 admin admin] PATH_INFO: `/v3/users/893216354d6c470f8531cf65b91ebad1` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.675077 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ede119-d41d-48f4-bf91-87d81c8d6173 admin admin] RBAC: Authorizing `identity:get_user(user_id=893216354d6c470f8531cf65b91ebad1)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:47.677274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ede119-d41d-48f4-bf91-87d81c8d6173 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:47.678938 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 141/276] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:47 2021] GET /identity/v3/users/893216354d6c470f8531cf65b91ebad1 => generated 297 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:47.679717 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 136/277] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:47.680831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127783f6-e53d-4e16-8533-483b98cc32bb None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.681114 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127783f6-e53d-4e16-8533-483b98cc32bb None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.681387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127783f6-e53d-4e16-8533-483b98cc32bb None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.683175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 137/278] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:47.683452 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ede119-d41d-48f4-bf91-87d81c8d6173 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.684763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127783f6-e53d-4e16-8533-483b98cc32bb None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.695241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ede119-d41d-48f4-bf91-87d81c8d6173 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.696843 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127783f6-e53d-4e16-8533-483b98cc32bb None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.699406 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d4359-e093-4935-88a0-6ef10ffbcffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.700227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d4359-e093-4935-88a0-6ef10ffbcffe admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.700496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d4359-e093-4935-88a0-6ef10ffbcffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.700725 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d4359-e093-4935-88a0-6ef10ffbcffe admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.701008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ec9d-715e-44ac-a59e-2cacfac3abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.701832 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ec9d-715e-44ac-a59e-2cacfac3abd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.702114 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ec9d-715e-44ac-a59e-2cacfac3abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.702392 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ec9d-715e-44ac-a59e-2cacfac3abd2 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.703597 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148ec9d-715e-44ac-a59e-2cacfac3abd2 admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:47.706236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148ec9d-715e-44ac-a59e-2cacfac3abd2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:47.707939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 138/279] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:47 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:47.710074 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38de5-7b54-4282-97a3-795f06ece49e None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.710366 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38de5-7b54-4282-97a3-795f06ece49e None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.710645 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38de5-7b54-4282-97a3-795f06ece49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.711644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d4359-e093-4935-88a0-6ef10ffbcffe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:47.718440 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-948d4359-e093-4935-88a0-6ef10ffbcffe admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:18:47.719615 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 142/280] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:47 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:47.720961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d4359-e093-4935-88a0-6ef10ffbcffe admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.728603 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a3a38de5-7b54-4282-97a3-795f06ece49e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:47.729778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a3a38de5-7b54-4282-97a3-795f06ece49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:47.730430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d4359-e093-4935-88a0-6ef10ffbcffe admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.734534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf7d6b-56d9-4775-b29e-bfd40d169e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.735261 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf7d6b-56d9-4775-b29e-bfd40d169e60 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.735608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf7d6b-56d9-4775-b29e-bfd40d169e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.735835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf7d6b-56d9-4775-b29e-bfd40d169e60 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.737217 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 139/281] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:47.737994 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a38de5-7b54-4282-97a3-795f06ece49e None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.745873 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf7d6b-56d9-4775-b29e-bfd40d169e60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:47.746865 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a38de5-7b54-4282-97a3-795f06ece49e None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.751136 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349ff58-9323-414b-84d0-404d0addabc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.752033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349ff58-9323-414b-84d0-404d0addabc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.752345 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349ff58-9323-414b-84d0-404d0addabc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.752621 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349ff58-9323-414b-84d0-404d0addabc0 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f/users/893216354d6c470f8531cf65b91ebad1/roles/726ace838f324527844cb0c0a21a0fbf` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.752761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-3ecf7d6b-56d9-4775-b29e-bfd40d169e60 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:18:47.753891 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 143/282] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:47 2021] GET /identity/v3/roles/member => generated 84 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:47.754755 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349ff58-9323-414b-84d0-404d0addabc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc4455f0ea9485aac8ec368a026004f, user_id=893216354d6c470f8531cf65b91ebad1, role_id=726ace838f324527844cb0c0a21a0fbf)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:47.757613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349ff58-9323-414b-84d0-404d0addabc0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:47.759884 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf7d6b-56d9-4775-b29e-bfd40d169e60 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.770527 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf7d6b-56d9-4775-b29e-bfd40d169e60 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.771682 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 140/283] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:18:47 2021] PUT /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f/users/893216354d6c470f8531cf65b91ebad1/roles/726ace838f324527844cb0c0a21a0fbf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:18:47.772507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349ff58-9323-414b-84d0-404d0addabc0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.831819 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecedbc9-2593-447d-b0ec-8a64795d7975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.832662 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecedbc9-2593-447d-b0ec-8a64795d7975 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.833012 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecedbc9-2593-447d-b0ec-8a64795d7975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.833374 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecedbc9-2593-447d-b0ec-8a64795d7975 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.835360 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecedbc9-2593-447d-b0ec-8a64795d7975 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:47.835745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecedbc9-2593-447d-b0ec-8a64795d7975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:47.837604 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecedbc9-2593-447d-b0ec-8a64795d7975 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:47.844862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349ff58-9323-414b-84d0-404d0addabc0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.848313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 144/284] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:47.850135 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27614b82-6dde-4e19-9156-8badf52d9f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.850812 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27614b82-6dde-4e19-9156-8badf52d9f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.851150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27614b82-6dde-4e19-9156-8badf52d9f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.851426 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27614b82-6dde-4e19-9156-8badf52d9f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.852203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27614b82-6dde-4e19-9156-8badf52d9f68 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:47.852508 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27614b82-6dde-4e19-9156-8badf52d9f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:47.853963 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecedbc9-2593-447d-b0ec-8a64795d7975 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.854422 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27614b82-6dde-4e19-9156-8badf52d9f68 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:47.869581 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 141/285] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:47.869805 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecedbc9-2593-447d-b0ec-8a64795d7975 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.869903 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27614b82-6dde-4e19-9156-8badf52d9f68 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.880323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae38a2-48ea-4ccf-8802-ef9a90c54faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.881143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae38a2-48ea-4ccf-8802-ef9a90c54faf admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.881470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae38a2-48ea-4ccf-8802-ef9a90c54faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.881768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae38a2-48ea-4ccf-8802-ef9a90c54faf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.883027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae38a2-48ea-4ccf-8802-ef9a90c54faf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:47.883152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27614b82-6dde-4e19-9156-8badf52d9f68 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.884750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae38a2-48ea-4ccf-8802-ef9a90c54faf admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:47.886534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 145/286] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:47.887664 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82741b-93ed-4c74-a813-63d99c7b56f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.888538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82741b-93ed-4c74-a813-63d99c7b56f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.888838 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82741b-93ed-4c74-a813-63d99c7b56f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.889088 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82741b-93ed-4c74-a813-63d99c7b56f1 admin admin] PATH_INFO: `/v3/users/15ab543211d94ee7b4706e907a936cdc` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.893986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae38a2-48ea-4ccf-8802-ef9a90c54faf admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.906400 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82741b-93ed-4c74-a813-63d99c7b56f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=15ab543211d94ee7b4706e907a936cdc)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:47.909142 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae38a2-48ea-4ccf-8802-ef9a90c54faf admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.909396 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82741b-93ed-4c74-a813-63d99c7b56f1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:47.911514 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 142/287] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:47 2021] GET /identity/v3/users/15ab543211d94ee7b4706e907a936cdc => generated 293 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:47.912082 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82741b-93ed-4c74-a813-63d99c7b56f1 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.919963 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55fa1a-7f67-4aef-acfd-34706c44c52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.920882 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55fa1a-7f67-4aef-acfd-34706c44c52c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.921235 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55fa1a-7f67-4aef-acfd-34706c44c52c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.921516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55fa1a-7f67-4aef-acfd-34706c44c52c admin admin] PATH_INFO: `/v3/users/d0a1f9fb3d6943c88bbfe7c8c555fcb3` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.923120 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82741b-93ed-4c74-a813-63d99c7b56f1 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.923578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55fa1a-7f67-4aef-acfd-34706c44c52c admin admin] RBAC: Authorizing `identity:get_user(user_id=d0a1f9fb3d6943c88bbfe7c8c555fcb3)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:47.926640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55fa1a-7f67-4aef-acfd-34706c44c52c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:47.928266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9d5c7-6536-47f3-83ae-74e6bdb78685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.934130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 146/288] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:47 2021] GET /identity/v3/users/d0a1f9fb3d6943c88bbfe7c8c555fcb3 => generated 297 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:47.934532 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9d5c7-6536-47f3-83ae-74e6bdb78685 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.934711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55fa1a-7f67-4aef-acfd-34706c44c52c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.934901 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9d5c7-6536-47f3-83ae-74e6bdb78685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.934901 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9d5c7-6536-47f3-83ae-74e6bdb78685 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.934901 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9d5c7-6536-47f3-83ae-74e6bdb78685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:47.935894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9d5c7-6536-47f3-83ae-74e6bdb78685 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:47.945104 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55fa1a-7f67-4aef-acfd-34706c44c52c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.951734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835ea6-925f-49fc-ab97-830ae3590f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.952470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835ea6-925f-49fc-ab97-830ae3590f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.952876 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835ea6-925f-49fc-ab97-830ae3590f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.953269 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835ea6-925f-49fc-ab97-830ae3590f1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.954753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835ea6-925f-49fc-ab97-830ae3590f1f admin admin] RBAC: Adding query filter params (role.id=e734a22c1b2c40feb0147271d002bdee, user.id=15ab543211d94ee7b4706e907a936cdc, scope.system=all) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:47.955167 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835ea6-925f-49fc-ab97-830ae3590f1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:47.957484 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835ea6-925f-49fc-ab97-830ae3590f1f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:47.965079 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 143/289] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:18:47 2021] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:18:47.965331 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9d5c7-6536-47f3-83ae-74e6bdb78685 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:47.976984 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9d5c7-6536-47f3-83ae-74e6bdb78685 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:47.981681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dae0b-fb1c-40ac-822b-4a1649755f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:47.981883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 147/290] 10.222.0.60 () {56 vars in 1329 bytes} [Wed Dec 15 13:18:47 2021] GET /identity/v3/role_assignments?user.id=15ab543211d94ee7b4706e907a936cdc&scope.system=all&role.id=e734a22c1b2c40feb0147271d002bdee => generated 226 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:47.982726 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dae0b-fb1c-40ac-822b-4a1649755f8b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:47.983104 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dae0b-fb1c-40ac-822b-4a1649755f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:47.983441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dae0b-fb1c-40ac-822b-4a1649755f8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:47.999532 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27dae0b-fb1c-40ac-822b-4a1649755f8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:48.001676 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27dae0b-fb1c-40ac-822b-4a1649755f8b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:48.012630 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 144/291] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:48.020054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835ea6-925f-49fc-ab97-830ae3590f1f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:48.033368 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835ea6-925f-49fc-ab97-830ae3590f1f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:48.043666 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3072668-e80b-4fde-afee-4fd6efceb03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:48.044855 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3072668-e80b-4fde-afee-4fd6efceb03e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:48.045136 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3072668-e80b-4fde-afee-4fd6efceb03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:48.045412 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3072668-e80b-4fde-afee-4fd6efceb03e admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:48.046920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3072668-e80b-4fde-afee-4fd6efceb03e admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:48.049209 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3072668-e80b-4fde-afee-4fd6efceb03e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:48.051178 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 148/292] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:48 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:48.058017 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dae0b-fb1c-40ac-822b-4a1649755f8b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:48.068237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dae0b-fb1c-40ac-822b-4a1649755f8b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:48.073037 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90ab97-9828-4e0a-a395-bfc582bcf2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:48.073702 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90ab97-9828-4e0a-a395-bfc582bcf2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:48.073985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90ab97-9828-4e0a-a395-bfc582bcf2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:48.074262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90ab97-9828-4e0a-a395-bfc582bcf2a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:48.075248 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90ab97-9828-4e0a-a395-bfc582bcf2a0 admin admin] RBAC: Adding query filter params (role.id=e734a22c1b2c40feb0147271d002bdee, scope.project.id=8dc4455f0ea9485aac8ec368a026004f, user.id=d0a1f9fb3d6943c88bbfe7c8c555fcb3) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:48.075623 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90ab97-9828-4e0a-a395-bfc582bcf2a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:48.077659 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90ab97-9828-4e0a-a395-bfc582bcf2a0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:48.085761 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 145/293] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:48 2021] GET /identity/v3/role_assignments?user.id=d0a1f9fb3d6943c88bbfe7c8c555fcb3&scope.project.id=8dc4455f0ea9485aac8ec368a026004f&role.id=e734a22c1b2c40feb0147271d002bdee => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:50.267886 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e11b61-3a12-4f79-a2f2-e25b1632a6d0 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.268405 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e11b61-3a12-4f79-a2f2-e25b1632a6d0 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.268482 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e11b61-3a12-4f79-a2f2-e25b1632a6d0 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.270460 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 149/294] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:50.278472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c673a3-4394-4dbc-b992-cc88c41b7d83 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.278472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c673a3-4394-4dbc-b992-cc88c41b7d83 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.278472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c673a3-4394-4dbc-b992-cc88c41b7d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.296464 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-05c673a3-4394-4dbc-b992-cc88c41b7d83 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:50.297843 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-05c673a3-4394-4dbc-b992-cc88c41b7d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:50.306146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 146/295] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:50.330891 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e11b61-3a12-4f79-a2f2-e25b1632a6d0 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.343439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e11b61-3a12-4f79-a2f2-e25b1632a6d0 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.348451 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a1d22-815c-4d5d-8099-596cbbcd654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.349396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a1d22-815c-4d5d-8099-596cbbcd654e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.349850 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a1d22-815c-4d5d-8099-596cbbcd654e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.350267 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a1d22-815c-4d5d-8099-596cbbcd654e admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.361713 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a1d22-815c-4d5d-8099-596cbbcd654e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:50.368776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-502a1d22-815c-4d5d-8099-596cbbcd654e admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:18:50.374940 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 150/296] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:50 2021] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:50.376869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c673a3-4394-4dbc-b992-cc88c41b7d83 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.386135 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c673a3-4394-4dbc-b992-cc88c41b7d83 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.390709 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a814ecc-52b2-45b0-b468-4181be1d365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.391548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814ecc-52b2-45b0-b468-4181be1d365d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.391997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814ecc-52b2-45b0-b468-4181be1d365d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.392508 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814ecc-52b2-45b0-b468-4181be1d365d admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.393417 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a814ecc-52b2-45b0-b468-4181be1d365d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:50.393867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a814ecc-52b2-45b0-b468-4181be1d365d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:50.395658 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a814ecc-52b2-45b0-b468-4181be1d365d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:50.404446 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 147/297] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:50 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:50.411210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a814ecc-52b2-45b0-b468-4181be1d365d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.412147 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465457b1-050c-450e-a027-1d6d5b0eba0f None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.412582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465457b1-050c-450e-a027-1d6d5b0eba0f None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.413003 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465457b1-050c-450e-a027-1d6d5b0eba0f None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.415186 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 151/298] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:50.422137 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e7766-ec7a-421c-92de-8c33b9b27f25 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.422517 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e7766-ec7a-421c-92de-8c33b9b27f25 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.422799 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e7766-ec7a-421c-92de-8c33b9b27f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.425300 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a814ecc-52b2-45b0-b468-4181be1d365d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.429872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1cccb-b927-464a-8cd1-70839dd877a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.430958 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1cccb-b927-464a-8cd1-70839dd877a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.431385 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1cccb-b927-464a-8cd1-70839dd877a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.431821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1cccb-b927-464a-8cd1-70839dd877a0 admin admin] PATH_INFO: `/v3/users/893216354d6c470f8531cf65b91ebad1` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.433191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1cccb-b927-464a-8cd1-70839dd877a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=893216354d6c470f8531cf65b91ebad1)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:50.435495 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1cccb-b927-464a-8cd1-70839dd877a0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:50.437564 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 148/299] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:50 2021] GET /identity/v3/users/893216354d6c470f8531cf65b91ebad1 => generated 297 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:50.443668 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1cccb-b927-464a-8cd1-70839dd877a0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.443957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-cd3e7766-ec7a-421c-92de-8c33b9b27f25 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:50.445303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-cd3e7766-ec7a-421c-92de-8c33b9b27f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:50.453413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 152/300] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:50.458954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1cccb-b927-464a-8cd1-70839dd877a0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.462468 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9ddcd-2b26-4644-9e61-c3c7c725d78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.463302 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9ddcd-2b26-4644-9e61-c3c7c725d78a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.463733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9ddcd-2b26-4644-9e61-c3c7c725d78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.464155 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9ddcd-2b26-4644-9e61-c3c7c725d78a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.473353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9ddcd-2b26-4644-9e61-c3c7c725d78a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:50.475342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9ddcd-2b26-4644-9e61-c3c7c725d78a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:50.483937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e7766-ec7a-421c-92de-8c33b9b27f25 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.490939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 149/301] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:18:50.492310 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9ddcd-2b26-4644-9e61-c3c7c725d78a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.494178 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e7766-ec7a-421c-92de-8c33b9b27f25 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.500673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb554a-c0fa-462d-81b3-6e3ee6435152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.501578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb554a-c0fa-462d-81b3-6e3ee6435152 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.501934 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb554a-c0fa-462d-81b3-6e3ee6435152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.502280 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb554a-c0fa-462d-81b3-6e3ee6435152 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.503238 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9ddcd-2b26-4644-9e61-c3c7c725d78a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.507774 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0ce0f-d8e4-40de-ad1a-f02d6993e302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.508960 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0ce0f-d8e4-40de-ad1a-f02d6993e302 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.509386 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0ce0f-d8e4-40de-ad1a-f02d6993e302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.509821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0ce0f-d8e4-40de-ad1a-f02d6993e302 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.511190 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0ce0f-d8e4-40de-ad1a-f02d6993e302 admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:50.513443 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0ce0f-d8e4-40de-ad1a-f02d6993e302 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:50.513717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb554a-c0fa-462d-81b3-6e3ee6435152 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:50.515451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 150/302] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:50 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:50.521432 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-3bdb554a-c0fa-462d-81b3-6e3ee6435152 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:18:50.522407 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0ce0f-d8e4-40de-ad1a-f02d6993e302 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.527581 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 153/303] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:18:50.529628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb554a-c0fa-462d-81b3-6e3ee6435152 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.533449 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0ce0f-d8e4-40de-ad1a-f02d6993e302 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.537953 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d9c16-945f-4079-936d-adfacdcd2e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.538772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d9c16-945f-4079-936d-adfacdcd2e7d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.539215 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d9c16-945f-4079-936d-adfacdcd2e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.539634 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d9c16-945f-4079-936d-adfacdcd2e7d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.540460 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb554a-c0fa-462d-81b3-6e3ee6435152 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.540797 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d9c16-945f-4079-936d-adfacdcd2e7d admin admin] RBAC: Adding query filter params (role.id=726ace838f324527844cb0c0a21a0fbf, scope.project.id=8dc4455f0ea9485aac8ec368a026004f, user.id=893216354d6c470f8531cf65b91ebad1) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:50.541358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d9c16-945f-4079-936d-adfacdcd2e7d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:50.543981 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d9c16-945f-4079-936d-adfacdcd2e7d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:50.545429 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b8fe8-9e1a-479d-b37d-f609a787f4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.546153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8fe8-9e1a-479d-b37d-f609a787f4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.546505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8fe8-9e1a-479d-b37d-f609a787f4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.547068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8fe8-9e1a-479d-b37d-f609a787f4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.547929 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b8fe8-9e1a-479d-b37d-f609a787f4d1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:50.549352 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b8fe8-9e1a-479d-b37d-f609a787f4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:50.551363 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b8fe8-9e1a-479d-b37d-f609a787f4d1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:50.552500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 151/304] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:18:50 2021] GET /identity/v3/role_assignments?user.id=893216354d6c470f8531cf65b91ebad1&scope.project.id=8dc4455f0ea9485aac8ec368a026004f&role.id=726ace838f324527844cb0c0a21a0fbf => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:50.561217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 154/305] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:50.567328 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b8fe8-9e1a-479d-b37d-f609a787f4d1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.567728 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e90047-051e-4f3c-83ca-8696c6b11722 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.568263 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e90047-051e-4f3c-83ca-8696c6b11722 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.568790 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e90047-051e-4f3c-83ca-8696c6b11722 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.571173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 152/306] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:50.579101 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c5588-3f9a-4565-9bd4-89fa7e5b4ec1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.579691 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c5588-3f9a-4565-9bd4-89fa7e5b4ec1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.580005 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c5588-3f9a-4565-9bd4-89fa7e5b4ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.581262 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b8fe8-9e1a-479d-b37d-f609a787f4d1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.586550 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7dd768-7a5b-489b-9eaa-fd3c43f2f897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.587705 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dd768-7a5b-489b-9eaa-fd3c43f2f897 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.588132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dd768-7a5b-489b-9eaa-fd3c43f2f897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.588550 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dd768-7a5b-489b-9eaa-fd3c43f2f897 admin admin] PATH_INFO: `/v3/users/15ab543211d94ee7b4706e907a936cdc` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.590127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7dd768-7a5b-489b-9eaa-fd3c43f2f897 admin admin] RBAC: Authorizing `identity:get_user(user_id=15ab543211d94ee7b4706e907a936cdc)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:50.592351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7dd768-7a5b-489b-9eaa-fd3c43f2f897 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:50.594246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 155/307] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:50 2021] GET /identity/v3/users/15ab543211d94ee7b4706e907a936cdc => generated 293 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:50.596053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d7834-7114-47f3-9722-1bfdeb5fb689 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.596339 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d7834-7114-47f3-9722-1bfdeb5fb689 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.596625 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d7834-7114-47f3-9722-1bfdeb5fb689 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.598506 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 156/308] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:50.604107 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d7834-7114-47f3-9722-1bfdeb5fb689 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.604492 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-f45c5588-3f9a-4565-9bd4-89fa7e5b4ec1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:50.605827 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f45c5588-3f9a-4565-9bd4-89fa7e5b4ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:50.614119 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 153/309] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:50.616348 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac72e0-d304-4c45-a542-730b48535568 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.616787 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac72e0-d304-4c45-a542-730b48535568 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.617279 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac72e0-d304-4c45-a542-730b48535568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.617569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d7834-7114-47f3-9722-1bfdeb5fb689 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.622672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d189d-f000-4b88-bfb6-49da2c0dc2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.623701 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d189d-f000-4b88-bfb6-49da2c0dc2db admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.623982 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d189d-f000-4b88-bfb6-49da2c0dc2db admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.624261 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d189d-f000-4b88-bfb6-49da2c0dc2db admin admin] PATH_INFO: `/v3/system/users/15ab543211d94ee7b4706e907a936cdc/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.626969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d189d-f000-4b88-bfb6-49da2c0dc2db admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=15ab543211d94ee7b4706e907a936cdc, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:50.632691 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-ee6d189d-f000-4b88-bfb6-49da2c0dc2db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:50.632691 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:18:50.632691 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:18:50.633891 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d189d-f000-4b88-bfb6-49da2c0dc2db admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:50.638728 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-90ac72e0-d304-4c45-a542-730b48535568 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:50.640067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-90ac72e0-d304-4c45-a542-730b48535568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:50.653069 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 157/310] 10.222.0.60 () {58 vars in 1355 bytes} [Wed Dec 15 13:18:50 2021] PUT /identity/v3/system/users/15ab543211d94ee7b4706e907a936cdc/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:18:50.653069 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d189d-f000-4b88-bfb6-49da2c0dc2db admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.654134 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 154/311] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:50.666001 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d189d-f000-4b88-bfb6-49da2c0dc2db admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.671435 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfc041-a864-4a60-b06e-2c3fbcb9836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.672316 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc041-a864-4a60-b06e-2c3fbcb9836e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.672607 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc041-a864-4a60-b06e-2c3fbcb9836e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.672888 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc041-a864-4a60-b06e-2c3fbcb9836e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.674412 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfc041-a864-4a60-b06e-2c3fbcb9836e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:50.676341 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfc041-a864-4a60-b06e-2c3fbcb9836e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:50.678427 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 158/312] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:50.679276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac72e0-d304-4c45-a542-730b48535568 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.684822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfc041-a864-4a60-b06e-2c3fbcb9836e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.691999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac72e0-d304-4c45-a542-730b48535568 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.695985 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfc041-a864-4a60-b06e-2c3fbcb9836e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.697229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53fc3e-779e-4d34-a032-99efbc039171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.698146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53fc3e-779e-4d34-a032-99efbc039171 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.698483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53fc3e-779e-4d34-a032-99efbc039171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.698766 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53fc3e-779e-4d34-a032-99efbc039171 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.701130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9be5c-5c3f-41a0-9874-347ae3211a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.701616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9be5c-5c3f-41a0-9874-347ae3211a9f admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.701982 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9be5c-5c3f-41a0-9874-347ae3211a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.702269 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9be5c-5c3f-41a0-9874-347ae3211a9f admin admin] PATH_INFO: `/v3/groups` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.703061 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9be5c-5c3f-41a0-9874-347ae3211a9f admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:50.704117 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-a7d9be5c-5c3f-41a0-9874-347ae3211a9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:50.704117 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:18:50.704117 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:18:50.705885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9be5c-5c3f-41a0-9874-347ae3211a9f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:50.713970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53fc3e-779e-4d34-a032-99efbc039171 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:50.722189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-8b53fc3e-779e-4d34-a032-99efbc039171 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:18:50.731122 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 155/314] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:50 2021] GET /identity/v3/roles/reader => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:50.731122 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53fc3e-779e-4d34-a032-99efbc039171 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.731590 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 159/314] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Dec 15 13:18:50 2021] POST /identity/v3/groups => generated 229 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:18:50.744970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53fc3e-779e-4d34-a032-99efbc039171 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.750207 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc91623-3521-4c5c-9daf-1a198f472edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.751233 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91623-3521-4c5c-9daf-1a198f472edf admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.751615 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91623-3521-4c5c-9daf-1a198f472edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.751990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91623-3521-4c5c-9daf-1a198f472edf admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.752955 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc91623-3521-4c5c-9daf-1a198f472edf admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:50.753429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc91623-3521-4c5c-9daf-1a198f472edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:50.755308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc91623-3521-4c5c-9daf-1a198f472edf admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:50.766594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 156/315] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:50 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:50.774089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9be5c-5c3f-41a0-9874-347ae3211a9f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.786796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9be5c-5c3f-41a0-9874-347ae3211a9f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.791975 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d986f9-e8da-47c9-85b3-688b87aa9dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.793147 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d986f9-e8da-47c9-85b3-688b87aa9dae admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.793642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d986f9-e8da-47c9-85b3-688b87aa9dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.794091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d986f9-e8da-47c9-85b3-688b87aa9dae admin admin] PATH_INFO: `/v3/users/de4e95149bc748adaacb58597206716b` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.815428 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d986f9-e8da-47c9-85b3-688b87aa9dae admin admin] RBAC: Authorizing `identity:get_user(user_id=de4e95149bc748adaacb58597206716b)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:50.817667 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d986f9-e8da-47c9-85b3-688b87aa9dae admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:50.819545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 160/316] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:50 2021] GET /identity/v3/users/de4e95149bc748adaacb58597206716b => generated 293 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:50.826578 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc91623-3521-4c5c-9daf-1a198f472edf admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:50.840380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc91623-3521-4c5c-9daf-1a198f472edf admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:50.849326 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e482f2f-4719-4cbb-a1d6-c7bee6070ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:50.850406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e482f2f-4719-4cbb-a1d6-c7bee6070ecd admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:50.850943 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e482f2f-4719-4cbb-a1d6-c7bee6070ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:50.851450 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e482f2f-4719-4cbb-a1d6-c7bee6070ecd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:50.852549 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e482f2f-4719-4cbb-a1d6-c7bee6070ecd admin admin] RBAC: Adding query filter params (role.id=726ace838f324527844cb0c0a21a0fbf, user.id=de4e95149bc748adaacb58597206716b, scope.system=all) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:50.853188 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e482f2f-4719-4cbb-a1d6-c7bee6070ecd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:50.855548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e482f2f-4719-4cbb-a1d6-c7bee6070ecd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:50.864720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 157/317] 10.222.0.60 () {56 vars in 1329 bytes} [Wed Dec 15 13:18:50 2021] GET /identity/v3/role_assignments?user.id=de4e95149bc748adaacb58597206716b&scope.system=all&role.id=726ace838f324527844cb0c0a21a0fbf => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:53.083740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133882e-818f-4c2a-a115-ef113fb7db94 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.084274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133882e-818f-4c2a-a115-ef113fb7db94 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.084274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133882e-818f-4c2a-a115-ef113fb7db94 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.086235 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 161/318] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:53.091638 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ccfa0-9c76-4a78-8f3e-8bbe1c74277e None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.092009 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ccfa0-9c76-4a78-8f3e-8bbe1c74277e None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.092202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ccfa0-9c76-4a78-8f3e-8bbe1c74277e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.110540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-264ccfa0-9c76-4a78-8f3e-8bbe1c74277e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:53.111783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-264ccfa0-9c76-4a78-8f3e-8bbe1c74277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:53.119525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 158/319] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:53.143601 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133882e-818f-4c2a-a115-ef113fb7db94 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:53.155673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133882e-818f-4c2a-a115-ef113fb7db94 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:53.160535 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99ba81-deb6-424e-8198-362d541e288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:53.161319 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99ba81-deb6-424e-8198-362d541e288e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.161604 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99ba81-deb6-424e-8198-362d541e288e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.161882 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99ba81-deb6-424e-8198-362d541e288e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.172392 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99ba81-deb6-424e-8198-362d541e288e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:53.179334 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-ab99ba81-deb6-424e-8198-362d541e288e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:18:53.180715 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 162/320] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:53.185239 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193df015-1fb9-44f6-b0c0-d8105d771e88 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.185701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193df015-1fb9-44f6-b0c0-d8105d771e88 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.185812 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193df015-1fb9-44f6-b0c0-d8105d771e88 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.186531 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99ba81-deb6-424e-8198-362d541e288e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:53.187718 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 159/321] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:53.192844 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dbad6-4831-49b6-9fdc-1ac93262518e None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.193125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dbad6-4831-49b6-9fdc-1ac93262518e None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.193403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dbad6-4831-49b6-9fdc-1ac93262518e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.196681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99ba81-deb6-424e-8198-362d541e288e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:53.201743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a77c8-ada7-4e1d-b428-9bed44446afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:53.202386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a77c8-ada7-4e1d-b428-9bed44446afb admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.202674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a77c8-ada7-4e1d-b428-9bed44446afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.202990 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a77c8-ada7-4e1d-b428-9bed44446afb admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.203758 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a77c8-ada7-4e1d-b428-9bed44446afb admin admin] RBAC: Adding query filter params (name=member) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:53.204070 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a77c8-ada7-4e1d-b428-9bed44446afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:53.206203 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a77c8-ada7-4e1d-b428-9bed44446afb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:53.210994 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-7f2dbad6-4831-49b6-9fdc-1ac93262518e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:53.212160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-7f2dbad6-4831-49b6-9fdc-1ac93262518e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:53.215990 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 163/322] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:53 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:53.219815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 160/323] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:53.222044 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a77c8-ada7-4e1d-b428-9bed44446afb admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:53.231234 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a77c8-ada7-4e1d-b428-9bed44446afb admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:53.235427 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a0d09-5271-4802-8caf-6f8c3392bd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:53.236302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a0d09-5271-4802-8caf-6f8c3392bd42 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.236586 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a0d09-5271-4802-8caf-6f8c3392bd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.236866 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a0d09-5271-4802-8caf-6f8c3392bd42 admin admin] PATH_INFO: `/v3/users/15ab543211d94ee7b4706e907a936cdc` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.238053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a0d09-5271-4802-8caf-6f8c3392bd42 admin admin] RBAC: Authorizing `identity:get_user(user_id=15ab543211d94ee7b4706e907a936cdc)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:53.240217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a0d09-5271-4802-8caf-6f8c3392bd42 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:53.242892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 164/324] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:53 2021] GET /identity/v3/users/15ab543211d94ee7b4706e907a936cdc => generated 293 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:53.244011 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dbad6-4831-49b6-9fdc-1ac93262518e None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:53.247789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a0d09-5271-4802-8caf-6f8c3392bd42 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:53.252881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dbad6-4831-49b6-9fdc-1ac93262518e None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:53.257069 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a0d09-5271-4802-8caf-6f8c3392bd42 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:53.257253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34db107-1ae1-432e-b446-a64ea330784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:53.258018 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34db107-1ae1-432e-b446-a64ea330784e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.258245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34db107-1ae1-432e-b446-a64ea330784e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.258518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34db107-1ae1-432e-b446-a64ea330784e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.259755 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34db107-1ae1-432e-b446-a64ea330784e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:53.261446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60236e2d-c787-4851-9947-201b0fac0bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:53.261561 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34db107-1ae1-432e-b446-a64ea330784e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:53.262070 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60236e2d-c787-4851-9947-201b0fac0bbe admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.262354 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60236e2d-c787-4851-9947-201b0fac0bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.262635 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60236e2d-c787-4851-9947-201b0fac0bbe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.263043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 161/325] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:18:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:53.263516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60236e2d-c787-4851-9947-201b0fac0bbe admin admin] RBAC: Adding query filter params (role.id=e734a22c1b2c40feb0147271d002bdee, user.id=15ab543211d94ee7b4706e907a936cdc, scope.system=all) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:53.263829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60236e2d-c787-4851-9947-201b0fac0bbe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:53.264158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a668-b4f3-4c08-b198-8de7513b1549 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.264438 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a668-b4f3-4c08-b198-8de7513b1549 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.264706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a668-b4f3-4c08-b198-8de7513b1549 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.265630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60236e2d-c787-4851-9947-201b0fac0bbe admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:53.266428 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 162/326] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:53.269557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3a668-b4f3-4c08-b198-8de7513b1549 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:53.281000 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 165/327] 10.222.0.60 () {56 vars in 1329 bytes} [Wed Dec 15 13:18:53 2021] GET /identity/v3/role_assignments?user.id=15ab543211d94ee7b4706e907a936cdc&scope.system=all&role.id=e734a22c1b2c40feb0147271d002bdee => generated 510 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:53.282202 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea3be-f426-453a-a892-1160232e0a0e None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.282490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea3be-f426-453a-a892-1160232e0a0e None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.282765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3a668-b4f3-4c08-b198-8de7513b1549 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:53.282903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea3be-f426-453a-a892-1160232e0a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.287774 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e29263-953b-4f86-a5e4-498655a2f1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:53.288451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e29263-953b-4f86-a5e4-498655a2f1af admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.288732 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e29263-953b-4f86-a5e4-498655a2f1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.289007 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e29263-953b-4f86-a5e4-498655a2f1af admin admin] PATH_INFO: `/v3/groups` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.289751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e29263-953b-4f86-a5e4-498655a2f1af admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:53.290824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-c9e29263-953b-4f86-a5e4-498655a2f1af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:53.290824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:18:53.290824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:18:53.292092 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e29263-953b-4f86-a5e4-498655a2f1af admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:53.303014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-355ea3be-f426-453a-a892-1160232e0a0e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:53.304293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-355ea3be-f426-453a-a892-1160232e0a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:53.318174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 163/328] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Dec 15 13:18:53 2021] POST /identity/v3/groups => generated 226 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:18:53.318395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 166/329] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:53.336848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e29263-953b-4f86-a5e4-498655a2f1af admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:53.348148 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e29263-953b-4f86-a5e4-498655a2f1af admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:53.353000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f03616-d887-4489-b7c0-f0047cf7675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:53.353830 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f03616-d887-4489-b7c0-f0047cf7675c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.354124 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f03616-d887-4489-b7c0-f0047cf7675c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.354407 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f03616-d887-4489-b7c0-f0047cf7675c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.367107 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f03616-d887-4489-b7c0-f0047cf7675c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:53.374415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-01f03616-d887-4489-b7c0-f0047cf7675c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:18:53.375962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 164/330] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:53 2021] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:53.382954 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ea3be-f426-453a-a892-1160232e0a0e None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:53.393244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ea3be-f426-453a-a892-1160232e0a0e None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:53.397897 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249df0e-e27f-47f6-adc6-c9d9e4d33ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:53.398687 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249df0e-e27f-47f6-adc6-c9d9e4d33ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.399069 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249df0e-e27f-47f6-adc6-c9d9e4d33ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.399434 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249df0e-e27f-47f6-adc6-c9d9e4d33ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.400293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249df0e-e27f-47f6-adc6-c9d9e4d33ec7 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:53.400678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249df0e-e27f-47f6-adc6-c9d9e4d33ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:53.402857 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249df0e-e27f-47f6-adc6-c9d9e4d33ec7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:53.419242 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 167/331] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:53 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:53.421613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f03616-d887-4489-b7c0-f0047cf7675c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:53.435646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f03616-d887-4489-b7c0-f0047cf7675c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:53.440935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b11c90-063b-4200-ae19-cde19c26bc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:53.441833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b11c90-063b-4200-ae19-cde19c26bc02 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.442115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b11c90-063b-4200-ae19-cde19c26bc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.442388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b11c90-063b-4200-ae19-cde19c26bc02 admin admin] PATH_INFO: `/v3/users/de4e95149bc748adaacb58597206716b` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.443728 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b11c90-063b-4200-ae19-cde19c26bc02 admin admin] RBAC: Authorizing `identity:get_user(user_id=de4e95149bc748adaacb58597206716b)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:53.446219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b11c90-063b-4200-ae19-cde19c26bc02 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:53.449422 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 165/332] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:53 2021] GET /identity/v3/users/de4e95149bc748adaacb58597206716b => generated 293 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:53.458444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249df0e-e27f-47f6-adc6-c9d9e4d33ec7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:53.469044 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249df0e-e27f-47f6-adc6-c9d9e4d33ec7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:53.473949 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fa1fc-cff9-440f-9738-b949f9f33940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:53.475047 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fa1fc-cff9-440f-9738-b949f9f33940 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:53.475434 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fa1fc-cff9-440f-9738-b949f9f33940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:53.475814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fa1fc-cff9-440f-9738-b949f9f33940 admin admin] PATH_INFO: `/v3/system/users/de4e95149bc748adaacb58597206716b/roles/726ace838f324527844cb0c0a21a0fbf` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:53.477574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fa1fc-cff9-440f-9738-b949f9f33940 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=de4e95149bc748adaacb58597206716b, role_id=726ace838f324527844cb0c0a21a0fbf)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:53.479386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fa1fc-cff9-440f-9738-b949f9f33940 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:53.487835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 168/333] 10.222.0.60 () {58 vars in 1355 bytes} [Wed Dec 15 13:18:53 2021] PUT /identity/v3/system/users/de4e95149bc748adaacb58597206716b/roles/726ace838f324527844cb0c0a21a0fbf => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:18:56.171818 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2aa47-1f5c-4beb-8dd8-f29cdc06d190 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.172328 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2aa47-1f5c-4beb-8dd8-f29cdc06d190 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.172402 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2aa47-1f5c-4beb-8dd8-f29cdc06d190 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.172783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1597e-0532-4957-b7a0-182c9e4bdc63 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.173149 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1597e-0532-4957-b7a0-182c9e4bdc63 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.173351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1597e-0532-4957-b7a0-182c9e4bdc63 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.174408 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 166/334] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:56.175414 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 169/335] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:56.180632 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50e902-f5d4-41d2-80f3-dec3d75f7b42 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.180917 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50e902-f5d4-41d2-80f3-dec3d75f7b42 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.181019 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49264f9d-79ab-46bb-b19c-15ef5c182ec8 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.181271 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49264f9d-79ab-46bb-b19c-15ef5c182ec8 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.181371 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50e902-f5d4-41d2-80f3-dec3d75f7b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.181553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49264f9d-79ab-46bb-b19c-15ef5c182ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.202861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-49264f9d-79ab-46bb-b19c-15ef5c182ec8 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:56.204052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-49264f9d-79ab-46bb-b19c-15ef5c182ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:56.206287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-dc50e902-f5d4-41d2-80f3-dec3d75f7b42 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:56.207455 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-dc50e902-f5d4-41d2-80f3-dec3d75f7b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:56.216015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 167/336] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:56.224790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 170/337] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:56.240781 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50e902-f5d4-41d2-80f3-dec3d75f7b42 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.250337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50e902-f5d4-41d2-80f3-dec3d75f7b42 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.254788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8fca7-96c0-49c1-a05a-ab8fafd35855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.255601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8fca7-96c0-49c1-a05a-ab8fafd35855 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.255881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8fca7-96c0-49c1-a05a-ab8fafd35855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.256156 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8fca7-96c0-49c1-a05a-ab8fafd35855 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.264587 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49264f9d-79ab-46bb-b19c-15ef5c182ec8 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.282203 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49264f9d-79ab-46bb-b19c-15ef5c182ec8 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.284325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8fca7-96c0-49c1-a05a-ab8fafd35855 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:56.299284 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aef634-9f0d-44f6-801b-ed80e02131b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.300091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aef634-9f0d-44f6-801b-ed80e02131b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.300369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aef634-9f0d-44f6-801b-ed80e02131b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.300644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aef634-9f0d-44f6-801b-ed80e02131b8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.301281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-4fa8fca7-96c0-49c1-a05a-ab8fafd35855 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:18:56.302527 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 168/338] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:56.309193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8fca7-96c0-49c1-a05a-ab8fafd35855 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.325773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aef634-9f0d-44f6-801b-ed80e02131b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:56.333632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-24aef634-9f0d-44f6-801b-ed80e02131b8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:18:56.338548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8fca7-96c0-49c1-a05a-ab8fafd35855 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.340184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 171/339] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:56.342658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aef634-9f0d-44f6-801b-ed80e02131b8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.344282 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7113c72-0c4a-4233-8705-4636fd42e409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.344946 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7113c72-0c4a-4233-8705-4636fd42e409 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.345226 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7113c72-0c4a-4233-8705-4636fd42e409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.345501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7113c72-0c4a-4233-8705-4636fd42e409 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.349372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7113c72-0c4a-4233-8705-4636fd42e409 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:56.349372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7113c72-0c4a-4233-8705-4636fd42e409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:56.352728 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7113c72-0c4a-4233-8705-4636fd42e409 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:56.369778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 169/340] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:56.371847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aef634-9f0d-44f6-801b-ed80e02131b8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.375831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7113c72-0c4a-4233-8705-4636fd42e409 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.383510 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14fe3c-435d-4c14-b99d-760622ffc72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.384466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14fe3c-435d-4c14-b99d-760622ffc72c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.384970 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14fe3c-435d-4c14-b99d-760622ffc72c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.385442 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14fe3c-435d-4c14-b99d-760622ffc72c admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.386408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14fe3c-435d-4c14-b99d-760622ffc72c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:56.386946 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14fe3c-435d-4c14-b99d-760622ffc72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:56.388750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14fe3c-435d-4c14-b99d-760622ffc72c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:56.392438 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7113c72-0c4a-4233-8705-4636fd42e409 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.405566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258c45f-2296-468f-978c-0890984abeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.406209 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258c45f-2296-468f-978c-0890984abeee admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.406486 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258c45f-2296-468f-978c-0890984abeee admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.406763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258c45f-2296-468f-978c-0890984abeee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.406978 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 172/341] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:56.412690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14fe3c-435d-4c14-b99d-760622ffc72c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.419175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258c45f-2296-468f-978c-0890984abeee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:56.421480 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258c45f-2296-468f-978c-0890984abeee admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:56.433565 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14fe3c-435d-4c14-b99d-760622ffc72c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.436604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 170/342] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:56.443733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258c45f-2296-468f-978c-0890984abeee admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.444816 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20286227-e22f-4346-9f87-66957d5ea882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.445485 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20286227-e22f-4346-9f87-66957d5ea882 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.445767 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20286227-e22f-4346-9f87-66957d5ea882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.446041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20286227-e22f-4346-9f87-66957d5ea882 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.453122 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258c45f-2296-468f-978c-0890984abeee admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.460147 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20286227-e22f-4346-9f87-66957d5ea882 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:56.461945 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20286227-e22f-4346-9f87-66957d5ea882 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:56.472262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013345b-148c-4a02-8290-580b2a189918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.473129 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013345b-148c-4a02-8290-580b2a189918 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.473405 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013345b-148c-4a02-8290-580b2a189918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.473678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013345b-148c-4a02-8290-580b2a189918 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.479867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013345b-148c-4a02-8290-580b2a189918 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:56.481710 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 173/343] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:18:56.481962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013345b-148c-4a02-8290-580b2a189918 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:56.483101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20286227-e22f-4346-9f87-66957d5ea882 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.484082 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 171/344] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:56.490609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013345b-148c-4a02-8290-580b2a189918 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.494934 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20286227-e22f-4346-9f87-66957d5ea882 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.504850 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013345b-148c-4a02-8290-580b2a189918 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.508214 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86938621-4509-4a05-bd02-b1ad98db3fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.509067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86938621-4509-4a05-bd02-b1ad98db3fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.509343 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86938621-4509-4a05-bd02-b1ad98db3fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.509616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86938621-4509-4a05-bd02-b1ad98db3fd5 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.511098 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86938621-4509-4a05-bd02-b1ad98db3fd5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:56.513127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86938621-4509-4a05-bd02-b1ad98db3fd5 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:56.514802 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 174/345] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:56.521397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32b5c8-5bbd-4793-a812-f927d1f2ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.522246 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32b5c8-5bbd-4793-a812-f927d1f2ae1d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.522523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32b5c8-5bbd-4793-a812-f927d1f2ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.522794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32b5c8-5bbd-4793-a812-f927d1f2ae1d admin admin] PATH_INFO: `/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.524269 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86938621-4509-4a05-bd02-b1ad98db3fd5 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.536076 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32b5c8-5bbd-4793-a812-f927d1f2ae1d admin admin] RBAC: Authorizing `identity:get_group(group_id=43a8d7cb8d0345b2a71f46d3f4509162)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:56.537125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-4e32b5c8-5bbd-4793-a812-f927d1f2ae1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:56.537125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:18:56.537125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:18:56.538308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32b5c8-5bbd-4793-a812-f927d1f2ae1d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:56.544121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 172/346] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162 => generated 226 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:56.547890 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86938621-4509-4a05-bd02-b1ad98db3fd5 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.550950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32b5c8-5bbd-4793-a812-f927d1f2ae1d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.562137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32b5c8-5bbd-4793-a812-f927d1f2ae1d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.563329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbd154-3d73-4406-8419-5bf6ffb64791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.564171 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbd154-3d73-4406-8419-5bf6ffb64791 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.564449 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbd154-3d73-4406-8419-5bf6ffb64791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.565248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbd154-3d73-4406-8419-5bf6ffb64791 admin admin] PATH_INFO: `/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.566709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbd154-3d73-4406-8419-5bf6ffb64791 admin admin] RBAC: Authorizing `identity:get_group(group_id=43a8d7cb8d0345b2a71f46d3f4509162)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:56.567761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-b1fbd154-3d73-4406-8419-5bf6ffb64791 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:18:56.567761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:18:56.567761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:18:56.568930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbd154-3d73-4406-8419-5bf6ffb64791 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:56.570709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 175/347] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:56.577148 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbd154-3d73-4406-8419-5bf6ffb64791 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.583698 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa251a38-3eda-478b-a3fe-d6d3a47d22eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.584353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251a38-3eda-478b-a3fe-d6d3a47d22eb admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.584630 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251a38-3eda-478b-a3fe-d6d3a47d22eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.584906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251a38-3eda-478b-a3fe-d6d3a47d22eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.585766 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa251a38-3eda-478b-a3fe-d6d3a47d22eb admin admin] RBAC: Adding query filter params (group.id=43a8d7cb8d0345b2a71f46d3f4509162, role.id=e734a22c1b2c40feb0147271d002bdee, scope.project.id=d9bef98222d5424aa293398d503f422d) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:56.586074 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa251a38-3eda-478b-a3fe-d6d3a47d22eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:56.587954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa251a38-3eda-478b-a3fe-d6d3a47d22eb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:56.600323 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 173/348] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/role_assignments?group.id=43a8d7cb8d0345b2a71f46d3f4509162&scope.project.id=d9bef98222d5424aa293398d503f422d&role.id=e734a22c1b2c40feb0147271d002bdee => generated 260 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:56.602723 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbd154-3d73-4406-8419-5bf6ffb64791 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.607597 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f06085-ebfa-4dc4-994c-a0c7d38020cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.608258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f06085-ebfa-4dc4-994c-a0c7d38020cc admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.608540 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f06085-ebfa-4dc4-994c-a0c7d38020cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.608812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f06085-ebfa-4dc4-994c-a0c7d38020cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.609673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f06085-ebfa-4dc4-994c-a0c7d38020cc admin admin] RBAC: Adding query filter params (group.id=43a8d7cb8d0345b2a71f46d3f4509162, role.id=f4edd7aabe7e416f95ab6833aa478f07, scope.project.id=d9bef98222d5424aa293398d503f422d) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:56.609979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f06085-ebfa-4dc4-994c-a0c7d38020cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:56.612036 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f06085-ebfa-4dc4-994c-a0c7d38020cc admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:56.612235 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263f91-2a3e-4904-8e66-b1ac0e6fbc6c None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.612406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263f91-2a3e-4904-8e66-b1ac0e6fbc6c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.612597 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263f91-2a3e-4904-8e66-b1ac0e6fbc6c None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.614437 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 174/349] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:18:56.620212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 176/350] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/role_assignments?group.id=43a8d7cb8d0345b2a71f46d3f4509162&scope.project.id=d9bef98222d5424aa293398d503f422d&role.id=f4edd7aabe7e416f95ab6833aa478f07 => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:56.636962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9b8c8-1b22-427c-8bf2-284c58ca9e0b None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.637306 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9b8c8-1b22-427c-8bf2-284c58ca9e0b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.637509 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9b8c8-1b22-427c-8bf2-284c58ca9e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.668029 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-75e9b8c8-1b22-427c-8bf2-284c58ca9e0b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:56.669261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-75e9b8c8-1b22-427c-8bf2-284c58ca9e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:56.693859 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 175/351] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:56.737022 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f06085-ebfa-4dc4-994c-a0c7d38020cc admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.753293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f06085-ebfa-4dc4-994c-a0c7d38020cc admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.758062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887f052-00f4-4d89-8165-9d63416f6bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.758914 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887f052-00f4-4d89-8165-9d63416f6bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.759201 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887f052-00f4-4d89-8165-9d63416f6bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.759477 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887f052-00f4-4d89-8165-9d63416f6bd8 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.788232 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887f052-00f4-4d89-8165-9d63416f6bd8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:56.795619 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-1887f052-00f4-4d89-8165-9d63416f6bd8 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:18:56.797225 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 177/352] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/roles/reader => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:56.803962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9b8c8-1b22-427c-8bf2-284c58ca9e0b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.818733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9b8c8-1b22-427c-8bf2-284c58ca9e0b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.830312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03bb52-4f6b-4a75-8abd-2b3f76df2a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.831026 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03bb52-4f6b-4a75-8abd-2b3f76df2a3b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.831307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03bb52-4f6b-4a75-8abd-2b3f76df2a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.831586 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03bb52-4f6b-4a75-8abd-2b3f76df2a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.832379 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03bb52-4f6b-4a75-8abd-2b3f76df2a3b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:56.832690 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03bb52-4f6b-4a75-8abd-2b3f76df2a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:56.834337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03bb52-4f6b-4a75-8abd-2b3f76df2a3b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:56.853339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 176/353] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:56.859602 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887f052-00f4-4d89-8165-9d63416f6bd8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.877060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887f052-00f4-4d89-8165-9d63416f6bd8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.882289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baed006-7feb-47bb-879c-138979cebb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.887485 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baed006-7feb-47bb-879c-138979cebb17 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.887780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baed006-7feb-47bb-879c-138979cebb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.888116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baed006-7feb-47bb-879c-138979cebb17 admin admin] PATH_INFO: `/v3/users/de4e95149bc748adaacb58597206716b` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.889587 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baed006-7feb-47bb-879c-138979cebb17 admin admin] RBAC: Authorizing `identity:get_user(user_id=de4e95149bc748adaacb58597206716b)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:56.891787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baed006-7feb-47bb-879c-138979cebb17 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:56.893906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 178/354] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/users/de4e95149bc748adaacb58597206716b => generated 293 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:56.900143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03bb52-4f6b-4a75-8abd-2b3f76df2a3b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:56.916503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03bb52-4f6b-4a75-8abd-2b3f76df2a3b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:56.925185 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791b107-4b62-4525-a2b3-24e3679db3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:56.925844 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791b107-4b62-4525-a2b3-24e3679db3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.926127 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791b107-4b62-4525-a2b3-24e3679db3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.926404 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791b107-4b62-4525-a2b3-24e3679db3b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.927291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791b107-4b62-4525-a2b3-24e3679db3b8 admin admin] RBAC: Adding query filter params (role.id=726ace838f324527844cb0c0a21a0fbf, user.id=de4e95149bc748adaacb58597206716b, scope.system=all) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:56.927602 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791b107-4b62-4525-a2b3-24e3679db3b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:56.929506 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791b107-4b62-4525-a2b3-24e3679db3b8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:56.956802 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 177/355] 10.222.0.60 () {56 vars in 1329 bytes} [Wed Dec 15 13:18:56 2021] GET /identity/v3/role_assignments?user.id=de4e95149bc748adaacb58597206716b&scope.system=all&role.id=726ace838f324527844cb0c0a21a0fbf => generated 510 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:56.993295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9de2de-0df0-438b-b1a0-a71e7b27ca49 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:56.993678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9de2de-0df0-438b-b1a0-a71e7b27ca49 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:56.993848 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9de2de-0df0-438b-b1a0-a71e7b27ca49 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:56.995704 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 179/356] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:57.003870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cfb37-92d6-4185-b403-124ba6d54221 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:57.004217 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cfb37-92d6-4185-b403-124ba6d54221 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:57.004501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cfb37-92d6-4185-b403-124ba6d54221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:57.030875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-007cfb37-92d6-4185-b403-124ba6d54221 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:57.032098 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-007cfb37-92d6-4185-b403-124ba6d54221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:57.042889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 178/357] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:57.071644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9de2de-0df0-438b-b1a0-a71e7b27ca49 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:57.088237 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9de2de-0df0-438b-b1a0-a71e7b27ca49 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:57.092846 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785a931-9747-49c6-9477-63d218408368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:57.093661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785a931-9747-49c6-9477-63d218408368 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:57.093940 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785a931-9747-49c6-9477-63d218408368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:57.094215 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785a931-9747-49c6-9477-63d218408368 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:57.120415 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785a931-9747-49c6-9477-63d218408368 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:57.127584 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-c785a931-9747-49c6-9477-63d218408368 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:18:57.128837 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 180/358] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:57 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:57.135310 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cfb37-92d6-4185-b403-124ba6d54221 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:57.146094 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cfb37-92d6-4185-b403-124ba6d54221 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:57.152714 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4acc2-c3a8-4d01-9a2d-ffa28d1167de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:57.153400 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4acc2-c3a8-4d01-9a2d-ffa28d1167de admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:57.153680 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4acc2-c3a8-4d01-9a2d-ffa28d1167de admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:57.153953 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4acc2-c3a8-4d01-9a2d-ffa28d1167de admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:57.154743 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4acc2-c3a8-4d01-9a2d-ffa28d1167de admin admin] RBAC: Adding query filter params (name=member) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:57.155079 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4acc2-c3a8-4d01-9a2d-ffa28d1167de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:57.156754 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4acc2-c3a8-4d01-9a2d-ffa28d1167de admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:57.170477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 179/359] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:18:57 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:57.176966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785a931-9747-49c6-9477-63d218408368 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:57.193644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785a931-9747-49c6-9477-63d218408368 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:57.198205 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0bb66-d6ff-4f3b-95e8-08a278eadb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:57.198878 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0bb66-d6ff-4f3b-95e8-08a278eadb55 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:57.199166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0bb66-d6ff-4f3b-95e8-08a278eadb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:57.199440 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0bb66-d6ff-4f3b-95e8-08a278eadb55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:57.214991 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0bb66-d6ff-4f3b-95e8-08a278eadb55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:57.216770 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0bb66-d6ff-4f3b-95e8-08a278eadb55 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:57.232779 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 181/360] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:57.239524 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4acc2-c3a8-4d01-9a2d-ffa28d1167de admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:57.249466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4acc2-c3a8-4d01-9a2d-ffa28d1167de admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:57.257706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5fc52-c3a5-47aa-b501-75640eb13aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:57.258616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5fc52-c3a5-47aa-b501-75640eb13aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:57.258909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5fc52-c3a5-47aa-b501-75640eb13aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:57.259186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5fc52-c3a5-47aa-b501-75640eb13aa7 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:57.260432 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5fc52-c3a5-47aa-b501-75640eb13aa7 admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:57.262659 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5fc52-c3a5-47aa-b501-75640eb13aa7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:57.264413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 180/361] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:57 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:57.270317 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0bb66-d6ff-4f3b-95e8-08a278eadb55 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:57.279783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0bb66-d6ff-4f3b-95e8-08a278eadb55 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:57.287341 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2661943-5812-4dc2-a463-9a6cd93a4863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:57.288190 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2661943-5812-4dc2-a463-9a6cd93a4863 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:57.288465 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2661943-5812-4dc2-a463-9a6cd93a4863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:57.288738 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2661943-5812-4dc2-a463-9a6cd93a4863 admin admin] PATH_INFO: `/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:57.291586 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2661943-5812-4dc2-a463-9a6cd93a4863 admin admin] RBAC: Authorizing `identity:get_group(group_id=43a8d7cb8d0345b2a71f46d3f4509162)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:57.293497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2661943-5812-4dc2-a463-9a6cd93a4863 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:57.295369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 182/362] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:18:57 2021] GET /identity/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:57.302238 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5fc52-c3a5-47aa-b501-75640eb13aa7 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:57.313555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5fc52-c3a5-47aa-b501-75640eb13aa7 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:57.318723 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a82cbe-fb83-4555-b9f1-3ffd87719528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:57.319503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a82cbe-fb83-4555-b9f1-3ffd87719528 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:57.319784 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a82cbe-fb83-4555-b9f1-3ffd87719528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:57.320063 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a82cbe-fb83-4555-b9f1-3ffd87719528 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:57.320967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a82cbe-fb83-4555-b9f1-3ffd87719528 admin admin] RBAC: Adding query filter params (group.id=43a8d7cb8d0345b2a71f46d3f4509162, role.id=e734a22c1b2c40feb0147271d002bdee, scope.project.id=8dc4455f0ea9485aac8ec368a026004f) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:57.321280 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a82cbe-fb83-4555-b9f1-3ffd87719528 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:57.328608 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a82cbe-fb83-4555-b9f1-3ffd87719528 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:57.335209 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 181/363] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Dec 15 13:18:57 2021] GET /identity/v3/role_assignments?group.id=43a8d7cb8d0345b2a71f46d3f4509162&scope.project.id=8dc4455f0ea9485aac8ec368a026004f&role.id=e734a22c1b2c40feb0147271d002bdee => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:58.228772 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0b46f-ae1c-4264-a593-895d9dfd02c4 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.229278 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0b46f-ae1c-4264-a593-895d9dfd02c4 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.229353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0b46f-ae1c-4264-a593-895d9dfd02c4 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.231355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 183/364] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:58.237692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c86c6b-82c4-4b9a-a7db-de9968d7ef45 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.237979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c86c6b-82c4-4b9a-a7db-de9968d7ef45 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.238256 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c86c6b-82c4-4b9a-a7db-de9968d7ef45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.257103 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-86c86c6b-82c4-4b9a-a7db-de9968d7ef45 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:58.258269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-86c86c6b-82c4-4b9a-a7db-de9968d7ef45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:58.266012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 182/365] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:18:58.289051 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0b46f-ae1c-4264-a593-895d9dfd02c4 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:58.302471 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0b46f-ae1c-4264-a593-895d9dfd02c4 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:58.306764 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952380f6-71c9-4588-a3ba-072647631c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:58.307582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952380f6-71c9-4588-a3ba-072647631c12 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.307862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952380f6-71c9-4588-a3ba-072647631c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.308134 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952380f6-71c9-4588-a3ba-072647631c12 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.320573 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952380f6-71c9-4588-a3ba-072647631c12 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:58.327793 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-952380f6-71c9-4588-a3ba-072647631c12 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:18:58.328978 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 184/366] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:18:58 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:58.337221 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c86c6b-82c4-4b9a-a7db-de9968d7ef45 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:58.346451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c86c6b-82c4-4b9a-a7db-de9968d7ef45 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:58.350963 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d89664-e817-4833-8791-ee73367109a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:58.351620 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d89664-e817-4833-8791-ee73367109a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.351899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d89664-e817-4833-8791-ee73367109a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.352177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d89664-e817-4833-8791-ee73367109a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.352948 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d89664-e817-4833-8791-ee73367109a6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:58.353253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d89664-e817-4833-8791-ee73367109a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:58.354855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d89664-e817-4833-8791-ee73367109a6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:58.364409 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 183/367] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:18:58 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:58.370409 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952380f6-71c9-4588-a3ba-072647631c12 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:58.381099 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952380f6-71c9-4588-a3ba-072647631c12 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:58.385647 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d3031-075e-4298-8fb5-a34cf7233902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:58.386286 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d3031-075e-4298-8fb5-a34cf7233902 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.386566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d3031-075e-4298-8fb5-a34cf7233902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.386859 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d3031-075e-4298-8fb5-a34cf7233902 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.395767 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d3031-075e-4298-8fb5-a34cf7233902 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:58.397502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d3031-075e-4298-8fb5-a34cf7233902 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:58.406448 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 185/368] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:58.412677 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d89664-e817-4833-8791-ee73367109a6 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:58.422761 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d89664-e817-4833-8791-ee73367109a6 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:58.427852 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c5b0c-ab64-486b-86e3-88006b718082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:58.428782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c5b0c-ab64-486b-86e3-88006b718082 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.429066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c5b0c-ab64-486b-86e3-88006b718082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.429342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c5b0c-ab64-486b-86e3-88006b718082 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.430776 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c5b0c-ab64-486b-86e3-88006b718082 admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:58.433001 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c5b0c-ab64-486b-86e3-88006b718082 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:58.435232 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 184/369] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:58 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:58.442143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d3031-075e-4298-8fb5-a34cf7233902 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:58.451499 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d3031-075e-4298-8fb5-a34cf7233902 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:58.460092 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa854d-3e49-48b8-8000-4844f32f66ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:58.460947 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa854d-3e49-48b8-8000-4844f32f66ef admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.461226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa854d-3e49-48b8-8000-4844f32f66ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.461499 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa854d-3e49-48b8-8000-4844f32f66ef admin admin] PATH_INFO: `/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.462754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa854d-3e49-48b8-8000-4844f32f66ef admin admin] RBAC: Authorizing `identity:get_group(group_id=43a8d7cb8d0345b2a71f46d3f4509162)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:58.464753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa854d-3e49-48b8-8000-4844f32f66ef admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:58.466613 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 186/370] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:18:58 2021] GET /identity/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:58.472841 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c5b0c-ab64-486b-86e3-88006b718082 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:58.483144 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c5b0c-ab64-486b-86e3-88006b718082 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:58.491112 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a35eb2-bc4c-439e-b028-886f0097a6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:58.491815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a35eb2-bc4c-439e-b028-886f0097a6ea admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.492093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a35eb2-bc4c-439e-b028-886f0097a6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.492429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a35eb2-bc4c-439e-b028-886f0097a6ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.493289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a35eb2-bc4c-439e-b028-886f0097a6ea admin admin] RBAC: Adding query filter params (group.id=43a8d7cb8d0345b2a71f46d3f4509162, role.id=f4edd7aabe7e416f95ab6833aa478f07, scope.project.id=8dc4455f0ea9485aac8ec368a026004f) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:58.493654 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a35eb2-bc4c-439e-b028-886f0097a6ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:58.495599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a35eb2-bc4c-439e-b028-886f0097a6ea admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:58.501967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 185/371] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Dec 15 13:18:58 2021] GET /identity/v3/role_assignments?group.id=43a8d7cb8d0345b2a71f46d3f4509162&scope.project.id=8dc4455f0ea9485aac8ec368a026004f&role.id=f4edd7aabe7e416f95ab6833aa478f07 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:58.637209 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590ebf0-556e-4a42-8e65-1720e808e2ad None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.637600 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590ebf0-556e-4a42-8e65-1720e808e2ad None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.637808 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590ebf0-556e-4a42-8e65-1720e808e2ad None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.639828 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 187/372] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:58.645846 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8b5c8-a595-4649-9bd8-4a333fdebd74 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.646133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8b5c8-a595-4649-9bd8-4a333fdebd74 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.646413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8b5c8-a595-4649-9bd8-4a333fdebd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.665533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-f1d8b5c8-a595-4649-9bd8-4a333fdebd74 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:58.666575 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f1d8b5c8-a595-4649-9bd8-4a333fdebd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:58.675724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 186/373] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:18:58.699977 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590ebf0-556e-4a42-8e65-1720e808e2ad None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:58.712444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590ebf0-556e-4a42-8e65-1720e808e2ad None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:58.717086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42de7ae-25d2-4054-9d7d-7b3d48cd47e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:58.717934 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de7ae-25d2-4054-9d7d-7b3d48cd47e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.718213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de7ae-25d2-4054-9d7d-7b3d48cd47e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.718538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de7ae-25d2-4054-9d7d-7b3d48cd47e9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.735268 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42de7ae-25d2-4054-9d7d-7b3d48cd47e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:18:58.745424 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-f42de7ae-25d2-4054-9d7d-7b3d48cd47e9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:18:58.747003 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 188/374] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:18:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:18:58.753274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8b5c8-a595-4649-9bd8-4a333fdebd74 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:58.762525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8b5c8-a595-4649-9bd8-4a333fdebd74 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:58.769211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6458f90-c097-41b6-ba61-ee80e0b8c48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:58.769857 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6458f90-c097-41b6-ba61-ee80e0b8c48e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.770141 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6458f90-c097-41b6-ba61-ee80e0b8c48e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.770412 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6458f90-c097-41b6-ba61-ee80e0b8c48e admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.771252 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6458f90-c097-41b6-ba61-ee80e0b8c48e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:58.771558 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6458f90-c097-41b6-ba61-ee80e0b8c48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:58.773227 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6458f90-c097-41b6-ba61-ee80e0b8c48e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:58.782522 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 187/375] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:18:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:58.802019 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42de7ae-25d2-4054-9d7d-7b3d48cd47e9 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:58.811754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42de7ae-25d2-4054-9d7d-7b3d48cd47e9 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:58.822800 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b686-84c0-44a5-bea5-617e24d8777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:58.823511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b686-84c0-44a5-bea5-617e24d8777a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.823791 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b686-84c0-44a5-bea5-617e24d8777a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.824064 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b686-84c0-44a5-bea5-617e24d8777a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.833288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306b686-84c0-44a5-bea5-617e24d8777a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:58.835125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306b686-84c0-44a5-bea5-617e24d8777a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:58.844968 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 189/376] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:18:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:18:58.851793 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6458f90-c097-41b6-ba61-ee80e0b8c48e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:58.861584 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6458f90-c097-41b6-ba61-ee80e0b8c48e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:58.868508 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbbe60-d5b1-4e8b-81b8-96eca6f9298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:58.869420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbbe60-d5b1-4e8b-81b8-96eca6f9298b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.869699 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbbe60-d5b1-4e8b-81b8-96eca6f9298b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.869971 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbbe60-d5b1-4e8b-81b8-96eca6f9298b admin admin] PATH_INFO: `/v3/projects/b8bb67e688614ccb9ee5454c18356750` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.871256 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbbe60-d5b1-4e8b-81b8-96eca6f9298b admin admin] RBAC: Authorizing `identity:get_project(project_id=b8bb67e688614ccb9ee5454c18356750)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:58.873083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbbe60-d5b1-4e8b-81b8-96eca6f9298b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:58.874880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 188/377] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:18:58 2021] GET /identity/v3/projects/b8bb67e688614ccb9ee5454c18356750 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:58.881048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b686-84c0-44a5-bea5-617e24d8777a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:58.889983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b686-84c0-44a5-bea5-617e24d8777a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:58.896604 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e3ef6-5ca4-4c7d-993b-a9fa8bfba8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:58.897473 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e3ef6-5ca4-4c7d-993b-a9fa8bfba8de admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.897752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e3ef6-5ca4-4c7d-993b-a9fa8bfba8de admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.898030 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e3ef6-5ca4-4c7d-993b-a9fa8bfba8de admin admin] PATH_INFO: `/v3/groups/d9814215f6d4481b9ab092e8eb16303e` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.905294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e3ef6-5ca4-4c7d-993b-a9fa8bfba8de admin admin] RBAC: Authorizing `identity:get_group(group_id=d9814215f6d4481b9ab092e8eb16303e)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:58.907308 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e3ef6-5ca4-4c7d-993b-a9fa8bfba8de admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:58.909150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 190/378] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:18:58 2021] GET /identity/v3/groups/d9814215f6d4481b9ab092e8eb16303e => generated 229 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:18:58.916150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbbe60-d5b1-4e8b-81b8-96eca6f9298b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:58.926342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbbe60-d5b1-4e8b-81b8-96eca6f9298b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:58.930793 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7ab28-4077-4abc-b3b2-c4927318edac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:58.931478 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7ab28-4077-4abc-b3b2-c4927318edac admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:58.931757 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7ab28-4077-4abc-b3b2-c4927318edac admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:58.932035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7ab28-4077-4abc-b3b2-c4927318edac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:58.932888 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7ab28-4077-4abc-b3b2-c4927318edac admin admin] RBAC: Adding query filter params (group.id=d9814215f6d4481b9ab092e8eb16303e, role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=b8bb67e688614ccb9ee5454c18356750) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:18:58.933197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7ab28-4077-4abc-b3b2-c4927318edac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:58.935107 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7ab28-4077-4abc-b3b2-c4927318edac admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:58.941764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 189/379] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Dec 15 13:18:58 2021] GET /identity/v3/role_assignments?group.id=d9814215f6d4481b9ab092e8eb16303e&scope.project.id=b8bb67e688614ccb9ee5454c18356750&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 260 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:18:59.943475 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1910b23-4bec-4fad-9643-b76dcac0c94e None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:59.944227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1910b23-4bec-4fad-9643-b76dcac0c94e None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:59.944227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1910b23-4bec-4fad-9643-b76dcac0c94e None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:59.945864 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 191/380] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:18:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:18:59.961640 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb968c21-5224-4f34-8fb9-231cad163be4 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:59.962227 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb968c21-5224-4f34-8fb9-231cad163be4 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:59.962227 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb968c21-5224-4f34-8fb9-231cad163be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:59.980793 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-eb968c21-5224-4f34-8fb9-231cad163be4 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:18:59.981979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-eb968c21-5224-4f34-8fb9-231cad163be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:59.995164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 190/381] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:18:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:00.032343 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1910b23-4bec-4fad-9643-b76dcac0c94e None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.049005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1910b23-4bec-4fad-9643-b76dcac0c94e None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.053408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e5cb8-38c5-42fa-b995-00401e7881b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.054206 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e5cb8-38c5-42fa-b995-00401e7881b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.054480 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e5cb8-38c5-42fa-b995-00401e7881b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.054753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e5cb8-38c5-42fa-b995-00401e7881b4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.070115 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e5cb8-38c5-42fa-b995-00401e7881b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:00.077413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-f12e5cb8-38c5-42fa-b995-00401e7881b4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:19:00.078603 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 192/382] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:19:00 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:00.085685 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb968c21-5224-4f34-8fb9-231cad163be4 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.094894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb968c21-5224-4f34-8fb9-231cad163be4 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.101247 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99f91a-28c2-4da3-9b82-c43d1e2adfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.101916 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99f91a-28c2-4da3-9b82-c43d1e2adfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.102200 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99f91a-28c2-4da3-9b82-c43d1e2adfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.102476 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99f91a-28c2-4da3-9b82-c43d1e2adfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.103275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99f91a-28c2-4da3-9b82-c43d1e2adfe5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:00.103582 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99f91a-28c2-4da3-9b82-c43d1e2adfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:00.105176 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99f91a-28c2-4da3-9b82-c43d1e2adfe5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:00.114115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 191/383] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:00 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:00.120668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e5cb8-38c5-42fa-b995-00401e7881b4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.132416 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e5cb8-38c5-42fa-b995-00401e7881b4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.141785 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315048be-f26e-47c7-b77b-6efd590737d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.142637 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315048be-f26e-47c7-b77b-6efd590737d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.142987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315048be-f26e-47c7-b77b-6efd590737d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.143838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315048be-f26e-47c7-b77b-6efd590737d7 admin admin] PATH_INFO: `/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.145041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315048be-f26e-47c7-b77b-6efd590737d7 admin admin] RBAC: Authorizing `identity:get_group(group_id=43a8d7cb8d0345b2a71f46d3f4509162)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:00.146967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315048be-f26e-47c7-b77b-6efd590737d7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:00.148784 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 193/384] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:19:00 2021] GET /identity/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:00.154974 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99f91a-28c2-4da3-9b82-c43d1e2adfe5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.164872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99f91a-28c2-4da3-9b82-c43d1e2adfe5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.169947 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ed6b-1932-4c6f-afd9-dfd3edba86a6 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.170239 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ed6b-1932-4c6f-afd9-dfd3edba86a6 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.170517 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ed6b-1932-4c6f-afd9-dfd3edba86a6 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.173627 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 194/385] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:19:00.176682 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1121b1a-7552-4cbc-80b9-6bffb3621107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.177533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1121b1a-7552-4cbc-80b9-6bffb3621107 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.177792 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1121b1a-7552-4cbc-80b9-6bffb3621107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.178178 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1121b1a-7552-4cbc-80b9-6bffb3621107 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.179812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd46f9d-2237-42c6-b461-8c94f2ff66f5 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.180088 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd46f9d-2237-42c6-b461-8c94f2ff66f5 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.180360 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd46f9d-2237-42c6-b461-8c94f2ff66f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.182396 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1121b1a-7552-4cbc-80b9-6bffb3621107 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:00.184486 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1121b1a-7552-4cbc-80b9-6bffb3621107 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:00.188309 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 192/386] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:19:00 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:00.193172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1121b1a-7552-4cbc-80b9-6bffb3621107 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.215998 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1121b1a-7552-4cbc-80b9-6bffb3621107 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.217518 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-8dd46f9d-2237-42c6-b461-8c94f2ff66f5 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:00.218703 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8dd46f9d-2237-42c6-b461-8c94f2ff66f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:00.224838 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97d17d-9535-4395-9e65-a1f536774eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.225714 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97d17d-9535-4395-9e65-a1f536774eee admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.225992 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97d17d-9535-4395-9e65-a1f536774eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.226263 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97d17d-9535-4395-9e65-a1f536774eee admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d/groups/43a8d7cb8d0345b2a71f46d3f4509162/roles/f4edd7aabe7e416f95ab6833aa478f07` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.231563 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97d17d-9535-4395-9e65-a1f536774eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9bef98222d5424aa293398d503f422d, group_id=43a8d7cb8d0345b2a71f46d3f4509162, role_id=f4edd7aabe7e416f95ab6833aa478f07)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:00.234204 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97d17d-9535-4395-9e65-a1f536774eee admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:00.238574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 195/387] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:00.251822 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 193/388] 10.222.0.60 () {58 vars in 1463 bytes} [Wed Dec 15 13:19:00 2021] PUT /identity/v3/projects/d9bef98222d5424aa293398d503f422d/groups/43a8d7cb8d0345b2a71f46d3f4509162/roles/f4edd7aabe7e416f95ab6833aa478f07 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:19:00.275497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd46f9d-2237-42c6-b461-8c94f2ff66f5 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.287991 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd46f9d-2237-42c6-b461-8c94f2ff66f5 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.357484 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be50039-652c-4d7d-9bb3-3d5c9cc0d9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.358292 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50039-652c-4d7d-9bb3-3d5c9cc0d9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.358574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50039-652c-4d7d-9bb3-3d5c9cc0d9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.358866 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50039-652c-4d7d-9bb3-3d5c9cc0d9a4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.371839 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be50039-652c-4d7d-9bb3-3d5c9cc0d9a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:00.379236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad1d74-923f-4c32-b4c7-94f847662f47 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.379525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad1d74-923f-4c32-b4c7-94f847662f47 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.379690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-4be50039-652c-4d7d-9bb3-3d5c9cc0d9a4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:19:00.379847 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad1d74-923f-4c32-b4c7-94f847662f47 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.380784 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 196/389] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:00.382217 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 194/390] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:19:00.388156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be50039-652c-4d7d-9bb3-3d5c9cc0d9a4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.390172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589a1d4-eeee-44eb-a474-739e6b5366fd None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.390462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589a1d4-eeee-44eb-a474-739e6b5366fd None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.390741 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589a1d4-eeee-44eb-a474-739e6b5366fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.398825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be50039-652c-4d7d-9bb3-3d5c9cc0d9a4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.407627 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b52f5-ff55-42a3-97dc-62fd16fdfdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.408409 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b52f5-ff55-42a3-97dc-62fd16fdfdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.408702 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b52f5-ff55-42a3-97dc-62fd16fdfdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.409024 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b52f5-ff55-42a3-97dc-62fd16fdfdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.409847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b52f5-ff55-42a3-97dc-62fd16fdfdf3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:00.410156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b52f5-ff55-42a3-97dc-62fd16fdfdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:00.411713 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e589a1d4-eeee-44eb-a474-739e6b5366fd None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:00.411948 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b52f5-ff55-42a3-97dc-62fd16fdfdf3 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:00.412902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e589a1d4-eeee-44eb-a474-739e6b5366fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:00.421518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 195/391] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:00.430743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 197/392] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:19:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:00.437096 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589a1d4-eeee-44eb-a474-739e6b5366fd None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.449642 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589a1d4-eeee-44eb-a474-739e6b5366fd None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.459199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630492d-dd09-4227-b24f-e4661a3786f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.460289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630492d-dd09-4227-b24f-e4661a3786f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.460575 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630492d-dd09-4227-b24f-e4661a3786f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.460898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630492d-dd09-4227-b24f-e4661a3786f7 admin admin] PATH_INFO: `/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.462419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630492d-dd09-4227-b24f-e4661a3786f7 admin admin] RBAC: Authorizing `identity:get_group(group_id=43a8d7cb8d0345b2a71f46d3f4509162)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:00.466350 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630492d-dd09-4227-b24f-e4661a3786f7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:00.468595 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 196/393] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:19:00 2021] GET /identity/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:00.471754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b52f5-ff55-42a3-97dc-62fd16fdfdf3 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.474678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630492d-dd09-4227-b24f-e4661a3786f7 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.485234 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630492d-dd09-4227-b24f-e4661a3786f7 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.490435 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec44a12-70dd-498f-be78-0116c4188302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.491588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec44a12-70dd-498f-be78-0116c4188302 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.491794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec44a12-70dd-498f-be78-0116c4188302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.492073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec44a12-70dd-498f-be78-0116c4188302 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.493399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec44a12-70dd-498f-be78-0116c4188302 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:00.494634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b52f5-ff55-42a3-97dc-62fd16fdfdf3 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.495783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec44a12-70dd-498f-be78-0116c4188302 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:00.497922 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 197/394] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:19:00 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:00.505144 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec44a12-70dd-498f-be78-0116c4188302 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.513016 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09a72f-391c-4ff7-8e3d-864c4482a112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.513862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09a72f-391c-4ff7-8e3d-864c4482a112 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.514578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09a72f-391c-4ff7-8e3d-864c4482a112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.514840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09a72f-391c-4ff7-8e3d-864c4482a112 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.527778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec44a12-70dd-498f-be78-0116c4188302 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.536977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e0d89-510b-4e6d-ab99-a6eee615ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.537867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e0d89-510b-4e6d-ab99-a6eee615ffba admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.539679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e0d89-510b-4e6d-ab99-a6eee615ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.539894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e0d89-510b-4e6d-ab99-a6eee615ffba admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d/groups/43a8d7cb8d0345b2a71f46d3f4509162/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.541732 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09a72f-391c-4ff7-8e3d-864c4482a112 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:00.546489 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e0d89-510b-4e6d-ab99-a6eee615ffba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9bef98222d5424aa293398d503f422d, group_id=43a8d7cb8d0345b2a71f46d3f4509162, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:00.552106 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e0d89-510b-4e6d-ab99-a6eee615ffba admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:00.559920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-0e09a72f-391c-4ff7-8e3d-864c4482a112 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:19:00.561397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 198/395] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:00.568841 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09a72f-391c-4ff7-8e3d-864c4482a112 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.579340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 198/396] 10.222.0.60 () {58 vars in 1463 bytes} [Wed Dec 15 13:19:00 2021] PUT /identity/v3/projects/d9bef98222d5424aa293398d503f422d/groups/43a8d7cb8d0345b2a71f46d3f4509162/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:19:00.590552 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09a72f-391c-4ff7-8e3d-864c4482a112 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.666509 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ad43d-6ebf-41aa-a580-1e47f0286f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.667274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ad43d-6ebf-41aa-a580-1e47f0286f1d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.667561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ad43d-6ebf-41aa-a580-1e47f0286f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.667844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ad43d-6ebf-41aa-a580-1e47f0286f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.668628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ad43d-6ebf-41aa-a580-1e47f0286f1d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:00.669000 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ad43d-6ebf-41aa-a580-1e47f0286f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:00.670901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ad43d-6ebf-41aa-a580-1e47f0286f1d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:00.688796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 199/397] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:19:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:00.692354 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e0d89-510b-4e6d-ab99-a6eee615ffba admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.709543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e0d89-510b-4e6d-ab99-a6eee615ffba admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.716922 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccbd29-e2b2-4f16-b6c2-85389ca48ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.717752 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccbd29-e2b2-4f16-b6c2-85389ca48ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.718086 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccbd29-e2b2-4f16-b6c2-85389ca48ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.718365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccbd29-e2b2-4f16-b6c2-85389ca48ae3 admin admin] PATH_INFO: `/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.719716 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccbd29-e2b2-4f16-b6c2-85389ca48ae3 admin admin] RBAC: Authorizing `identity:get_group(group_id=43a8d7cb8d0345b2a71f46d3f4509162)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:00.722013 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccbd29-e2b2-4f16-b6c2-85389ca48ae3 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:00.724220 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 199/398] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:19:00 2021] GET /identity/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:00.730399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ad43d-6ebf-41aa-a580-1e47f0286f1d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.744226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ad43d-6ebf-41aa-a580-1e47f0286f1d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.753649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3deb5d-c8fa-4ac4-91d5-1468e2b22cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.754927 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3deb5d-c8fa-4ac4-91d5-1468e2b22cbb admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.755428 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3deb5d-c8fa-4ac4-91d5-1468e2b22cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.755918 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3deb5d-c8fa-4ac4-91d5-1468e2b22cbb admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.759724 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3deb5d-c8fa-4ac4-91d5-1468e2b22cbb admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:00.761840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3deb5d-c8fa-4ac4-91d5-1468e2b22cbb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:00.764044 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 200/399] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:19:00 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:00.770229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccbd29-e2b2-4f16-b6c2-85389ca48ae3 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:00.783027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccbd29-e2b2-4f16-b6c2-85389ca48ae3 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:00.788292 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03952c4-7b15-43fb-8d20-69ec63dc58ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:00.789230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03952c4-7b15-43fb-8d20-69ec63dc58ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:00.789509 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03952c4-7b15-43fb-8d20-69ec63dc58ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:00.789779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03952c4-7b15-43fb-8d20-69ec63dc58ca admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f/groups/43a8d7cb8d0345b2a71f46d3f4509162/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:00.791935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03952c4-7b15-43fb-8d20-69ec63dc58ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc4455f0ea9485aac8ec368a026004f, group_id=43a8d7cb8d0345b2a71f46d3f4509162, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:00.794820 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03952c4-7b15-43fb-8d20-69ec63dc58ca admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:00.821281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 200/400] 10.222.0.60 () {58 vars in 1463 bytes} [Wed Dec 15 13:19:00 2021] PUT /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f/groups/43a8d7cb8d0345b2a71f46d3f4509162/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:19:02.058980 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6f1d-a0be-4e32-a09e-99856c27b080 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:02.059515 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6f1d-a0be-4e32-a09e-99856c27b080 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:02.059515 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6f1d-a0be-4e32-a09e-99856c27b080 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:02.061566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 201/401] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:02.076868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc899e-8f9b-4685-bf05-db57aebb0f45 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:02.077334 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc899e-8f9b-4685-bf05-db57aebb0f45 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:02.077433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc899e-8f9b-4685-bf05-db57aebb0f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:02.099844 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-88cc899e-8f9b-4685-bf05-db57aebb0f45 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:02.101029 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-88cc899e-8f9b-4685-bf05-db57aebb0f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:02.170751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 201/402] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:02.216381 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d6f1d-a0be-4e32-a09e-99856c27b080 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:02.230553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d6f1d-a0be-4e32-a09e-99856c27b080 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:02.234828 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b23d7-8106-4c23-ad3b-559cf177476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:02.235652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b23d7-8106-4c23-ad3b-559cf177476b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:02.235929 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b23d7-8106-4c23-ad3b-559cf177476b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:02.236202 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b23d7-8106-4c23-ad3b-559cf177476b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:02.251853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b23d7-8106-4c23-ad3b-559cf177476b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:02.259423 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c72bc5-ee52-4309-a9d8-423280f76df7 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:02.259682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-470b23d7-8106-4c23-ad3b-559cf177476b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:19:02.259796 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c72bc5-ee52-4309-a9d8-423280f76df7 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:02.259976 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c72bc5-ee52-4309-a9d8-423280f76df7 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:02.261085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 202/403] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:19:02 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:02.261745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 202/404] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:02.268103 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b23d7-8106-4c23-ad3b-559cf177476b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:02.272769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a54a0e-65aa-4e6d-a591-298fe532ecd5 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:02.273058 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a54a0e-65aa-4e6d-a591-298fe532ecd5 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:02.273332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a54a0e-65aa-4e6d-a591-298fe532ecd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:02.279855 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b23d7-8106-4c23-ad3b-559cf177476b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:02.285041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9b8c7-62da-4c1d-8c2a-2f2c510e790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:02.285690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9b8c7-62da-4c1d-8c2a-2f2c510e790e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:02.285967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9b8c7-62da-4c1d-8c2a-2f2c510e790e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:02.286244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9b8c7-62da-4c1d-8c2a-2f2c510e790e admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:02.287254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9b8c7-62da-4c1d-8c2a-2f2c510e790e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:02.288432 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9b8c7-62da-4c1d-8c2a-2f2c510e790e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:02.290026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9b8c7-62da-4c1d-8c2a-2f2c510e790e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:02.305749 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a7a54a0e-65aa-4e6d-a591-298fe532ecd5 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:02.306969 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a7a54a0e-65aa-4e6d-a591-298fe532ecd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:02.311722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 203/405] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:02 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:02.321185 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9b8c7-62da-4c1d-8c2a-2f2c510e790e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:02.323793 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 203/406] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:02.336055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9b8c7-62da-4c1d-8c2a-2f2c510e790e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:02.348692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d955e6-cacb-420c-9861-532ab71240b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:02.349929 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a54a0e-65aa-4e6d-a591-298fe532ecd5 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:02.351030 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d955e6-cacb-420c-9861-532ab71240b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:02.355227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d955e6-cacb-420c-9861-532ab71240b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:02.355853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d955e6-cacb-420c-9861-532ab71240b8 admin admin] PATH_INFO: `/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:02.358340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d955e6-cacb-420c-9861-532ab71240b8 admin admin] RBAC: Authorizing `identity:get_group(group_id=43a8d7cb8d0345b2a71f46d3f4509162)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:02.361664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d955e6-cacb-420c-9861-532ab71240b8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:02.370648 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 204/407] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:19:02 2021] GET /identity/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:02.373287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a54a0e-65aa-4e6d-a591-298fe532ecd5 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:02.375783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d955e6-cacb-420c-9861-532ab71240b8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:02.388201 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d955e6-cacb-420c-9861-532ab71240b8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:02.389136 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b6058-bb6e-4f10-af2e-7e241e1a1f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:02.390162 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b6058-bb6e-4f10-af2e-7e241e1a1f3e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:02.390661 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b6058-bb6e-4f10-af2e-7e241e1a1f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:02.391171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b6058-bb6e-4f10-af2e-7e241e1a1f3e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:02.395675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dabac-5f7d-49de-859c-d34c1635894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:02.396622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dabac-5f7d-49de-859c-d34c1635894b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:02.396901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dabac-5f7d-49de-859c-d34c1635894b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:02.397175 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dabac-5f7d-49de-859c-d34c1635894b admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:02.398901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dabac-5f7d-49de-859c-d34c1635894b admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:02.401361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dabac-5f7d-49de-859c-d34c1635894b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:02.405340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 205/408] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:19:02 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:02.416677 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b6058-bb6e-4f10-af2e-7e241e1a1f3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:02.417215 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dabac-5f7d-49de-859c-d34c1635894b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:02.424342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-0d5b6058-bb6e-4f10-af2e-7e241e1a1f3e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:19:02.430882 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dabac-5f7d-49de-859c-d34c1635894b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:02.431183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 204/409] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:19:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:02.435419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b6058-bb6e-4f10-af2e-7e241e1a1f3e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:02.438568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba6baf-9ec1-4acb-85b3-bc4c4e25c2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:02.439556 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6baf-9ec1-4acb-85b3-bc4c4e25c2da admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:02.439841 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6baf-9ec1-4acb-85b3-bc4c4e25c2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:02.440117 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6baf-9ec1-4acb-85b3-bc4c4e25c2da admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f/groups/43a8d7cb8d0345b2a71f46d3f4509162/roles/f4edd7aabe7e416f95ab6833aa478f07` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:02.446883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba6baf-9ec1-4acb-85b3-bc4c4e25c2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc4455f0ea9485aac8ec368a026004f, group_id=43a8d7cb8d0345b2a71f46d3f4509162, role_id=f4edd7aabe7e416f95ab6833aa478f07)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:02.446883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba6baf-9ec1-4acb-85b3-bc4c4e25c2da admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:02.454380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b6058-bb6e-4f10-af2e-7e241e1a1f3e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:02.462240 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabeb7a5-de40-4196-a5e3-cffc3df5a551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:02.465424 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabeb7a5-de40-4196-a5e3-cffc3df5a551 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:02.465932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabeb7a5-de40-4196-a5e3-cffc3df5a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:02.466479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabeb7a5-de40-4196-a5e3-cffc3df5a551 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:02.467657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabeb7a5-de40-4196-a5e3-cffc3df5a551 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:02.468225 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabeb7a5-de40-4196-a5e3-cffc3df5a551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:02.469034 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 206/410] 10.222.0.60 () {58 vars in 1463 bytes} [Wed Dec 15 13:19:02 2021] PUT /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f/groups/43a8d7cb8d0345b2a71f46d3f4509162/roles/f4edd7aabe7e416f95ab6833aa478f07 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:19:02.471484 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabeb7a5-de40-4196-a5e3-cffc3df5a551 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:02.486716 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 205/411] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:02.493512 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba6baf-9ec1-4acb-85b3-bc4c4e25c2da admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:02.583650 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba6baf-9ec1-4acb-85b3-bc4c4e25c2da admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:02.595795 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2642ab-0eee-4290-b4ef-2422daeadb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:02.596725 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2642ab-0eee-4290-b4ef-2422daeadb9d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:02.597009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2642ab-0eee-4290-b4ef-2422daeadb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:02.597287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2642ab-0eee-4290-b4ef-2422daeadb9d admin admin] PATH_INFO: `/v3/groups/d9814215f6d4481b9ab092e8eb16303e` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:02.598801 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2642ab-0eee-4290-b4ef-2422daeadb9d admin admin] RBAC: Authorizing `identity:get_group(group_id=d9814215f6d4481b9ab092e8eb16303e)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:02.600756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2642ab-0eee-4290-b4ef-2422daeadb9d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:02.602438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 207/412] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:19:02 2021] GET /identity/v3/groups/d9814215f6d4481b9ab092e8eb16303e => generated 229 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:02.608820 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabeb7a5-de40-4196-a5e3-cffc3df5a551 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:02.624342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabeb7a5-de40-4196-a5e3-cffc3df5a551 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:02.632796 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a194917-3020-43cc-a38d-1fa96590d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:02.634015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194917-3020-43cc-a38d-1fa96590d3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:02.634545 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194917-3020-43cc-a38d-1fa96590d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:02.635067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194917-3020-43cc-a38d-1fa96590d3f5 admin admin] PATH_INFO: `/v3/projects/b8bb67e688614ccb9ee5454c18356750` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:02.639725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a194917-3020-43cc-a38d-1fa96590d3f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=b8bb67e688614ccb9ee5454c18356750)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:02.641937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a194917-3020-43cc-a38d-1fa96590d3f5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:02.644827 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 206/413] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:19:02 2021] GET /identity/v3/projects/b8bb67e688614ccb9ee5454c18356750 => generated 344 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:02.651439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2642ab-0eee-4290-b4ef-2422daeadb9d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:02.661578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2642ab-0eee-4290-b4ef-2422daeadb9d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:02.671322 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde182e0-54c9-4a1e-be5e-384a0423148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:02.672224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde182e0-54c9-4a1e-be5e-384a0423148a admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:02.672502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde182e0-54c9-4a1e-be5e-384a0423148a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:02.672769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde182e0-54c9-4a1e-be5e-384a0423148a admin admin] PATH_INFO: `/v3/projects/b8bb67e688614ccb9ee5454c18356750/groups/d9814215f6d4481b9ab092e8eb16303e/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:02.676597 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde182e0-54c9-4a1e-be5e-384a0423148a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bb67e688614ccb9ee5454c18356750, group_id=d9814215f6d4481b9ab092e8eb16303e, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:02.679310 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde182e0-54c9-4a1e-be5e-384a0423148a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:02.697845 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 208/414] 10.222.0.60 () {58 vars in 1463 bytes} [Wed Dec 15 13:19:02 2021] PUT /identity/v3/projects/b8bb67e688614ccb9ee5454c18356750/groups/d9814215f6d4481b9ab092e8eb16303e/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:19:03.270446 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9aa47-3eb7-4987-bbc7-519bc7eaf43d None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:03.271509 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9aa47-3eb7-4987-bbc7-519bc7eaf43d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:03.271994 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9aa47-3eb7-4987-bbc7-519bc7eaf43d None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:03.274391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 207/415] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:03.280297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045bf37-d6b4-46e5-be6a-244321ba7416 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:03.280796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045bf37-d6b4-46e5-be6a-244321ba7416 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:03.280893 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045bf37-d6b4-46e5-be6a-244321ba7416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:03.311997 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-9045bf37-d6b4-46e5-be6a-244321ba7416 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:03.313261 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9045bf37-d6b4-46e5-be6a-244321ba7416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:03.388532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 209/416] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:03.426062 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9aa47-3eb7-4987-bbc7-519bc7eaf43d None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:03.444413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9aa47-3eb7-4987-bbc7-519bc7eaf43d None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:03.448747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0b10d-8f60-4561-8b15-8245d26c602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:03.449541 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0b10d-8f60-4561-8b15-8245d26c602f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:03.449821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0b10d-8f60-4561-8b15-8245d26c602f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:03.450092 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0b10d-8f60-4561-8b15-8245d26c602f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:03.461373 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0b10d-8f60-4561-8b15-8245d26c602f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:03.473370 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-bdb0b10d-8f60-4561-8b15-8245d26c602f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:19:03.474602 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 208/417] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:19:03 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:03.480981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045bf37-d6b4-46e5-be6a-244321ba7416 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:03.490438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045bf37-d6b4-46e5-be6a-244321ba7416 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:03.498667 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34eb0d3-9f53-4fc5-ae67-d8e9dee4acce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:03.499393 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eb0d3-9f53-4fc5-ae67-d8e9dee4acce admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:03.499849 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eb0d3-9f53-4fc5-ae67-d8e9dee4acce admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:03.500140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eb0d3-9f53-4fc5-ae67-d8e9dee4acce admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:03.500929 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34eb0d3-9f53-4fc5-ae67-d8e9dee4acce admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:03.501238 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34eb0d3-9f53-4fc5-ae67-d8e9dee4acce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:03.502899 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34eb0d3-9f53-4fc5-ae67-d8e9dee4acce admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:03.515052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 210/418] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:03 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:03.521329 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0b10d-8f60-4561-8b15-8245d26c602f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:03.531551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0b10d-8f60-4561-8b15-8245d26c602f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:03.538782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3a7a7-e586-43a1-8c76-04f345132e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:03.539454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3a7a7-e586-43a1-8c76-04f345132e16 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:03.539735 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3a7a7-e586-43a1-8c76-04f345132e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:03.540012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3a7a7-e586-43a1-8c76-04f345132e16 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:03.549259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3a7a7-e586-43a1-8c76-04f345132e16 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:03.551086 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3a7a7-e586-43a1-8c76-04f345132e16 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:03.564260 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 209/419] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:19:03.570557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34eb0d3-9f53-4fc5-ae67-d8e9dee4acce admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:03.580342 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34eb0d3-9f53-4fc5-ae67-d8e9dee4acce admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:03.587049 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d8bf4-89f9-406c-91b2-45bac25a256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:03.587907 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8bf4-89f9-406c-91b2-45bac25a256d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:03.588182 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8bf4-89f9-406c-91b2-45bac25a256d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:03.588456 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8bf4-89f9-406c-91b2-45bac25a256d admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:03.589670 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d8bf4-89f9-406c-91b2-45bac25a256d admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:03.591733 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d8bf4-89f9-406c-91b2-45bac25a256d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:03.593605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 211/420] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:19:03 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:03.599855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3a7a7-e586-43a1-8c76-04f345132e16 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:03.609021 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3a7a7-e586-43a1-8c76-04f345132e16 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:03.613514 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d02bf-b5ae-46cb-9c0b-6779146d0ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:03.614350 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d02bf-b5ae-46cb-9c0b-6779146d0ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:03.614626 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d02bf-b5ae-46cb-9c0b-6779146d0ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:03.614941 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d02bf-b5ae-46cb-9c0b-6779146d0ec2 admin admin] PATH_INFO: `/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:03.616127 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d02bf-b5ae-46cb-9c0b-6779146d0ec2 admin admin] RBAC: Authorizing `identity:get_group(group_id=43a8d7cb8d0345b2a71f46d3f4509162)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:03.618025 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d02bf-b5ae-46cb-9c0b-6779146d0ec2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:03.619841 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 210/421] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:19:03 2021] GET /identity/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:03.625836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d8bf4-89f9-406c-91b2-45bac25a256d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:03.636852 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d8bf4-89f9-406c-91b2-45bac25a256d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:03.647489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ae98e-f46a-418b-a219-ca1b3f948951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:03.648155 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ae98e-f46a-418b-a219-ca1b3f948951 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:03.648438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ae98e-f46a-418b-a219-ca1b3f948951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:03.648715 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ae98e-f46a-418b-a219-ca1b3f948951 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:03.649570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ae98e-f46a-418b-a219-ca1b3f948951 admin admin] RBAC: Adding query filter params (group.id=43a8d7cb8d0345b2a71f46d3f4509162, role.id=f4edd7aabe7e416f95ab6833aa478f07, scope.project.id=d9bef98222d5424aa293398d503f422d) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:03.649881 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ae98e-f46a-418b-a219-ca1b3f948951 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:03.655587 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ae98e-f46a-418b-a219-ca1b3f948951 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:03.658320 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 212/422] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Dec 15 13:19:03 2021] GET /identity/v3/role_assignments?group.id=43a8d7cb8d0345b2a71f46d3f4509162&scope.project.id=d9bef98222d5424aa293398d503f422d&role.id=f4edd7aabe7e416f95ab6833aa478f07 => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:03.826464 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf0be1-5442-4778-a03b-17655465b0c1 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:03.826648 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf0be1-5442-4778-a03b-17655465b0c1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:03.826953 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf0be1-5442-4778-a03b-17655465b0c1 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:03.829225 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 211/423] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:03.841271 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d883b1-0132-4891-9a5e-96d3dd13d32e None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:03.841592 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d883b1-0132-4891-9a5e-96d3dd13d32e None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:03.841836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d883b1-0132-4891-9a5e-96d3dd13d32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:03.864829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-34d883b1-0132-4891-9a5e-96d3dd13d32e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:03.866035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-34d883b1-0132-4891-9a5e-96d3dd13d32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:03.878804 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 213/424] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:03.915657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf0be1-5442-4778-a03b-17655465b0c1 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:03.932807 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf0be1-5442-4778-a03b-17655465b0c1 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:03.943829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb81b11-b0de-460c-b87b-09a1dff83271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:03.944633 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81b11-b0de-460c-b87b-09a1dff83271 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:03.944912 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81b11-b0de-460c-b87b-09a1dff83271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:03.945185 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81b11-b0de-460c-b87b-09a1dff83271 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:03.957649 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb81b11-b0de-460c-b87b-09a1dff83271 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:03.969006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-cbb81b11-b0de-460c-b87b-09a1dff83271 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:19:03.970601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 212/425] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:03.976620 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d883b1-0132-4891-9a5e-96d3dd13d32e None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:03.986175 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d883b1-0132-4891-9a5e-96d3dd13d32e None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:03.998017 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274afc5-483f-43d1-9763-757516881dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:03.998702 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274afc5-483f-43d1-9763-757516881dfc admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:03.999015 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274afc5-483f-43d1-9763-757516881dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:03.999295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274afc5-483f-43d1-9763-757516881dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:04.000077 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274afc5-483f-43d1-9763-757516881dfc admin admin] RBAC: Adding query filter params (name=member) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:04.000401 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274afc5-483f-43d1-9763-757516881dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:04.001986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274afc5-483f-43d1-9763-757516881dfc admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:04.017613 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 214/426] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:19:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:04.023006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee4c02-f9e9-4924-a97a-6f1a3502ee85 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:04.023477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee4c02-f9e9-4924-a97a-6f1a3502ee85 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:04.023639 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee4c02-f9e9-4924-a97a-6f1a3502ee85 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:04.024311 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274afc5-483f-43d1-9763-757516881dfc admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:04.025556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 213/427] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:04.031806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc0054-d7f9-4e2b-a078-a14e318c092b None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:04.032095 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc0054-d7f9-4e2b-a078-a14e318c092b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:04.032367 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc0054-d7f9-4e2b-a078-a14e318c092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:04.039268 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274afc5-483f-43d1-9763-757516881dfc admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:04.044544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bec5a8-b90f-469d-8568-0bb40fd84de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:04.045599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec5a8-b90f-469d-8568-0bb40fd84de9 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:04.046097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec5a8-b90f-469d-8568-0bb40fd84de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:04.047000 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec5a8-b90f-469d-8568-0bb40fd84de9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:04.056403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bec5a8-b90f-469d-8568-0bb40fd84de9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:04.058568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bec5a8-b90f-469d-8568-0bb40fd84de9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:04.068023 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-92fc0054-d7f9-4e2b-a078-a14e318c092b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:04.069262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-92fc0054-d7f9-4e2b-a078-a14e318c092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:04.072045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 215/428] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:19:04.078398 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bec5a8-b90f-469d-8568-0bb40fd84de9 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:04.088395 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 214/429] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:04.092937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bec5a8-b90f-469d-8568-0bb40fd84de9 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:04.103504 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232f686-1c14-4774-92b8-fce6b59fbc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:04.104367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232f686-1c14-4774-92b8-fce6b59fbc67 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:04.104652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232f686-1c14-4774-92b8-fce6b59fbc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:04.104931 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232f686-1c14-4774-92b8-fce6b59fbc67 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:04.106612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232f686-1c14-4774-92b8-fce6b59fbc67 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:04.109677 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232f686-1c14-4774-92b8-fce6b59fbc67 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:04.112876 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 216/430] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:19:04 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:04.113775 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc0054-d7f9-4e2b-a078-a14e318c092b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:04.118563 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232f686-1c14-4774-92b8-fce6b59fbc67 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:04.131470 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc0054-d7f9-4e2b-a078-a14e318c092b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:04.133251 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232f686-1c14-4774-92b8-fce6b59fbc67 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:04.137952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc1d99-033b-4663-9110-a9c942ba3a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:04.138500 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdd6df-f45c-4244-b6df-47db0898cb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:04.138800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1d99-033b-4663-9110-a9c942ba3a89 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:04.139116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1d99-033b-4663-9110-a9c942ba3a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:04.139397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1d99-033b-4663-9110-a9c942ba3a89 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:04.139582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdd6df-f45c-4244-b6df-47db0898cb24 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:04.139727 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdd6df-f45c-4244-b6df-47db0898cb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:04.140045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdd6df-f45c-4244-b6df-47db0898cb24 admin admin] PATH_INFO: `/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:04.141329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdd6df-f45c-4244-b6df-47db0898cb24 admin admin] RBAC: Authorizing `identity:get_group(group_id=43a8d7cb8d0345b2a71f46d3f4509162)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:04.143297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdd6df-f45c-4244-b6df-47db0898cb24 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:04.145860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 217/431] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:19:04 2021] GET /identity/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:04.153393 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdd6df-f45c-4244-b6df-47db0898cb24 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:04.161731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc1d99-033b-4663-9110-a9c942ba3a89 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:04.164923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdd6df-f45c-4244-b6df-47db0898cb24 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:04.169501 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d22610-7326-4ab2-92da-323a94be3a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:04.170154 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d22610-7326-4ab2-92da-323a94be3a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:04.170436 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d22610-7326-4ab2-92da-323a94be3a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:04.170712 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d22610-7326-4ab2-92da-323a94be3a36 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:04.172027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-41cc1d99-033b-4663-9110-a9c942ba3a89 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:19:04.172378 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d22610-7326-4ab2-92da-323a94be3a36 admin admin] RBAC: Adding query filter params (group.id=43a8d7cb8d0345b2a71f46d3f4509162, role.id=e734a22c1b2c40feb0147271d002bdee, scope.project.id=d9bef98222d5424aa293398d503f422d) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:04.172789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d22610-7326-4ab2-92da-323a94be3a36 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:04.173603 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 215/432] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:04 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:04.176712 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d22610-7326-4ab2-92da-323a94be3a36 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:04.180305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc1d99-033b-4663-9110-a9c942ba3a89 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:04.192517 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 218/433] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Dec 15 13:19:04 2021] GET /identity/v3/role_assignments?group.id=43a8d7cb8d0345b2a71f46d3f4509162&scope.project.id=d9bef98222d5424aa293398d503f422d&role.id=e734a22c1b2c40feb0147271d002bdee => generated 611 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:04.194043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc1d99-033b-4663-9110-a9c942ba3a89 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:04.198822 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3778b75-942a-4a08-b6bf-f822109f14ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:04.199608 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3778b75-942a-4a08-b6bf-f822109f14ea admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:04.199889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3778b75-942a-4a08-b6bf-f822109f14ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:04.200167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3778b75-942a-4a08-b6bf-f822109f14ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:04.201027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3778b75-942a-4a08-b6bf-f822109f14ea admin admin] RBAC: Adding query filter params (name=member) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:04.201340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3778b75-942a-4a08-b6bf-f822109f14ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:04.203263 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3778b75-942a-4a08-b6bf-f822109f14ea admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:04.214237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 216/434] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:19:04 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:04.220644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d22610-7326-4ab2-92da-323a94be3a36 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:04.233276 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d22610-7326-4ab2-92da-323a94be3a36 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:04.238681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434daa83-9a01-457a-81e7-ee68dba18967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:04.239434 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434daa83-9a01-457a-81e7-ee68dba18967 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:04.239719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434daa83-9a01-457a-81e7-ee68dba18967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:04.239995 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434daa83-9a01-457a-81e7-ee68dba18967 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:04.249256 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434daa83-9a01-457a-81e7-ee68dba18967 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:04.251168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434daa83-9a01-457a-81e7-ee68dba18967 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:04.262973 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 219/435] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:19:04.269110 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3778b75-942a-4a08-b6bf-f822109f14ea admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:04.280709 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3778b75-942a-4a08-b6bf-f822109f14ea admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:04.289780 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd29a4-fc45-4a13-a669-3b9384e61792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:04.290721 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd29a4-fc45-4a13-a669-3b9384e61792 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:04.291079 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd29a4-fc45-4a13-a669-3b9384e61792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:04.291362 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd29a4-fc45-4a13-a669-3b9384e61792 admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:04.292699 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd29a4-fc45-4a13-a669-3b9384e61792 admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:04.294870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd29a4-fc45-4a13-a669-3b9384e61792 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:04.297201 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 217/436] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:19:04 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:04.303832 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434daa83-9a01-457a-81e7-ee68dba18967 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:04.316605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434daa83-9a01-457a-81e7-ee68dba18967 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:04.323238 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdf618-1ba3-4aad-aedc-eed72d4cb0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:04.324177 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdf618-1ba3-4aad-aedc-eed72d4cb0ce admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:04.324458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdf618-1ba3-4aad-aedc-eed72d4cb0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:04.324736 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdf618-1ba3-4aad-aedc-eed72d4cb0ce admin admin] PATH_INFO: `/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:04.325996 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdf618-1ba3-4aad-aedc-eed72d4cb0ce admin admin] RBAC: Authorizing `identity:get_group(group_id=43a8d7cb8d0345b2a71f46d3f4509162)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:04.328031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdf618-1ba3-4aad-aedc-eed72d4cb0ce admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:04.331401 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 220/437] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:19:04 2021] GET /identity/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:04.336926 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd29a4-fc45-4a13-a669-3b9384e61792 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:04.348114 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd29a4-fc45-4a13-a669-3b9384e61792 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:04.353346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0f176-1262-4c4e-a398-6190611d91ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:04.354060 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0f176-1262-4c4e-a398-6190611d91ef admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:04.354347 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0f176-1262-4c4e-a398-6190611d91ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:04.354623 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0f176-1262-4c4e-a398-6190611d91ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:04.355618 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0f176-1262-4c4e-a398-6190611d91ef admin admin] RBAC: Adding query filter params (group.id=43a8d7cb8d0345b2a71f46d3f4509162, role.id=e734a22c1b2c40feb0147271d002bdee, scope.project.id=8dc4455f0ea9485aac8ec368a026004f) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:04.355939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0f176-1262-4c4e-a398-6190611d91ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:04.357938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0f176-1262-4c4e-a398-6190611d91ef admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:04.371043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 218/438] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Dec 15 13:19:04 2021] GET /identity/v3/role_assignments?group.id=43a8d7cb8d0345b2a71f46d3f4509162&scope.project.id=8dc4455f0ea9485aac8ec368a026004f&role.id=e734a22c1b2c40feb0147271d002bdee => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:05.438709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f3d98-1e00-470e-8d4c-e92c968adef6 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.439286 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f3d98-1e00-470e-8d4c-e92c968adef6 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.439286 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f3d98-1e00-470e-8d4c-e92c968adef6 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.441765 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 221/439] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:05.447180 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f242384-1b50-4329-b440-06d272b9d152 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.447569 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f242384-1b50-4329-b440-06d272b9d152 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.447738 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f242384-1b50-4329-b440-06d272b9d152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.465920 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-5f242384-1b50-4329-b440-06d272b9d152 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:05.467137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5f242384-1b50-4329-b440-06d272b9d152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:05.474592 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 219/440] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:05.498153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f3d98-1e00-470e-8d4c-e92c968adef6 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:05.510820 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f3d98-1e00-470e-8d4c-e92c968adef6 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:05.515111 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57feb7d4-6aa6-4c23-91c6-2b1a12b95c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:05.515895 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57feb7d4-6aa6-4c23-91c6-2b1a12b95c87 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.516179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57feb7d4-6aa6-4c23-91c6-2b1a12b95c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.516455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57feb7d4-6aa6-4c23-91c6-2b1a12b95c87 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.527495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57feb7d4-6aa6-4c23-91c6-2b1a12b95c87 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:05.534618 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-57feb7d4-6aa6-4c23-91c6-2b1a12b95c87 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:19:05.535781 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 222/441] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:19:05 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:05.546930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f242384-1b50-4329-b440-06d272b9d152 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:05.556467 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f242384-1b50-4329-b440-06d272b9d152 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:05.560839 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a473fd1-c21a-4a5b-a04b-39ad6126c283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:05.561497 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a473fd1-c21a-4a5b-a04b-39ad6126c283 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.561782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a473fd1-c21a-4a5b-a04b-39ad6126c283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.562059 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a473fd1-c21a-4a5b-a04b-39ad6126c283 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.563574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a473fd1-c21a-4a5b-a04b-39ad6126c283 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:05.563574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a473fd1-c21a-4a5b-a04b-39ad6126c283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:05.564758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a473fd1-c21a-4a5b-a04b-39ad6126c283 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:05.575013 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 220/442] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:05 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:05.580931 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57feb7d4-6aa6-4c23-91c6-2b1a12b95c87 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:05.591251 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57feb7d4-6aa6-4c23-91c6-2b1a12b95c87 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:05.595517 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca7035-f116-4fb5-8834-fd52dd2a402f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:05.596140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7035-f116-4fb5-8834-fd52dd2a402f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.596423 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7035-f116-4fb5-8834-fd52dd2a402f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.596701 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7035-f116-4fb5-8834-fd52dd2a402f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.604300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca7035-f116-4fb5-8834-fd52dd2a402f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:05.606061 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca7035-f116-4fb5-8834-fd52dd2a402f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:05.614537 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 223/443] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:19:05.620359 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a473fd1-c21a-4a5b-a04b-39ad6126c283 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:05.630392 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a473fd1-c21a-4a5b-a04b-39ad6126c283 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:05.634685 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d238fd7-75c1-4a02-91da-8a1a238189cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:05.635551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238fd7-75c1-4a02-91da-8a1a238189cc admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.635834 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238fd7-75c1-4a02-91da-8a1a238189cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.636107 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238fd7-75c1-4a02-91da-8a1a238189cc admin admin] PATH_INFO: `/v3/projects/8dc4455f0ea9485aac8ec368a026004f` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.637295 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d238fd7-75c1-4a02-91da-8a1a238189cc admin admin] RBAC: Authorizing `identity:get_project(project_id=8dc4455f0ea9485aac8ec368a026004f)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:05.639411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d238fd7-75c1-4a02-91da-8a1a238189cc admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:05.641088 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 221/444] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:19:05 2021] GET /identity/v3/projects/8dc4455f0ea9485aac8ec368a026004f => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:05.647494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca7035-f116-4fb5-8834-fd52dd2a402f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:05.658510 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca7035-f116-4fb5-8834-fd52dd2a402f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:05.663038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc17ea7-a6ab-4f9b-a112-10abfb20f500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:05.663877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc17ea7-a6ab-4f9b-a112-10abfb20f500 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.664158 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc17ea7-a6ab-4f9b-a112-10abfb20f500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.664430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc17ea7-a6ab-4f9b-a112-10abfb20f500 admin admin] PATH_INFO: `/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.665612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc17ea7-a6ab-4f9b-a112-10abfb20f500 admin admin] RBAC: Authorizing `identity:get_group(group_id=43a8d7cb8d0345b2a71f46d3f4509162)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:05.667542 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc17ea7-a6ab-4f9b-a112-10abfb20f500 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:05.669131 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 224/445] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:19:05 2021] GET /identity/v3/groups/43a8d7cb8d0345b2a71f46d3f4509162 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:05.676100 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d238fd7-75c1-4a02-91da-8a1a238189cc admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:05.685850 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d238fd7-75c1-4a02-91da-8a1a238189cc admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:05.690242 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e10b71-f246-4b95-bd54-11ac96a3e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:05.691478 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e10b71-f246-4b95-bd54-11ac96a3e368 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.691769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e10b71-f246-4b95-bd54-11ac96a3e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.692046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e10b71-f246-4b95-bd54-11ac96a3e368 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.692900 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e10b71-f246-4b95-bd54-11ac96a3e368 admin admin] RBAC: Adding query filter params (group.id=43a8d7cb8d0345b2a71f46d3f4509162, role.id=f4edd7aabe7e416f95ab6833aa478f07, scope.project.id=8dc4455f0ea9485aac8ec368a026004f) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:05.693208 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e10b71-f246-4b95-bd54-11ac96a3e368 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:05.695081 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e10b71-f246-4b95-bd54-11ac96a3e368 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:05.701393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 222/446] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Dec 15 13:19:05 2021] GET /identity/v3/role_assignments?group.id=43a8d7cb8d0345b2a71f46d3f4509162&scope.project.id=8dc4455f0ea9485aac8ec368a026004f&role.id=f4edd7aabe7e416f95ab6833aa478f07 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:05.709401 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802984ef-89d2-4b07-8103-2f665110986c None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.709689 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802984ef-89d2-4b07-8103-2f665110986c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.709962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802984ef-89d2-4b07-8103-2f665110986c None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.711821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 225/447] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:05.718555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff3c75-b3d7-4f78-8251-28197b0a0001 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.718852 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff3c75-b3d7-4f78-8251-28197b0a0001 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.719145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff3c75-b3d7-4f78-8251-28197b0a0001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.740580 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-99ff3c75-b3d7-4f78-8251-28197b0a0001 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:05.741995 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-99ff3c75-b3d7-4f78-8251-28197b0a0001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:05.749648 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 223/448] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:05.778880 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802984ef-89d2-4b07-8103-2f665110986c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:05.795842 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802984ef-89d2-4b07-8103-2f665110986c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:05.803188 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889653aa-7973-470a-8d55-03909ec1bd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:05.805125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889653aa-7973-470a-8d55-03909ec1bd40 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.805410 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889653aa-7973-470a-8d55-03909ec1bd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.805691 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889653aa-7973-470a-8d55-03909ec1bd40 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.818093 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889653aa-7973-470a-8d55-03909ec1bd40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:05.828775 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-889653aa-7973-470a-8d55-03909ec1bd40 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:19:05.830046 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 226/449] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:19:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:05.837157 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff3c75-b3d7-4f78-8251-28197b0a0001 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:05.847449 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff3c75-b3d7-4f78-8251-28197b0a0001 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:05.852855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5dcfb-9ef0-470c-b111-c38aab2a58b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:05.853531 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5dcfb-9ef0-470c-b111-c38aab2a58b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.853810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5dcfb-9ef0-470c-b111-c38aab2a58b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.854084 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5dcfb-9ef0-470c-b111-c38aab2a58b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.854894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5dcfb-9ef0-470c-b111-c38aab2a58b1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:05.855207 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5dcfb-9ef0-470c-b111-c38aab2a58b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:05.856851 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5dcfb-9ef0-470c-b111-c38aab2a58b1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:05.867072 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 224/450] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:05.873779 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889653aa-7973-470a-8d55-03909ec1bd40 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:05.885080 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889653aa-7973-470a-8d55-03909ec1bd40 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:05.889511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b381237-8288-4ae2-8107-745018b88487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:05.890177 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b381237-8288-4ae2-8107-745018b88487 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.890462 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b381237-8288-4ae2-8107-745018b88487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.890744 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b381237-8288-4ae2-8107-745018b88487 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.900080 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b381237-8288-4ae2-8107-745018b88487 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:05.901894 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b381237-8288-4ae2-8107-745018b88487 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:05.911459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 227/451] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:19:05.918181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5dcfb-9ef0-470c-b111-c38aab2a58b1 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:05.928771 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5dcfb-9ef0-470c-b111-c38aab2a58b1 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:05.933227 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71907dc4-49ab-44eb-b860-23dbd08e749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:05.934060 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71907dc4-49ab-44eb-b860-23dbd08e749c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.934345 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71907dc4-49ab-44eb-b860-23dbd08e749c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.934621 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71907dc4-49ab-44eb-b860-23dbd08e749c admin admin] PATH_INFO: `/v3/projects/b8bb67e688614ccb9ee5454c18356750` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.935876 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71907dc4-49ab-44eb-b860-23dbd08e749c admin admin] RBAC: Authorizing `identity:get_project(project_id=b8bb67e688614ccb9ee5454c18356750)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:05.937687 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71907dc4-49ab-44eb-b860-23dbd08e749c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:05.939427 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 225/452] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:19:05 2021] GET /identity/v3/projects/b8bb67e688614ccb9ee5454c18356750 => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:05.946473 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b381237-8288-4ae2-8107-745018b88487 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:05.955468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b381237-8288-4ae2-8107-745018b88487 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:05.960174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b7076-340f-47d5-8a6d-a0f1468c1d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:05.960998 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b7076-340f-47d5-8a6d-a0f1468c1d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.961285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b7076-340f-47d5-8a6d-a0f1468c1d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.961566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b7076-340f-47d5-8a6d-a0f1468c1d9c admin admin] PATH_INFO: `/v3/groups/d9814215f6d4481b9ab092e8eb16303e` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.963022 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b7076-340f-47d5-8a6d-a0f1468c1d9c admin admin] RBAC: Authorizing `identity:get_group(group_id=d9814215f6d4481b9ab092e8eb16303e)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:05.964938 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b7076-340f-47d5-8a6d-a0f1468c1d9c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:05.966747 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 228/453] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Dec 15 13:19:05 2021] GET /identity/v3/groups/d9814215f6d4481b9ab092e8eb16303e => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:05.973075 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71907dc4-49ab-44eb-b860-23dbd08e749c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:05.983874 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71907dc4-49ab-44eb-b860-23dbd08e749c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:05.988835 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ef53d-297a-42b9-bae1-cb1fa70cc7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:05.989483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ef53d-297a-42b9-bae1-cb1fa70cc7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:05.989758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ef53d-297a-42b9-bae1-cb1fa70cc7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:05.990031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ef53d-297a-42b9-bae1-cb1fa70cc7e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:05.991043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ef53d-297a-42b9-bae1-cb1fa70cc7e0 admin admin] RBAC: Adding query filter params (group.id=d9814215f6d4481b9ab092e8eb16303e, role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=b8bb67e688614ccb9ee5454c18356750) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:05.991354 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ef53d-297a-42b9-bae1-cb1fa70cc7e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:05.993283 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ef53d-297a-42b9-bae1-cb1fa70cc7e0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:05.999950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 226/454] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Dec 15 13:19:05 2021] GET /identity/v3/role_assignments?group.id=d9814215f6d4481b9ab092e8eb16303e&scope.project.id=b8bb67e688614ccb9ee5454c18356750&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:08.834392 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17505a-8c75-4ea7-8871-f89e6fa65d74 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:08.834925 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17505a-8c75-4ea7-8871-f89e6fa65d74 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:08.835035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17505a-8c75-4ea7-8871-f89e6fa65d74 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:08.836987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 229/455] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:08.843005 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30520-5b2f-4af8-88a5-404638c02176 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:08.843408 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30520-5b2f-4af8-88a5-404638c02176 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:08.843572 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30520-5b2f-4af8-88a5-404638c02176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:08.867137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-17e30520-5b2f-4af8-88a5-404638c02176 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:08.868328 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-17e30520-5b2f-4af8-88a5-404638c02176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:08.880053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 227/456] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:08.916344 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17505a-8c75-4ea7-8871-f89e6fa65d74 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:08.935505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17505a-8c75-4ea7-8871-f89e6fa65d74 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:08.939979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b620-1fcd-4b88-b584-d1db706e66f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:08.940824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b620-1fcd-4b88-b584-d1db706e66f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:08.941053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b620-1fcd-4b88-b584-d1db706e66f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:08.941900 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b620-1fcd-4b88-b584-d1db706e66f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:08.952956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070b620-1fcd-4b88-b584-d1db706e66f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:08.954808 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070b620-1fcd-4b88-b584-d1db706e66f6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:08.961544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27ebf5-6ea7-466e-a6b1-019ac8344771 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:08.961832 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27ebf5-6ea7-466e-a6b1-019ac8344771 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:08.962113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27ebf5-6ea7-466e-a6b1-019ac8344771 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:08.964153 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 228/457] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:08.969785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a56c3-4913-4bc1-8fd8-e732de0cc5cc None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:08.970073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a56c3-4913-4bc1-8fd8-e732de0cc5cc None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:08.970360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a56c3-4913-4bc1-8fd8-e732de0cc5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:08.979186 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-c070b620-1fcd-4b88-b584-d1db706e66f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:08.980924 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 230/458] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:08.995692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b620-1fcd-4b88-b584-d1db706e66f6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:09.006051 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b620-1fcd-4b88-b584-d1db706e66f6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:09.007976 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-777a56c3-4913-4bc1-8fd8-e732de0cc5cc None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:09.009165 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-777a56c3-4913-4bc1-8fd8-e732de0cc5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:09.015370 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d40c08-8fc7-4088-8398-de56081e9136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:09.016058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40c08-8fc7-4088-8398-de56081e9136 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:09.016320 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40c08-8fc7-4088-8398-de56081e9136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:09.016594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40c08-8fc7-4088-8398-de56081e9136 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:09.017332 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40c08-8fc7-4088-8398-de56081e9136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:09.017638 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40c08-8fc7-4088-8398-de56081e9136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:09.018652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-42d40c08-8fc7-4088-8398-de56081e9136 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:09.018652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:19:09.018652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:19:09.020086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40c08-8fc7-4088-8398-de56081e9136 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:09.029080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 229/459] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:19:09.044395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 231/460] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:09.050241 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a56c3-4913-4bc1-8fd8-e732de0cc5cc None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:09.059826 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a56c3-4913-4bc1-8fd8-e732de0cc5cc None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:09.067375 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5296b-9096-417f-9495-98e29ce13883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:09.067971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d40c08-8fc7-4088-8398-de56081e9136 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:09.068524 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5296b-9096-417f-9495-98e29ce13883 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:09.069136 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5296b-9096-417f-9495-98e29ce13883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:09.069618 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5296b-9096-417f-9495-98e29ce13883 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:09.070539 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5296b-9096-417f-9495-98e29ce13883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:09.072672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5296b-9096-417f-9495-98e29ce13883 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:09.077696 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d40c08-8fc7-4088-8398-de56081e9136 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:09.083841 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312e6ea-d733-42e0-b436-530876ff79ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:09.084673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e6ea-d733-42e0-b436-530876ff79ca admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:09.084778 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e6ea-d733-42e0-b436-530876ff79ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:09.085012 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e6ea-d733-42e0-b436-530876ff79ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:09.096328 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312e6ea-d733-42e0-b436-530876ff79ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:09.098417 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312e6ea-d733-42e0-b436-530876ff79ca admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:09.107652 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 230/461] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:19:09 2021] POST /identity/v3/users => generated 246 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:09.117286 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-e312e6ea-d733-42e0-b436-530876ff79ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:09.118583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 232/462] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:09.125365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5296b-9096-417f-9495-98e29ce13883 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:09.136425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5296b-9096-417f-9495-98e29ce13883 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:09.141177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87dfbf-13aa-4c75-9d99-e96de4fa9ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:09.141912 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87dfbf-13aa-4c75-9d99-e96de4fa9ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:09.142194 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87dfbf-13aa-4c75-9d99-e96de4fa9ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:09.142460 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87dfbf-13aa-4c75-9d99-e96de4fa9ef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:09.143297 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87dfbf-13aa-4c75-9d99-e96de4fa9ef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:09.143621 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87dfbf-13aa-4c75-9d99-e96de4fa9ef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:09.146604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87dfbf-13aa-4c75-9d99-e96de4fa9ef2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:09.162989 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 231/463] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:09.165673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312e6ea-d733-42e0-b436-530876ff79ca admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:09.177687 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312e6ea-d733-42e0-b436-530876ff79ca admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:09.178945 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe523d9-82fa-42e1-b267-0b6620326418 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:09.179237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe523d9-82fa-42e1-b267-0b6620326418 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:09.179515 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe523d9-82fa-42e1-b267-0b6620326418 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:09.181363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 232/464] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:09.185682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed8e8e-74eb-49be-857e-d85f3a2d9842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:09.186507 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed8e8e-74eb-49be-857e-d85f3a2d9842 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:09.186795 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed8e8e-74eb-49be-857e-d85f3a2d9842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:09.188492 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b1c9a-da0d-4572-9924-74be7dc2e85c None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:09.188774 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b1c9a-da0d-4572-9924-74be7dc2e85c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:09.189050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b1c9a-da0d-4572-9924-74be7dc2e85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:09.190712 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed8e8e-74eb-49be-857e-d85f3a2d9842 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:09.192767 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed8e8e-74eb-49be-857e-d85f3a2d9842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:09.195519 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed8e8e-74eb-49be-857e-d85f3a2d9842 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:09.225959 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-116b1c9a-da0d-4572-9924-74be7dc2e85c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:09.229224 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-116b1c9a-da0d-4572-9924-74be7dc2e85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:09.234478 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 233/465] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:19:09 2021] POST /identity/v3/users => generated 248 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:09.245973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 233/466] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:09.292322 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed8e8e-74eb-49be-857e-d85f3a2d9842 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:09.304032 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed8e8e-74eb-49be-857e-d85f3a2d9842 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:09.311801 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43199a7b-a9e8-4c29-9a29-6a80c4a273f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:09.312628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43199a7b-a9e8-4c29-9a29-6a80c4a273f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:09.312913 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43199a7b-a9e8-4c29-9a29-6a80c4a273f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:09.313189 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43199a7b-a9e8-4c29-9a29-6a80c4a273f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:09.332686 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43199a7b-a9e8-4c29-9a29-6a80c4a273f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:09.334651 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43199a7b-a9e8-4c29-9a29-6a80c4a273f4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:09.355802 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-43199a7b-a9e8-4c29-9a29-6a80c4a273f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:09.357257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 234/467] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:09.363790 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b1c9a-da0d-4572-9924-74be7dc2e85c None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:09.373215 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b1c9a-da0d-4572-9924-74be7dc2e85c None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:09.377913 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c67dd7-f6b1-4ceb-b7bf-cb1ba5e2a767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:09.378609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67dd7-f6b1-4ceb-b7bf-cb1ba5e2a767 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:09.379463 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67dd7-f6b1-4ceb-b7bf-cb1ba5e2a767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:09.379745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67dd7-f6b1-4ceb-b7bf-cb1ba5e2a767 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:09.380521 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c67dd7-f6b1-4ceb-b7bf-cb1ba5e2a767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:09.380830 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c67dd7-f6b1-4ceb-b7bf-cb1ba5e2a767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:09.382489 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c67dd7-f6b1-4ceb-b7bf-cb1ba5e2a767 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:09.396253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 234/468] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:09.404004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43199a7b-a9e8-4c29-9a29-6a80c4a273f4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:09.415737 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43199a7b-a9e8-4c29-9a29-6a80c4a273f4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:09.420654 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499405e-42f4-4608-865c-ec92aeb0ab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:09.421410 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499405e-42f4-4608-865c-ec92aeb0ab7c admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:09.421690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499405e-42f4-4608-865c-ec92aeb0ab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:09.422027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499405e-42f4-4608-865c-ec92aeb0ab7c admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:09.423141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499405e-42f4-4608-865c-ec92aeb0ab7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:09.425288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499405e-42f4-4608-865c-ec92aeb0ab7c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:09.450892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 235/469] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:19:09 2021] POST /identity/v3/users => generated 248 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:09.859208 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8419ff6-f3b4-43c2-bf1d-d5354371fc79 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:09.859714 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8419ff6-f3b4-43c2-bf1d-d5354371fc79 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:09.859787 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8419ff6-f3b4-43c2-bf1d-d5354371fc79 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:09.861789 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 235/470] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:09.868571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d12a1-785a-4012-b68b-5f74e8a2a871 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:09.868991 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d12a1-785a-4012-b68b-5f74e8a2a871 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:09.869164 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d12a1-785a-4012-b68b-5f74e8a2a871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:09.891980 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-789d12a1-785a-4012-b68b-5f74e8a2a871 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:09.893185 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-789d12a1-785a-4012-b68b-5f74e8a2a871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:09.906065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 236/471] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:09.940597 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8419ff6-f3b4-43c2-bf1d-d5354371fc79 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:09.953140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8419ff6-f3b4-43c2-bf1d-d5354371fc79 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:09.963541 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a2923-6071-4013-b029-265ffa84df82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:09.964332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2923-6071-4013-b029-265ffa84df82 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:09.964612 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2923-6071-4013-b029-265ffa84df82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:09.964888 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2923-6071-4013-b029-265ffa84df82 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:09.982379 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a2923-6071-4013-b029-265ffa84df82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:09.984323 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a2923-6071-4013-b029-265ffa84df82 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:10.004786 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-001a2923-6071-4013-b029-265ffa84df82 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:10.011158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 236/472] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:10.012150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d12a1-785a-4012-b68b-5f74e8a2a871 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:10.033195 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d12a1-785a-4012-b68b-5f74e8a2a871 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:10.048616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39151659-83c0-4e1b-b76d-7eaeec3b0cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:10.049281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39151659-83c0-4e1b-b76d-7eaeec3b0cdc admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:10.049564 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39151659-83c0-4e1b-b76d-7eaeec3b0cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:10.049841 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39151659-83c0-4e1b-b76d-7eaeec3b0cdc admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:10.050587 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39151659-83c0-4e1b-b76d-7eaeec3b0cdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:10.051479 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39151659-83c0-4e1b-b76d-7eaeec3b0cdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:10.053089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39151659-83c0-4e1b-b76d-7eaeec3b0cdc admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:10.072036 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 237/473] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:10.077886 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a2923-6071-4013-b029-265ffa84df82 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:10.090662 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a2923-6071-4013-b029-265ffa84df82 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:10.101297 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970643c6-b09f-45c7-adc5-8bda5a8535b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:10.101967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970643c6-b09f-45c7-adc5-8bda5a8535b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:10.102250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970643c6-b09f-45c7-adc5-8bda5a8535b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:10.102582 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970643c6-b09f-45c7-adc5-8bda5a8535b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:10.103353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970643c6-b09f-45c7-adc5-8bda5a8535b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:10.105425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970643c6-b09f-45c7-adc5-8bda5a8535b1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:10.138177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 237/474] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:19:10 2021] POST /identity/v3/users => generated 249 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:10.706236 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b874056-772b-4ad2-8f0b-e647bd5d5a3c None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:10.706879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b874056-772b-4ad2-8f0b-e647bd5d5a3c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:10.708004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b874056-772b-4ad2-8f0b-e647bd5d5a3c None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:10.710249 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 238/475] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:10.715976 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ff95-9387-4ea6-8c8c-2f9c98c573dc None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:10.716554 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ff95-9387-4ea6-8c8c-2f9c98c573dc None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:10.717020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ff95-9387-4ea6-8c8c-2f9c98c573dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:10.735671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-3556ff95-9387-4ea6-8c8c-2f9c98c573dc None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:10.737192 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-3556ff95-9387-4ea6-8c8c-2f9c98c573dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:10.750526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 238/476] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:10.776839 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b874056-772b-4ad2-8f0b-e647bd5d5a3c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:10.790066 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b874056-772b-4ad2-8f0b-e647bd5d5a3c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:10.796970 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83ca50-4992-42d5-8846-e5e2ad437410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:10.797904 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83ca50-4992-42d5-8846-e5e2ad437410 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:10.798185 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83ca50-4992-42d5-8846-e5e2ad437410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:10.798460 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83ca50-4992-42d5-8846-e5e2ad437410 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:10.799403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83ca50-4992-42d5-8846-e5e2ad437410 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:10.800438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-1a83ca50-4992-42d5-8846-e5e2ad437410 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:10.800438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:19:10.800438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:19:10.801359 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83ca50-4992-42d5-8846-e5e2ad437410 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:10.810289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.sql.core [None req-1a83ca50-4992-42d5-8846-e5e2ad437410 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 15 13:19:10.810289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 15 13:19:10.810289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [parameters: {'id': 'ebf5d1e5e2b249d7b320a57d25149ce3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 15 13:19:10.810289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79064) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 13:19:10.825784 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-1a83ca50-4992-42d5-8846-e5e2ad437410 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 15 13:19:10.827532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 239/477] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:19:10 2021] POST /identity/v3/roles => generated 144 bytes in 51 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:10.835681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556ff95-9387-4ea6-8c8c-2f9c98c573dc None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:10.847926 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556ff95-9387-4ea6-8c8c-2f9c98c573dc None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:10.854909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12796d-8329-4159-8038-14aa2d766fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:10.855709 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12796d-8329-4159-8038-14aa2d766fae admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:10.855992 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12796d-8329-4159-8038-14aa2d766fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:10.856271 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12796d-8329-4159-8038-14aa2d766fae admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:10.880269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12796d-8329-4159-8038-14aa2d766fae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:10.887757 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-1a12796d-8329-4159-8038-14aa2d766fae admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:19:10.894201 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 239/478] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:19:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:10.896143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83ca50-4992-42d5-8846-e5e2ad437410 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:10.916289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83ca50-4992-42d5-8846-e5e2ad437410 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:10.924467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3341b1-1d6c-457a-a999-16a770cb4e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:10.925349 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3341b1-1d6c-457a-a999-16a770cb4e19 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:10.926359 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3341b1-1d6c-457a-a999-16a770cb4e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:10.926818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3341b1-1d6c-457a-a999-16a770cb4e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:10.927883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3341b1-1d6c-457a-a999-16a770cb4e19 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:10.928371 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3341b1-1d6c-457a-a999-16a770cb4e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:10.930161 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3341b1-1d6c-457a-a999-16a770cb4e19 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:10.947911 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 240/479] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:12.068829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022fe4a-ef40-495d-ac13-09960f97be7a None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.069863 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022fe4a-ef40-495d-ac13-09960f97be7a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.070353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022fe4a-ef40-495d-ac13-09960f97be7a None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.072616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 240/480] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:12.078615 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44253d3a-de37-42d7-830d-3aae7d8babd4 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.079425 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44253d3a-de37-42d7-830d-3aae7d8babd4 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.079906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44253d3a-de37-42d7-830d-3aae7d8babd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.104952 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-44253d3a-de37-42d7-830d-3aae7d8babd4 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:12.106512 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-44253d3a-de37-42d7-830d-3aae7d8babd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:12.121407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 241/481] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:19:12.158222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022fe4a-ef40-495d-ac13-09960f97be7a None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.175864 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022fe4a-ef40-495d-ac13-09960f97be7a None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.185301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad40d7d-3c09-4913-8204-78407b216bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.186371 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad40d7d-3c09-4913-8204-78407b216bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.186877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad40d7d-3c09-4913-8204-78407b216bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.187359 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad40d7d-3c09-4913-8204-78407b216bc8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.205159 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad40d7d-3c09-4913-8204-78407b216bc8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:12.212630 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-aad40d7d-3c09-4913-8204-78407b216bc8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:12.214339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 241/482] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:12.220675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44253d3a-de37-42d7-830d-3aae7d8babd4 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.230574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44253d3a-de37-42d7-830d-3aae7d8babd4 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.239537 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f3b2e-2fc9-4f04-8d1b-0daf87c3536d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.240463 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f3b2e-2fc9-4f04-8d1b-0daf87c3536d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.240966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f3b2e-2fc9-4f04-8d1b-0daf87c3536d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.241458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f3b2e-2fc9-4f04-8d1b-0daf87c3536d admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.242426 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f3b2e-2fc9-4f04-8d1b-0daf87c3536d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:12.242967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f3b2e-2fc9-4f04-8d1b-0daf87c3536d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.244756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f3b2e-2fc9-4f04-8d1b-0daf87c3536d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.261190 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 242/483] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:12.267252 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad40d7d-3c09-4913-8204-78407b216bc8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.277468 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad40d7d-3c09-4913-8204-78407b216bc8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.285114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3d471-58ca-477f-bb7d-2ee6ce6694bc None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.286225 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3d471-58ca-477f-bb7d-2ee6ce6694bc None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.286727 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3d471-58ca-477f-bb7d-2ee6ce6694bc None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.287444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cdcca-8187-4f11-a6f1-b29aa51a3e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.288227 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cdcca-8187-4f11-a6f1-b29aa51a3e31 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.288513 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cdcca-8187-4f11-a6f1-b29aa51a3e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.288795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cdcca-8187-4f11-a6f1-b29aa51a3e31 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.290925 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 243/484] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:12 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:19:12.295867 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af9fb8-b415-441b-8963-a37ae009c5cb None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.296396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af9fb8-b415-441b-8963-a37ae009c5cb None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.296892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af9fb8-b415-441b-8963-a37ae009c5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.312002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cdcca-8187-4f11-a6f1-b29aa51a3e31 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.314084 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cdcca-8187-4f11-a6f1-b29aa51a3e31 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.326807 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-19af9fb8-b415-441b-8963-a37ae009c5cb None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:12.328274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-19af9fb8-b415-441b-8963-a37ae009c5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:12.344814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 244/485] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:19:12.346751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-3e9cdcca-8187-4f11-a6f1-b29aa51a3e31 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:12.348961 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 242/486] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:12.355059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af9fb8-b415-441b-8963-a37ae009c5cb None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.365618 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af9fb8-b415-441b-8963-a37ae009c5cb None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.372515 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f257e-4616-4bcf-a9d0-76b21edfa5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.373363 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f257e-4616-4bcf-a9d0-76b21edfa5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.373894 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f257e-4616-4bcf-a9d0-76b21edfa5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.374371 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f257e-4616-4bcf-a9d0-76b21edfa5d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.375319 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f257e-4616-4bcf-a9d0-76b21edfa5d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:12.375800 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f257e-4616-4bcf-a9d0-76b21edfa5d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.377717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f257e-4616-4bcf-a9d0-76b21edfa5d4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.393832 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 245/487] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:12.400644 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cdcca-8187-4f11-a6f1-b29aa51a3e31 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.403767 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f257e-4616-4bcf-a9d0-76b21edfa5d4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.413984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f257e-4616-4bcf-a9d0-76b21edfa5d4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.414872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cdcca-8187-4f11-a6f1-b29aa51a3e31 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.423519 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda87dd-2194-46ba-b7b3-096ecfd068d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.424738 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de29a5-df3b-46dc-bb1b-d690b6c6525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.425381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda87dd-2194-46ba-b7b3-096ecfd068d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.426668 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda87dd-2194-46ba-b7b3-096ecfd068d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.427223 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda87dd-2194-46ba-b7b3-096ecfd068d0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.427476 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de29a5-df3b-46dc-bb1b-d690b6c6525e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.427917 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de29a5-df3b-46dc-bb1b-d690b6c6525e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.428771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de29a5-df3b-46dc-bb1b-d690b6c6525e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.439800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda87dd-2194-46ba-b7b3-096ecfd068d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.443078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda87dd-2194-46ba-b7b3-096ecfd068d0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.448462 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de29a5-df3b-46dc-bb1b-d690b6c6525e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:12.455835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-21de29a5-df3b-46dc-bb1b-d690b6c6525e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:12.457964 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 246/488] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:12.458468 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-2eda87dd-2194-46ba-b7b3-096ecfd068d0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:19:12.459439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c41bd-140f-49f9-8d21-779565c703c5 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.459805 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c41bd-140f-49f9-8d21-779565c703c5 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.460176 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c41bd-140f-49f9-8d21-779565c703c5 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.460715 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 243/489] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:12.465548 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 247/490] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:12.466546 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda87dd-2194-46ba-b7b3-096ecfd068d0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.467675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c41bd-140f-49f9-8d21-779565c703c5 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.477782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda87dd-2194-46ba-b7b3-096ecfd068d0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.482596 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c41bd-140f-49f9-8d21-779565c703c5 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.482999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec386d1a-58a3-4fdb-b30a-dd219bdc193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.484141 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec386d1a-58a3-4fdb-b30a-dd219bdc193a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.484693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec386d1a-58a3-4fdb-b30a-dd219bdc193a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.485163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec386d1a-58a3-4fdb-b30a-dd219bdc193a admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.486400 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec386d1a-58a3-4fdb-b30a-dd219bdc193a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:12.486978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec386d1a-58a3-4fdb-b30a-dd219bdc193a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.487094 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ea35d-30db-4955-933e-905020156f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.487714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ea35d-30db-4955-933e-905020156f81 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.487999 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ea35d-30db-4955-933e-905020156f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.488278 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ea35d-30db-4955-933e-905020156f81 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.489162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ea35d-30db-4955-933e-905020156f81 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:12.489475 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ea35d-30db-4955-933e-905020156f81 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.490045 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec386d1a-58a3-4fdb-b30a-dd219bdc193a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.490480 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-411ea35d-30db-4955-933e-905020156f81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:12.490480 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:19:12.490480 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:19:12.491618 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ea35d-30db-4955-933e-905020156f81 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.500047 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 244/491] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:12.501591 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16566a-1274-499a-99d3-1a267ad05043 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.502124 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16566a-1274-499a-99d3-1a267ad05043 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.502599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16566a-1274-499a-99d3-1a267ad05043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.521816 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-bc16566a-1274-499a-99d3-1a267ad05043 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:12.523509 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-bc16566a-1274-499a-99d3-1a267ad05043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:12.531767 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 245/492] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:12.532868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16566a-1274-499a-99d3-1a267ad05043 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.541810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 248/493] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:12.543625 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16566a-1274-499a-99d3-1a267ad05043 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.548823 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48928-03a5-4402-a276-fb49127d60a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.549871 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48928-03a5-4402-a276-fb49127d60a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.550403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48928-03a5-4402-a276-fb49127d60a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.550923 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48928-03a5-4402-a276-fb49127d60a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.554659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ea35d-30db-4955-933e-905020156f81 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.563059 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d48928-03a5-4402-a276-fb49127d60a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.565250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d48928-03a5-4402-a276-fb49127d60a1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.572657 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ea35d-30db-4955-933e-905020156f81 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.578212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e8509-c56d-44a5-8cf7-adc926677b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.578809 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e8509-c56d-44a5-8cf7-adc926677b04 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.579126 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e8509-c56d-44a5-8cf7-adc926677b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.579408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e8509-c56d-44a5-8cf7-adc926677b04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.588394 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e8509-c56d-44a5-8cf7-adc926677b04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.588911 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-c0d48928-03a5-4402-a276-fb49127d60a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:12.590169 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e8509-c56d-44a5-8cf7-adc926677b04 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.590886 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 246/494] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:12.591910 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48928-03a5-4402-a276-fb49127d60a1 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.601590 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 249/495] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:19:12.602465 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e8509-c56d-44a5-8cf7-adc926677b04 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.603012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48928-03a5-4402-a276-fb49127d60a1 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.607867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa27719-19de-4ad3-9c0f-57c0f1de551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.608950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa27719-19de-4ad3-9c0f-57c0f1de551f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.609426 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa27719-19de-4ad3-9c0f-57c0f1de551f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.609928 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa27719-19de-4ad3-9c0f-57c0f1de551f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.611882 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e8509-c56d-44a5-8cf7-adc926677b04 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.617098 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f6b7a-a65e-410c-87a6-541a889562ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.617732 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f6b7a-a65e-410c-87a6-541a889562ba admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.618015 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f6b7a-a65e-410c-87a6-541a889562ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.618295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f6b7a-a65e-410c-87a6-541a889562ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.619062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f6b7a-a65e-410c-87a6-541a889562ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:12.619396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f6b7a-a65e-410c-87a6-541a889562ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.621424 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f6b7a-a65e-410c-87a6-541a889562ba admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.624045 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa27719-19de-4ad3-9c0f-57c0f1de551f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:12.631612 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-cfa27719-19de-4ad3-9c0f-57c0f1de551f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:12.633370 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 247/496] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:12.634389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa27719-19de-4ad3-9c0f-57c0f1de551f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.638894 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 250/497] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:12.640099 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f6b7a-a65e-410c-87a6-541a889562ba admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.649399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa27719-19de-4ad3-9c0f-57c0f1de551f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.650523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f6b7a-a65e-410c-87a6-541a889562ba admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.654280 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d4484-4690-4f69-9234-b9a334f769bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.655160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4484-4690-4f69-9234-b9a334f769bc admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.655553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4484-4690-4f69-9234-b9a334f769bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.655898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4484-4690-4f69-9234-b9a334f769bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.661512 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9b29d-b48e-47d6-87cb-eee4a6c70eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.662234 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b29d-b48e-47d6-87cb-eee4a6c70eda admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.662518 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b29d-b48e-47d6-87cb-eee4a6c70eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.662790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b29d-b48e-47d6-87cb-eee4a6c70eda admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.663621 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9b29d-b48e-47d6-87cb-eee4a6c70eda admin admin] RBAC: Adding query filter params (name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:12.663928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9b29d-b48e-47d6-87cb-eee4a6c70eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.666636 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9b29d-b48e-47d6-87cb-eee4a6c70eda admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.668550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d4484-4690-4f69-9234-b9a334f769bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.670523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d4484-4690-4f69-9234-b9a334f769bc admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.677075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 251/498] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:12.678364 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9b29d-b48e-47d6-87cb-eee4a6c70eda admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.689425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-6f9d4484-4690-4f69-9234-b9a334f769bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:12.690837 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 248/499] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:12.691746 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d4484-4690-4f69-9234-b9a334f769bc admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.699387 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9b29d-b48e-47d6-87cb-eee4a6c70eda admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.702038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d4484-4690-4f69-9234-b9a334f769bc admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.704258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ba5f6-26b7-49aa-9ff2-2e3947c77e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.705100 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ba5f6-26b7-49aa-9ff2-2e3947c77e08 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.705381 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ba5f6-26b7-49aa-9ff2-2e3947c77e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.705657 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ba5f6-26b7-49aa-9ff2-2e3947c77e08 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.707039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d39fa-01b6-4a58-9ad0-a94af549fd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.708473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d39fa-01b6-4a58-9ad0-a94af549fd98 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.708852 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d39fa-01b6-4a58-9ad0-a94af549fd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.709459 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d39fa-01b6-4a58-9ad0-a94af549fd98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.714682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ba5f6-26b7-49aa-9ff2-2e3947c77e08 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.717293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ba5f6-26b7-49aa-9ff2-2e3947c77e08 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.720770 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d39fa-01b6-4a58-9ad0-a94af549fd98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.722393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d39fa-01b6-4a58-9ad0-a94af549fd98 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.733757 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-542ba5f6-26b7-49aa-9ff2-2e3947c77e08 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 13:19:12.735301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 252/500] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/users/glance => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:12.736186 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ba5f6-26b7-49aa-9ff2-2e3947c77e08 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.741320 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-3a1d39fa-01b6-4a58-9ad0-a94af549fd98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:12.742935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 249/501] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:12.743666 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d39fa-01b6-4a58-9ad0-a94af549fd98 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.746912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ba5f6-26b7-49aa-9ff2-2e3947c77e08 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.755556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d39fa-01b6-4a58-9ad0-a94af549fd98 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.755921 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023a194-6bad-449e-8be5-382954929a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.757216 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023a194-6bad-449e-8be5-382954929a02 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.757744 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023a194-6bad-449e-8be5-382954929a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.758458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023a194-6bad-449e-8be5-382954929a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.759734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023a194-6bad-449e-8be5-382954929a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:12.760291 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023a194-6bad-449e-8be5-382954929a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.760541 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30389c3-0750-400c-a09a-a3355f45aff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.761269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30389c3-0750-400c-a09a-a3355f45aff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.761620 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30389c3-0750-400c-a09a-a3355f45aff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.761978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30389c3-0750-400c-a09a-a3355f45aff4 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.762929 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30389c3-0750-400c-a09a-a3355f45aff4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:12.763195 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023a194-6bad-449e-8be5-382954929a02 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.763293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30389c3-0750-400c-a09a-a3355f45aff4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.764393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-f30389c3-0750-400c-a09a-a3355f45aff4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:12.764393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:19:12.764393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:19:12.765637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30389c3-0750-400c-a09a-a3355f45aff4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.778780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 253/502] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:12.783776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023a194-6bad-449e-8be5-382954929a02 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.795390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023a194-6bad-449e-8be5-382954929a02 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.800831 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60059884-dfb4-4f62-92dc-e4d31f4439c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.801774 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60059884-dfb4-4f62-92dc-e4d31f4439c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.802246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60059884-dfb4-4f62-92dc-e4d31f4439c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.802711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60059884-dfb4-4f62-92dc-e4d31f4439c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.803690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60059884-dfb4-4f62-92dc-e4d31f4439c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:12.804205 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60059884-dfb4-4f62-92dc-e4d31f4439c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.806000 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60059884-dfb4-4f62-92dc-e4d31f4439c4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.810879 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 250/503] 10.222.0.60 () {56 vars in 1158 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:12.811617 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30389c3-0750-400c-a09a-a3355f45aff4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.821828 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 254/504] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:12.822464 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30389c3-0750-400c-a09a-a3355f45aff4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.823307 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60059884-dfb4-4f62-92dc-e4d31f4439c4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.827352 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc07451-e7a4-4158-b5e5-ca0d57c5030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.828189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc07451-e7a4-4158-b5e5-ca0d57c5030f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.828526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc07451-e7a4-4158-b5e5-ca0d57c5030f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.828750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc07451-e7a4-4158-b5e5-ca0d57c5030f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.835611 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60059884-dfb4-4f62-92dc-e4d31f4439c4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.837331 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc07451-e7a4-4158-b5e5-ca0d57c5030f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.839562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc07451-e7a4-4158-b5e5-ca0d57c5030f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.840977 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55458759-f096-4b88-b552-e9ff4a875576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.842376 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55458759-f096-4b88-b552-e9ff4a875576 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.842878 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55458759-f096-4b88-b552-e9ff4a875576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.843349 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55458759-f096-4b88-b552-e9ff4a875576 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.851976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55458759-f096-4b88-b552-e9ff4a875576 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.853335 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-ddc07451-e7a4-4158-b5e5-ca0d57c5030f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:12.854485 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55458759-f096-4b88-b552-e9ff4a875576 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.854590 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 251/505] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:12.855334 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc07451-e7a4-4158-b5e5-ca0d57c5030f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.865545 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc07451-e7a4-4158-b5e5-ca0d57c5030f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.866380 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 255/506] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:19:12.867719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55458759-f096-4b88-b552-e9ff4a875576 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.870270 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fbe3e-2f9f-4c27-8362-7cbc060063c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.871071 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fbe3e-2f9f-4c27-8362-7cbc060063c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.871355 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fbe3e-2f9f-4c27-8362-7cbc060063c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.871635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fbe3e-2f9f-4c27-8362-7cbc060063c1 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.880031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fbe3e-2f9f-4c27-8362-7cbc060063c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.880511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55458759-f096-4b88-b552-e9ff4a875576 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.882194 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fbe3e-2f9f-4c27-8362-7cbc060063c1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.886035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b2abd-3ef4-4237-8bf2-006b731d092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.886912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b2abd-3ef4-4237-8bf2-006b731d092b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.887407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b2abd-3ef4-4237-8bf2-006b731d092b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.887872 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b2abd-3ef4-4237-8bf2-006b731d092b admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.889134 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b2abd-3ef4-4237-8bf2-006b731d092b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:12.889650 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b2abd-3ef4-4237-8bf2-006b731d092b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.890831 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-ba5b2abd-3ef4-4237-8bf2-006b731d092b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:12.890831 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:19:12.890831 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:19:12.892282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b2abd-3ef4-4237-8bf2-006b731d092b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.896772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-1f1fbe3e-2f9f-4c27-8362-7cbc060063c1 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 13:19:12.898027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 252/507] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/users/cinder => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:12.898863 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fbe3e-2f9f-4c27-8362-7cbc060063c1 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.908530 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fbe3e-2f9f-4c27-8362-7cbc060063c1 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.913012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aba4e2-0880-4384-a123-4bdb4a3600c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.913773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aba4e2-0880-4384-a123-4bdb4a3600c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.914053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aba4e2-0880-4384-a123-4bdb4a3600c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.914329 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aba4e2-0880-4384-a123-4bdb4a3600c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.914946 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 256/508] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:12.916029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b2abd-3ef4-4237-8bf2-006b731d092b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.926353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aba4e2-0880-4384-a123-4bdb4a3600c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.928408 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aba4e2-0880-4384-a123-4bdb4a3600c8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.928523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b2abd-3ef4-4237-8bf2-006b731d092b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.934024 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46def601-e291-4306-85e6-84fbd96ffcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.935131 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46def601-e291-4306-85e6-84fbd96ffcac admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.935611 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46def601-e291-4306-85e6-84fbd96ffcac admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.936078 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46def601-e291-4306-85e6-84fbd96ffcac admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.937828 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46def601-e291-4306-85e6-84fbd96ffcac admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:12.938877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46def601-e291-4306-85e6-84fbd96ffcac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.941332 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46def601-e291-4306-85e6-84fbd96ffcac admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.948322 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-d3aba4e2-0880-4384-a123-4bdb4a3600c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:12.949741 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 253/509] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:12.950569 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aba4e2-0880-4384-a123-4bdb4a3600c8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.961440 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aba4e2-0880-4384-a123-4bdb4a3600c8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.966039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f850e-a729-4af5-b441-923aae0d1234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.966345 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 257/510] 10.222.0.60 () {56 vars in 1158 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:12.966635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f850e-a729-4af5-b441-923aae0d1234 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.966949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f850e-a729-4af5-b441-923aae0d1234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.967228 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f850e-a729-4af5-b441-923aae0d1234 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.968074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46def601-e291-4306-85e6-84fbd96ffcac admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.968178 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f850e-a729-4af5-b441-923aae0d1234 admin admin] RBAC: Adding query filter params (role.id=bf8b5076a92449fba2f54db6ae519ba6, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=d61a8e4d64664e68a5710fdf766e4685) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:12.968388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f850e-a729-4af5-b441-923aae0d1234 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.970369 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f850e-a729-4af5-b441-923aae0d1234 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.976656 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 254/511] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/role_assignments?user.id=d61a8e4d64664e68a5710fdf766e4685&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=bf8b5076a92449fba2f54db6ae519ba6 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:12.977365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f850e-a729-4af5-b441-923aae0d1234 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:12.980497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46def601-e291-4306-85e6-84fbd96ffcac admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.986562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9822-c322-4731-9b29-f0532ac2a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.987661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9822-c322-4731-9b29-f0532ac2a152 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.988138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9822-c322-4731-9b29-f0532ac2a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.988241 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f850e-a729-4af5-b441-923aae0d1234 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:12.988781 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9822-c322-4731-9b29-f0532ac2a152 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:12.990061 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec9822-c322-4731-9b29-f0532ac2a152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:12.990603 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec9822-c322-4731-9b29-f0532ac2a152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:12.992675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec9822-c322-4731-9b29-f0532ac2a152 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:12.993222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd8716-fde4-4099-8e71-7132244b83e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:12.993919 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd8716-fde4-4099-8e71-7132244b83e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:12.994204 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd8716-fde4-4099-8e71-7132244b83e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:12.994529 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd8716-fde4-4099-8e71-7132244b83e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.003397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd8716-fde4-4099-8e71-7132244b83e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.005747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd8716-fde4-4099-8e71-7132244b83e6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.013348 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 258/512] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:13.019319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 255/513] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:19:13.021713 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9822-c322-4731-9b29-f0532ac2a152 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.027959 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd8716-fde4-4099-8e71-7132244b83e6 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.039866 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9822-c322-4731-9b29-f0532ac2a152 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.046916 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901ff4f-0960-4da1-a681-1995517ca55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.047110 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd8716-fde4-4099-8e71-7132244b83e6 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.048044 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901ff4f-0960-4da1-a681-1995517ca55f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.048377 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901ff4f-0960-4da1-a681-1995517ca55f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.048653 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901ff4f-0960-4da1-a681-1995517ca55f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.057351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901ff4f-0960-4da1-a681-1995517ca55f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.059711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901ff4f-0960-4da1-a681-1995517ca55f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.068214 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2638cc2-8e42-4947-9531-95033ef1ce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.069027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638cc2-8e42-4947-9531-95033ef1ce3b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.069544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638cc2-8e42-4947-9531-95033ef1ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.069613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638cc2-8e42-4947-9531-95033ef1ce3b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.090265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-f901ff4f-0960-4da1-a681-1995517ca55f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:13.092591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 259/514] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:13.099525 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901ff4f-0960-4da1-a681-1995517ca55f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.100802 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2638cc2-8e42-4947-9531-95033ef1ce3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.102709 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2638cc2-8e42-4947-9531-95033ef1ce3b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.125248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901ff4f-0960-4da1-a681-1995517ca55f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.133182 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-a2638cc2-8e42-4947-9531-95033ef1ce3b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:13.133566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 256/515] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:13.140433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280a857-cc25-46cd-b536-e3bb1489fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.141115 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a857-cc25-46cd-b536-e3bb1489fc72 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.141398 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a857-cc25-46cd-b536-e3bb1489fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.141674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a857-cc25-46cd-b536-e3bb1489fc72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.142504 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280a857-cc25-46cd-b536-e3bb1489fc72 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:13.142820 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280a857-cc25-46cd-b536-e3bb1489fc72 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.143872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2638cc2-8e42-4947-9531-95033ef1ce3b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.144855 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280a857-cc25-46cd-b536-e3bb1489fc72 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.159362 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 260/516] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:13.165448 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2638cc2-8e42-4947-9531-95033ef1ce3b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.165809 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280a857-cc25-46cd-b536-e3bb1489fc72 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.177363 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280a857-cc25-46cd-b536-e3bb1489fc72 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.182218 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f04d2-ecc2-4f7c-b15b-591ed4ce48ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.182987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f04d2-ecc2-4f7c-b15b-591ed4ce48ff admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.183274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f04d2-ecc2-4f7c-b15b-591ed4ce48ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.183554 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f04d2-ecc2-4f7c-b15b-591ed4ce48ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.184482 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f04d2-ecc2-4f7c-b15b-591ed4ce48ff admin admin] RBAC: Adding query filter params (role.id=bf8b5076a92449fba2f54db6ae519ba6, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=5b9aff45fefe408fa1667e5298f8ff6c) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:13.184655 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd2412-fccd-451d-9cea-e2882c85b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.184854 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f04d2-ecc2-4f7c-b15b-591ed4ce48ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.185257 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd2412-fccd-451d-9cea-e2882c85b8bc admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.185550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd2412-fccd-451d-9cea-e2882c85b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.185832 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd2412-fccd-451d-9cea-e2882c85b8bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.186585 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd2412-fccd-451d-9cea-e2882c85b8bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:13.186777 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f04d2-ecc2-4f7c-b15b-591ed4ce48ff admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.186967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd2412-fccd-451d-9cea-e2882c85b8bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.188528 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd2412-fccd-451d-9cea-e2882c85b8bc admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.199034 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 261/517] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/role_assignments?user.id=5b9aff45fefe408fa1667e5298f8ff6c&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=bf8b5076a92449fba2f54db6ae519ba6 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:13.210609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 257/518] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:13.217069 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f04d2-ecc2-4f7c-b15b-591ed4ce48ff admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.235849 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f04d2-ecc2-4f7c-b15b-591ed4ce48ff admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.242060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb57d2-1580-4e3e-8223-d26c219fb82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.242958 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb57d2-1580-4e3e-8223-d26c219fb82a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.243302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb57d2-1580-4e3e-8223-d26c219fb82a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.243578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb57d2-1580-4e3e-8223-d26c219fb82a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.254329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb57d2-1580-4e3e-8223-d26c219fb82a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.257244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb57d2-1580-4e3e-8223-d26c219fb82a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.278793 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-1acb57d2-1580-4e3e-8223-d26c219fb82a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:13.280751 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 262/519] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:13.287387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd2412-fccd-451d-9cea-e2882c85b8bc admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.309477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd2412-fccd-451d-9cea-e2882c85b8bc admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.321197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38ca37-27cb-4e2e-9d59-51bc55fbb4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.321880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ca37-27cb-4e2e-9d59-51bc55fbb4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.322164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ca37-27cb-4e2e-9d59-51bc55fbb4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.322444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ca37-27cb-4e2e-9d59-51bc55fbb4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.323330 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38ca37-27cb-4e2e-9d59-51bc55fbb4e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:13.323821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38ca37-27cb-4e2e-9d59-51bc55fbb4e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.324867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-bf38ca37-27cb-4e2e-9d59-51bc55fbb4e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:13.324867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:19:13.324867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:19:13.326006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38ca37-27cb-4e2e-9d59-51bc55fbb4e1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.358874 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 258/520] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:13.365659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb57d2-1580-4e3e-8223-d26c219fb82a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.380901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb57d2-1580-4e3e-8223-d26c219fb82a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.391215 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3723f-b3f9-4522-9f9d-71020d092b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.392246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3723f-b3f9-4522-9f9d-71020d092b1c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.392722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3723f-b3f9-4522-9f9d-71020d092b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.393186 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3723f-b3f9-4522-9f9d-71020d092b1c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.394224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3723f-b3f9-4522-9f9d-71020d092b1c admin admin] RBAC: Adding query filter params (role.id=bf8b5076a92449fba2f54db6ae519ba6, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=69bf09fafcb24a13a1ef14cba8da380a) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:13.394819 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3723f-b3f9-4522-9f9d-71020d092b1c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.396948 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3723f-b3f9-4522-9f9d-71020d092b1c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.403720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 263/521] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/role_assignments?user.id=69bf09fafcb24a13a1ef14cba8da380a&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=bf8b5076a92449fba2f54db6ae519ba6 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:13.426021 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b30757-b314-42eb-8756-c9e51c6c6728 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.426930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b30757-b314-42eb-8756-c9e51c6c6728 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.427177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b30757-b314-42eb-8756-c9e51c6c6728 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.429242 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 259/522] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:13.435912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4f301-10f8-4344-843c-0093bb7a493d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.436534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4f301-10f8-4344-843c-0093bb7a493d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.437019 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4f301-10f8-4344-843c-0093bb7a493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.472496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-0bc4f301-10f8-4344-843c-0093bb7a493d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:13.474141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-0bc4f301-10f8-4344-843c-0093bb7a493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:13.486352 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 264/523] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:13.528569 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b30757-b314-42eb-8756-c9e51c6c6728 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.545346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b30757-b314-42eb-8756-c9e51c6c6728 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.555496 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480343a-71f6-4dff-9633-a60897b1e1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.556315 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480343a-71f6-4dff-9633-a60897b1e1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.556596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480343a-71f6-4dff-9633-a60897b1e1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.556876 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480343a-71f6-4dff-9633-a60897b1e1f8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.573639 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480343a-71f6-4dff-9633-a60897b1e1f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:13.580679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-8480343a-71f6-4dff-9633-a60897b1e1f8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:13.582245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 260/524] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:13.588742 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4f301-10f8-4344-843c-0093bb7a493d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.604555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4f301-10f8-4344-843c-0093bb7a493d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.616097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46327ea0-7279-4af6-b2ca-0912e2242836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.616809 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46327ea0-7279-4af6-b2ca-0912e2242836 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.617166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46327ea0-7279-4af6-b2ca-0912e2242836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.617519 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46327ea0-7279-4af6-b2ca-0912e2242836 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.618314 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46327ea0-7279-4af6-b2ca-0912e2242836 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:13.618629 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46327ea0-7279-4af6-b2ca-0912e2242836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.620287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46327ea0-7279-4af6-b2ca-0912e2242836 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.634341 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 265/525] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:13.640487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480343a-71f6-4dff-9633-a60897b1e1f8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.658152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480343a-71f6-4dff-9633-a60897b1e1f8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.668077 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5702ed-b97f-49f3-994d-27da5ded21ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.668865 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5702ed-b97f-49f3-994d-27da5ded21ca admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.669144 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5702ed-b97f-49f3-994d-27da5ded21ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.669426 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5702ed-b97f-49f3-994d-27da5ded21ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.684372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5702ed-b97f-49f3-994d-27da5ded21ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.691030 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5702ed-b97f-49f3-994d-27da5ded21ca admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.720288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-ce5702ed-b97f-49f3-994d-27da5ded21ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:13.721673 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 261/526] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:13.728129 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46327ea0-7279-4af6-b2ca-0912e2242836 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.749148 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46327ea0-7279-4af6-b2ca-0912e2242836 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.764088 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d617b0c-d87e-441d-a331-d5aea9afdf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.764763 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d617b0c-d87e-441d-a331-d5aea9afdf19 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.765059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d617b0c-d87e-441d-a331-d5aea9afdf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.765341 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d617b0c-d87e-441d-a331-d5aea9afdf19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.766091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d617b0c-d87e-441d-a331-d5aea9afdf19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:13.766403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d617b0c-d87e-441d-a331-d5aea9afdf19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.768028 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d617b0c-d87e-441d-a331-d5aea9afdf19 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.789085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 266/527] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:13.800819 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5702ed-b97f-49f3-994d-27da5ded21ca admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.811955 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5702ed-b97f-49f3-994d-27da5ded21ca admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.827765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d0e49-bfb8-45b4-8c59-78ca1da0fd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.828586 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d0e49-bfb8-45b4-8c59-78ca1da0fd21 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.828864 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d0e49-bfb8-45b4-8c59-78ca1da0fd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.829158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d0e49-bfb8-45b4-8c59-78ca1da0fd21 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.838057 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d0e49-bfb8-45b4-8c59-78ca1da0fd21 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.840097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d0e49-bfb8-45b4-8c59-78ca1da0fd21 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.859522 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-3f0d0e49-bfb8-45b4-8c59-78ca1da0fd21 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 13:19:13.861021 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 262/528] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/users/neutron => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:13.867737 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d617b0c-d87e-441d-a331-d5aea9afdf19 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.893305 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d617b0c-d87e-441d-a331-d5aea9afdf19 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.904437 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e382a5-f65b-45df-8aab-cbefd9db3833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.905124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e382a5-f65b-45df-8aab-cbefd9db3833 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.905422 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e382a5-f65b-45df-8aab-cbefd9db3833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.905697 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e382a5-f65b-45df-8aab-cbefd9db3833 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.906568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e382a5-f65b-45df-8aab-cbefd9db3833 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:13.906901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e382a5-f65b-45df-8aab-cbefd9db3833 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.908751 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e382a5-f65b-45df-8aab-cbefd9db3833 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.933060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 267/529] 10.222.0.60 () {56 vars in 1160 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:13.939013 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d0e49-bfb8-45b4-8c59-78ca1da0fd21 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:13.952678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d0e49-bfb8-45b4-8c59-78ca1da0fd21 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:13.960900 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11958f4-3a99-482b-8655-222d6a2b2cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:13.961553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11958f4-3a99-482b-8655-222d6a2b2cbd admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:13.961839 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11958f4-3a99-482b-8655-222d6a2b2cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:13.962120 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11958f4-3a99-482b-8655-222d6a2b2cbd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:13.975026 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11958f4-3a99-482b-8655-222d6a2b2cbd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:13.976788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11958f4-3a99-482b-8655-222d6a2b2cbd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:13.990037 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 263/530] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:19:13.995607 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e382a5-f65b-45df-8aab-cbefd9db3833 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:14.007128 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e382a5-f65b-45df-8aab-cbefd9db3833 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:14.014724 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f752c-3a5e-4496-ace1-67874afb7b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:14.015532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f752c-3a5e-4496-ace1-67874afb7b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:14.015819 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f752c-3a5e-4496-ace1-67874afb7b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:14.016087 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f752c-3a5e-4496-ace1-67874afb7b8b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:14.034452 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f752c-3a5e-4496-ace1-67874afb7b8b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:14.036891 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f752c-3a5e-4496-ace1-67874afb7b8b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:14.060689 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-5d5f752c-3a5e-4496-ace1-67874afb7b8b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:14.062029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 268/531] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:14.067863 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11958f4-3a99-482b-8655-222d6a2b2cbd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:14.076925 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11958f4-3a99-482b-8655-222d6a2b2cbd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:14.091999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dacde0-3e95-4d47-b647-d8af89b85497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:14.092651 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dacde0-3e95-4d47-b647-d8af89b85497 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:14.092935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dacde0-3e95-4d47-b647-d8af89b85497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:14.093213 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dacde0-3e95-4d47-b647-d8af89b85497 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:14.093948 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dacde0-3e95-4d47-b647-d8af89b85497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:14.094263 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dacde0-3e95-4d47-b647-d8af89b85497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:14.095887 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dacde0-3e95-4d47-b647-d8af89b85497 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:14.109062 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 264/532] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:14.114473 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f752c-3a5e-4496-ace1-67874afb7b8b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:14.127759 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f752c-3a5e-4496-ace1-67874afb7b8b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:14.140301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6eb892-64ef-4461-9de1-19f91d6b1d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:14.141080 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eb892-64ef-4461-9de1-19f91d6b1d2b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:14.141356 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eb892-64ef-4461-9de1-19f91d6b1d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:14.141628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eb892-64ef-4461-9de1-19f91d6b1d2b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:14.155928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6eb892-64ef-4461-9de1-19f91d6b1d2b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:14.157870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6eb892-64ef-4461-9de1-19f91d6b1d2b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:14.178625 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-fa6eb892-64ef-4461-9de1-19f91d6b1d2b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:14.180020 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 269/533] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:14.185932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dacde0-3e95-4d47-b647-d8af89b85497 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:14.200574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dacde0-3e95-4d47-b647-d8af89b85497 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:14.212474 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadaf7a-8c79-45c0-86f5-994ead37aa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:14.213139 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadaf7a-8c79-45c0-86f5-994ead37aa34 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:14.213421 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadaf7a-8c79-45c0-86f5-994ead37aa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:14.213697 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadaf7a-8c79-45c0-86f5-994ead37aa34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:14.214510 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadaf7a-8c79-45c0-86f5-994ead37aa34 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:14.214824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadaf7a-8c79-45c0-86f5-994ead37aa34 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:14.216703 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadaf7a-8c79-45c0-86f5-994ead37aa34 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:14.240273 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 265/534] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:14.246533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6eb892-64ef-4461-9de1-19f91d6b1d2b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:14.256943 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6eb892-64ef-4461-9de1-19f91d6b1d2b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:14.261489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada18cd-9119-4daf-98b3-6611305bb7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:14.262125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada18cd-9119-4daf-98b3-6611305bb7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:14.262409 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada18cd-9119-4daf-98b3-6611305bb7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:14.262691 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada18cd-9119-4daf-98b3-6611305bb7d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:14.263566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada18cd-9119-4daf-98b3-6611305bb7d6 admin admin] RBAC: Adding query filter params (role.id=bf8b5076a92449fba2f54db6ae519ba6, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=c9a44a13e31941b5af9579d8bec345ea) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:14.263875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada18cd-9119-4daf-98b3-6611305bb7d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:14.265717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada18cd-9119-4daf-98b3-6611305bb7d6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:14.272356 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 270/535] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:14 2021] GET /identity/v3/role_assignments?user.id=c9a44a13e31941b5af9579d8bec345ea&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=bf8b5076a92449fba2f54db6ae519ba6 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:14.335446 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b1a5b-c00f-48e8-a168-e72dc69ce44e None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:14.335767 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b1a5b-c00f-48e8-a168-e72dc69ce44e None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:14.336008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b1a5b-c00f-48e8-a168-e72dc69ce44e None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:14.337931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 266/536] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:14.353317 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3f2f7-b568-4d76-a4e8-1fb0ea81d719 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:14.353624 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3f2f7-b568-4d76-a4e8-1fb0ea81d719 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:14.353882 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3f2f7-b568-4d76-a4e8-1fb0ea81d719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:14.374132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-acb3f2f7-b568-4d76-a4e8-1fb0ea81d719 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:14.375401 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-acb3f2f7-b568-4d76-a4e8-1fb0ea81d719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:14.386291 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 271/537] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:19:14.411916 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b1a5b-c00f-48e8-a168-e72dc69ce44e None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:14.424726 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b1a5b-c00f-48e8-a168-e72dc69ce44e None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:14.429469 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2001fef-9a2d-42c9-835a-9a16586b720a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:14.430275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001fef-9a2d-42c9-835a-9a16586b720a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:14.430562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001fef-9a2d-42c9-835a-9a16586b720a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:14.430872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001fef-9a2d-42c9-835a-9a16586b720a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:14.443646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2001fef-9a2d-42c9-835a-9a16586b720a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:14.445992 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2001fef-9a2d-42c9-835a-9a16586b720a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:14.471829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-b2001fef-9a2d-42c9-835a-9a16586b720a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:14.473584 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 267/538] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:14.480079 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3f2f7-b568-4d76-a4e8-1fb0ea81d719 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:14.489322 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3f2f7-b568-4d76-a4e8-1fb0ea81d719 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:14.494004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13e499-af62-46e1-89b2-a25bafd8bfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:14.494671 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13e499-af62-46e1-89b2-a25bafd8bfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:14.494986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13e499-af62-46e1-89b2-a25bafd8bfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:14.495270 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13e499-af62-46e1-89b2-a25bafd8bfc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:14.496017 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13e499-af62-46e1-89b2-a25bafd8bfc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:14.496328 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13e499-af62-46e1-89b2-a25bafd8bfc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:14.498009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13e499-af62-46e1-89b2-a25bafd8bfc2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:14.511523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 272/539] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:14.517750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2001fef-9a2d-42c9-835a-9a16586b720a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:14.528762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2001fef-9a2d-42c9-835a-9a16586b720a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:14.533542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeb98a-25c2-4bfc-9763-7a52fb6a7c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:14.534276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb98a-25c2-4bfc-9763-7a52fb6a7c3c admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:14.534560 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb98a-25c2-4bfc-9763-7a52fb6a7c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:14.534931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb98a-25c2-4bfc-9763-7a52fb6a7c3c admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:14.535688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdeb98a-25c2-4bfc-9763-7a52fb6a7c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:14.537843 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdeb98a-25c2-4bfc-9763-7a52fb6a7c3c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:14.561552 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 268/540] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:19:14 2021] POST /identity/v3/users => generated 247 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:16.031023 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0a7b5-e6bf-4eb0-b466-b5c55108a862 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.031540 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0a7b5-e6bf-4eb0-b466-b5c55108a862 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.031643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0a7b5-e6bf-4eb0-b466-b5c55108a862 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.033504 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 273/541] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:16.039831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df95de-6534-4b67-bc8c-157d9657025c None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.040223 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df95de-6534-4b67-bc8c-157d9657025c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.040402 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df95de-6534-4b67-bc8c-157d9657025c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.059785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-25df95de-6534-4b67-bc8c-157d9657025c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:16.060989 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-25df95de-6534-4b67-bc8c-157d9657025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:16.069007 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 269/542] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:19:16.108398 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0a7b5-e6bf-4eb0-b466-b5c55108a862 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.122271 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53910d5e-6f47-4747-b989-38a75516a916 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.122564 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53910d5e-6f47-4747-b989-38a75516a916 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.122821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53910d5e-6f47-4747-b989-38a75516a916 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.124694 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0a7b5-e6bf-4eb0-b466-b5c55108a862 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.124865 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 270/543] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:19:16.130232 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba308-be94-47e3-92bc-7a411dfbb9b4 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.130515 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba308-be94-47e3-92bc-7a411dfbb9b4 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.130880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba308-be94-47e3-92bc-7a411dfbb9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.132348 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501217f-c1f7-4b90-8b43-772be4fa61ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.133131 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501217f-c1f7-4b90-8b43-772be4fa61ba admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.133417 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501217f-c1f7-4b90-8b43-772be4fa61ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.133696 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501217f-c1f7-4b90-8b43-772be4fa61ba admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.147771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501217f-c1f7-4b90-8b43-772be4fa61ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:16.153073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-75bba308-be94-47e3-92bc-7a411dfbb9b4 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:16.154472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-75bba308-be94-47e3-92bc-7a411dfbb9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:16.155177 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-6501217f-c1f7-4b90-8b43-772be4fa61ba admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:16.159721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 274/544] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:16.162997 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501217f-c1f7-4b90-8b43-772be4fa61ba admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.173064 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 271/545] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:19:16.176961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501217f-c1f7-4b90-8b43-772be4fa61ba admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.181621 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d65445-23d5-40bb-95da-78e8db8dc07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.182337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d65445-23d5-40bb-95da-78e8db8dc07a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.182688 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d65445-23d5-40bb-95da-78e8db8dc07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.183060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d65445-23d5-40bb-95da-78e8db8dc07a admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.183893 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d65445-23d5-40bb-95da-78e8db8dc07a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:16.184272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d65445-23d5-40bb-95da-78e8db8dc07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.186004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d65445-23d5-40bb-95da-78e8db8dc07a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.194762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 275/546] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:16.204230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bba308-be94-47e3-92bc-7a411dfbb9b4 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.214542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bba308-be94-47e3-92bc-7a411dfbb9b4 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.215645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d65445-23d5-40bb-95da-78e8db8dc07a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.226718 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457795e7-c022-4371-8d42-9514f6825d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.227630 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457795e7-c022-4371-8d42-9514f6825d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.227988 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457795e7-c022-4371-8d42-9514f6825d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.228388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457795e7-c022-4371-8d42-9514f6825d1b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.239355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d65445-23d5-40bb-95da-78e8db8dc07a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.245587 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78dc8f-4b90-4910-963a-fe4dac2be652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.246462 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78dc8f-4b90-4910-963a-fe4dac2be652 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.247891 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78dc8f-4b90-4910-963a-fe4dac2be652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.248959 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78dc8f-4b90-4910-963a-fe4dac2be652 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.249885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457795e7-c022-4371-8d42-9514f6825d1b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.252057 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457795e7-c022-4371-8d42-9514f6825d1b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.273866 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78dc8f-4b90-4910-963a-fe4dac2be652 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:16.281257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-bb78dc8f-4b90-4910-963a-fe4dac2be652 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:16.281436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-457795e7-c022-4371-8d42-9514f6825d1b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:16.282594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 276/547] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:16.284294 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 272/548] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:16.289997 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78dc8f-4b90-4910-963a-fe4dac2be652 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.291522 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457795e7-c022-4371-8d42-9514f6825d1b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.307446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78dc8f-4b90-4910-963a-fe4dac2be652 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.309560 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457795e7-c022-4371-8d42-9514f6825d1b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.317360 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cc505-487b-41f7-94af-70a9811656a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.318726 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cc505-487b-41f7-94af-70a9811656a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.319488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8734b-222e-4274-a79a-e060464191bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.319934 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cc505-487b-41f7-94af-70a9811656a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.320376 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cc505-487b-41f7-94af-70a9811656a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.321164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8734b-222e-4274-a79a-e060464191bc admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.322084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cc505-487b-41f7-94af-70a9811656a4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:16.322505 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8734b-222e-4274-a79a-e060464191bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.322946 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8734b-222e-4274-a79a-e060464191bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.323414 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cc505-487b-41f7-94af-70a9811656a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.324293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8734b-222e-4274-a79a-e060464191bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:16.326057 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cc505-487b-41f7-94af-70a9811656a4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.326516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8734b-222e-4274-a79a-e060464191bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.328277 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8734b-222e-4274-a79a-e060464191bc admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.353378 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 273/550] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:16.354599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 277/550] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:16.359502 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8734b-222e-4274-a79a-e060464191bc admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.365984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cc505-487b-41f7-94af-70a9811656a4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.369829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8734b-222e-4274-a79a-e060464191bc admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.374466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bbc54-b11f-445b-a8e4-522050c64f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.375461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bbc54-b11f-445b-a8e4-522050c64f10 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.375885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bbc54-b11f-445b-a8e4-522050c64f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.376361 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bbc54-b11f-445b-a8e4-522050c64f10 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.380847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cc505-487b-41f7-94af-70a9811656a4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.385385 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bbc54-b11f-445b-a8e4-522050c64f10 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.385992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e9095-d376-4299-a491-785b79936283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.386905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e9095-d376-4299-a491-785b79936283 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.387294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e9095-d376-4299-a491-785b79936283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.387685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e9095-d376-4299-a491-785b79936283 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.388519 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bbc54-b11f-445b-a8e4-522050c64f10 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.400215 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e9095-d376-4299-a491-785b79936283 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.402160 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e9095-d376-4299-a491-785b79936283 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.403433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-5f2bbc54-b11f-445b-a8e4-522050c64f10 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:19:16.404905 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 274/551] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:16.411650 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65fd76-264c-446e-b147-15795437243f None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.412089 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65fd76-264c-446e-b147-15795437243f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.412509 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65fd76-264c-446e-b147-15795437243f None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.414758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 275/552] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:16.415651 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65fd76-264c-446e-b147-15795437243f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.425608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-fa4e9095-d376-4299-a491-785b79936283 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:16.432056 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 278/553] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:16.433576 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093da7f9-affb-4339-8946-357756a6e57a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.434013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093da7f9-affb-4339-8946-357756a6e57a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.434439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093da7f9-affb-4339-8946-357756a6e57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.436024 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65fd76-264c-446e-b147-15795437243f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.445274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d5f13-45e0-4b96-9360-af3374180db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.446118 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5f13-45e0-4b96-9360-af3374180db8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.446545 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5f13-45e0-4b96-9360-af3374180db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.447206 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5f13-45e0-4b96-9360-af3374180db8 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.448309 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d5f13-45e0-4b96-9360-af3374180db8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:16.448969 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d5f13-45e0-4b96-9360-af3374180db8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.451007 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d5f13-45e0-4b96-9360-af3374180db8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.456640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-093da7f9-affb-4339-8946-357756a6e57a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:16.457726 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-093da7f9-affb-4339-8946-357756a6e57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:16.466206 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 279/554] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:16.466970 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093da7f9-affb-4339-8946-357756a6e57a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.474902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 276/555] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:16.476944 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093da7f9-affb-4339-8946-357756a6e57a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.483019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d5f13-45e0-4b96-9360-af3374180db8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.485785 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205f2fb-deb5-4385-87cc-282fe002d366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.486510 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f2fb-deb5-4385-87cc-282fe002d366 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.486949 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f2fb-deb5-4385-87cc-282fe002d366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.487300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f2fb-deb5-4385-87cc-282fe002d366 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.488196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205f2fb-deb5-4385-87cc-282fe002d366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:16.488570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205f2fb-deb5-4385-87cc-282fe002d366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.490674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205f2fb-deb5-4385-87cc-282fe002d366 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.494125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d5f13-45e0-4b96-9360-af3374180db8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.498959 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46c773-a642-4068-87af-2b0086b2dfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.500077 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46c773-a642-4068-87af-2b0086b2dfcb admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.500549 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46c773-a642-4068-87af-2b0086b2dfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.501050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46c773-a642-4068-87af-2b0086b2dfcb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.503487 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 280/556] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:16.509137 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205f2fb-deb5-4385-87cc-282fe002d366 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.513733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46c773-a642-4068-87af-2b0086b2dfcb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.515818 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46c773-a642-4068-87af-2b0086b2dfcb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.519479 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205f2fb-deb5-4385-87cc-282fe002d366 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.524723 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b246b-778b-4098-9a36-3d037b685484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.525584 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b246b-778b-4098-9a36-3d037b685484 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.525963 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b246b-778b-4098-9a36-3d037b685484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.526309 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b246b-778b-4098-9a36-3d037b685484 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.536678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-3b46c773-a642-4068-87af-2b0086b2dfcb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:16.538108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b246b-778b-4098-9a36-3d037b685484 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:16.538569 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 277/557] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:16.539591 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46c773-a642-4068-87af-2b0086b2dfcb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.549766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-a55b246b-778b-4098-9a36-3d037b685484 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:16.551254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 281/558] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:16.552115 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b246b-778b-4098-9a36-3d037b685484 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.560947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46c773-a642-4068-87af-2b0086b2dfcb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.565429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1475a64-99c2-48bd-ad41-50dff274a914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.566206 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1475a64-99c2-48bd-ad41-50dff274a914 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.566491 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1475a64-99c2-48bd-ad41-50dff274a914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.566771 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1475a64-99c2-48bd-ad41-50dff274a914 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.570033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b246b-778b-4098-9a36-3d037b685484 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.574665 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a80afd-9a1c-480b-ac71-04bbec8ea96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.575492 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1475a64-99c2-48bd-ad41-50dff274a914 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.575790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a80afd-9a1c-480b-ac71-04bbec8ea96b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.576262 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a80afd-9a1c-480b-ac71-04bbec8ea96b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.576730 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a80afd-9a1c-480b-ac71-04bbec8ea96b admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.577516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1475a64-99c2-48bd-ad41-50dff274a914 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.577877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a80afd-9a1c-480b-ac71-04bbec8ea96b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:16.578390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a80afd-9a1c-480b-ac71-04bbec8ea96b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.580203 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a80afd-9a1c-480b-ac71-04bbec8ea96b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.592652 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-c1475a64-99c2-48bd-ad41-50dff274a914 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 13:19:16.593165 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 282/559] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:16.594201 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a80afd-9a1c-480b-ac71-04bbec8ea96b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.594981 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 278/560] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/users/glance => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:16.603990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1475a64-99c2-48bd-ad41-50dff274a914 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.612965 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a80afd-9a1c-480b-ac71-04bbec8ea96b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.613714 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1475a64-99c2-48bd-ad41-50dff274a914 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.618058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d3cd-7330-448e-90d9-81bc8281b700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.618583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a09f5-8f8e-41f4-8d95-9fa0afb610bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.619241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d3cd-7330-448e-90d9-81bc8281b700 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.619416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a09f5-8f8e-41f4-8d95-9fa0afb610bd admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.619688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a09f5-8f8e-41f4-8d95-9fa0afb610bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.619965 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a09f5-8f8e-41f4-8d95-9fa0afb610bd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.620296 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d3cd-7330-448e-90d9-81bc8281b700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.620762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d3cd-7330-448e-90d9-81bc8281b700 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.621722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529d3cd-7330-448e-90d9-81bc8281b700 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:16.622220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529d3cd-7330-448e-90d9-81bc8281b700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.624035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529d3cd-7330-448e-90d9-81bc8281b700 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.627448 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a09f5-8f8e-41f4-8d95-9fa0afb610bd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.629475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a09f5-8f8e-41f4-8d95-9fa0afb610bd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.633721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 283/561] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:16.634721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d3cd-7330-448e-90d9-81bc8281b700 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.648650 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d3cd-7330-448e-90d9-81bc8281b700 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.649425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-c48a09f5-8f8e-41f4-8d95-9fa0afb610bd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:16.652312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 279/562] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:16.653303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a09f5-8f8e-41f4-8d95-9fa0afb610bd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.660195 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddfa9a-2984-44a4-b3a9-2b95cde08398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.661132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddfa9a-2984-44a4-b3a9-2b95cde08398 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.661436 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddfa9a-2984-44a4-b3a9-2b95cde08398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.661685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddfa9a-2984-44a4-b3a9-2b95cde08398 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.662543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddfa9a-2984-44a4-b3a9-2b95cde08398 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:16.662888 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddfa9a-2984-44a4-b3a9-2b95cde08398 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.664724 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddfa9a-2984-44a4-b3a9-2b95cde08398 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.668398 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a09f5-8f8e-41f4-8d95-9fa0afb610bd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.673264 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66664f-9ff1-4546-ac03-b439757e30c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.674571 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66664f-9ff1-4546-ac03-b439757e30c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.675065 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66664f-9ff1-4546-ac03-b439757e30c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.675736 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66664f-9ff1-4546-ac03-b439757e30c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.687186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66664f-9ff1-4546-ac03-b439757e30c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.687614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 284/563] 10.222.0.60 () {56 vars in 1158 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:16.688496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddfa9a-2984-44a4-b3a9-2b95cde08398 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.689939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66664f-9ff1-4546-ac03-b439757e30c0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.698710 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddfa9a-2984-44a4-b3a9-2b95cde08398 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.704239 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d696e9-5c8c-41da-af63-00443e541279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.705048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d696e9-5c8c-41da-af63-00443e541279 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.705431 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d696e9-5c8c-41da-af63-00443e541279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.705810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d696e9-5c8c-41da-af63-00443e541279 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.706726 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d696e9-5c8c-41da-af63-00443e541279 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:16.707181 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d696e9-5c8c-41da-af63-00443e541279 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.709744 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d696e9-5c8c-41da-af63-00443e541279 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.713185 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-8c66664f-9ff1-4546-ac03-b439757e30c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:16.719163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 280/564] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:16.720602 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66664f-9ff1-4546-ac03-b439757e30c0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.724139 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 285/565] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:16.725114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d696e9-5c8c-41da-af63-00443e541279 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.733100 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66664f-9ff1-4546-ac03-b439757e30c0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.735155 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d696e9-5c8c-41da-af63-00443e541279 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.738473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935d178-a454-463c-8fa7-7feb1265d0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.739917 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935d178-a454-463c-8fa7-7feb1265d0aa admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.740338 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935d178-a454-463c-8fa7-7feb1265d0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.740450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc51b9e-0314-4b9d-9b7b-00152238be6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.740870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935d178-a454-463c-8fa7-7feb1265d0aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.741321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc51b9e-0314-4b9d-9b7b-00152238be6e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.741747 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc51b9e-0314-4b9d-9b7b-00152238be6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.742122 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc51b9e-0314-4b9d-9b7b-00152238be6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.743070 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc51b9e-0314-4b9d-9b7b-00152238be6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:16.743483 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc51b9e-0314-4b9d-9b7b-00152238be6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.745282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc51b9e-0314-4b9d-9b7b-00152238be6e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.752628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935d178-a454-463c-8fa7-7feb1265d0aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.754590 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935d178-a454-463c-8fa7-7feb1265d0aa admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.763345 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 286/566] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:16.763345 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc51b9e-0314-4b9d-9b7b-00152238be6e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.775757 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc51b9e-0314-4b9d-9b7b-00152238be6e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.780265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e80d6-4f03-4b6c-aeb8-3d4142ef1199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.781128 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e80d6-4f03-4b6c-aeb8-3d4142ef1199 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.781470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e80d6-4f03-4b6c-aeb8-3d4142ef1199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.781749 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e80d6-4f03-4b6c-aeb8-3d4142ef1199 admin admin] PATH_INFO: `/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/d61a8e4d64664e68a5710fdf766e4685/roles/bf8b5076a92449fba2f54db6ae519ba6` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.782743 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-d935d178-a454-463c-8fa7-7feb1265d0aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:16.784262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 281/567] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:16.785187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935d178-a454-463c-8fa7-7feb1265d0aa admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.801157 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935d178-a454-463c-8fa7-7feb1265d0aa admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.805037 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e80d6-4f03-4b6c-aeb8-3d4142ef1199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f200887ca764a72b0640476fe3eb41b, user_id=d61a8e4d64664e68a5710fdf766e4685, role_id=bf8b5076a92449fba2f54db6ae519ba6)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.806183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f41c4-029d-45db-bff4-652ed188c29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.807160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f41c4-029d-45db-bff4-652ed188c29d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.807609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f41c4-029d-45db-bff4-652ed188c29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.808066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f41c4-029d-45db-bff4-652ed188c29d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.808166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e80d6-4f03-4b6c-aeb8-3d4142ef1199 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.816724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f41c4-029d-45db-bff4-652ed188c29d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.819779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f41c4-029d-45db-bff4-652ed188c29d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.823287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 287/568] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:19:16 2021] PUT /identity/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/d61a8e4d64664e68a5710fdf766e4685/roles/bf8b5076a92449fba2f54db6ae519ba6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:19:16.824155 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e80d6-4f03-4b6c-aeb8-3d4142ef1199 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.836731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-2c5f41c4-029d-45db-bff4-652ed188c29d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 13:19:16.838591 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 282/569] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/users/cinder => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:16.844943 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f41c4-029d-45db-bff4-652ed188c29d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.865769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f41c4-029d-45db-bff4-652ed188c29d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.896459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e80d6-4f03-4b6c-aeb8-3d4142ef1199 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.901453 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59ca6d-5939-419b-b8f8-fbc4f8862321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.902224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ca6d-5939-419b-b8f8-fbc4f8862321 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.902610 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ca6d-5939-419b-b8f8-fbc4f8862321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.902915 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ca6d-5939-419b-b8f8-fbc4f8862321 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.903885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59ca6d-5939-419b-b8f8-fbc4f8862321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:16.904082 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59ca6d-5939-419b-b8f8-fbc4f8862321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.905885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59ca6d-5939-419b-b8f8-fbc4f8862321 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.919465 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 288/570] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:16.925899 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59ca6d-5939-419b-b8f8-fbc4f8862321 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.936705 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59ca6d-5939-419b-b8f8-fbc4f8862321 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.941760 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33285326-c89f-4a2f-8e28-989d63cac6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.942019 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445fbfb-bbdb-40d3-ad47-3aa6bc4d6082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.943707 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285326-c89f-4a2f-8e28-989d63cac6fa admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.944074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445fbfb-bbdb-40d3-ad47-3aa6bc4d6082 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.944430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445fbfb-bbdb-40d3-ad47-3aa6bc4d6082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.944713 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445fbfb-bbdb-40d3-ad47-3aa6bc4d6082 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.944915 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285326-c89f-4a2f-8e28-989d63cac6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.945547 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285326-c89f-4a2f-8e28-989d63cac6fa admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.946606 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33285326-c89f-4a2f-8e28-989d63cac6fa admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:16.947148 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33285326-c89f-4a2f-8e28-989d63cac6fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.949386 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33285326-c89f-4a2f-8e28-989d63cac6fa admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.953218 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445fbfb-bbdb-40d3-ad47-3aa6bc4d6082 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.955219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445fbfb-bbdb-40d3-ad47-3aa6bc4d6082 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:16.970107 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 283/571] 10.222.0.60 () {56 vars in 1158 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:16.970477 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-2445fbfb-bbdb-40d3-ad47-3aa6bc4d6082 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:16.974945 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 289/572] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:16.977198 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33285326-c89f-4a2f-8e28-989d63cac6fa admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.977901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445fbfb-bbdb-40d3-ad47-3aa6bc4d6082 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:16.988211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33285326-c89f-4a2f-8e28-989d63cac6fa admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.988435 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445fbfb-bbdb-40d3-ad47-3aa6bc4d6082 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:16.993605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e59a7-3fca-4fdb-b5e7-9fb9206889c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.994330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e59a7-3fca-4fdb-b5e7-9fb9206889c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.994614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e59a7-3fca-4fdb-b5e7-9fb9206889c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.995008 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e59a7-3fca-4fdb-b5e7-9fb9206889c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.995377 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398d09-1544-4f74-b17a-c478d67ce7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:16.995843 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e59a7-3fca-4fdb-b5e7-9fb9206889c6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:16.996209 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e59a7-3fca-4fdb-b5e7-9fb9206889c6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:16.996811 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398d09-1544-4f74-b17a-c478d67ce7df admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:16.997286 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398d09-1544-4f74-b17a-c478d67ce7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:16.997765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398d09-1544-4f74-b17a-c478d67ce7df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:16.998199 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e59a7-3fca-4fdb-b5e7-9fb9206889c6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.010415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398d09-1544-4f74-b17a-c478d67ce7df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.012642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 290/573] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:17.012908 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398d09-1544-4f74-b17a-c478d67ce7df admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.019039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e59a7-3fca-4fdb-b5e7-9fb9206889c6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.029436 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e59a7-3fca-4fdb-b5e7-9fb9206889c6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.034028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-e9398d09-1544-4f74-b17a-c478d67ce7df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:17.034251 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe3686-7e8b-4968-b2b8-efb3f6f79495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.035227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe3686-7e8b-4968-b2b8-efb3f6f79495 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.035513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe3686-7e8b-4968-b2b8-efb3f6f79495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.035787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe3686-7e8b-4968-b2b8-efb3f6f79495 admin admin] PATH_INFO: `/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/5b9aff45fefe408fa1667e5298f8ff6c/roles/bf8b5076a92449fba2f54db6ae519ba6` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.037228 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 284/574] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:17.043599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398d09-1544-4f74-b17a-c478d67ce7df admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.054927 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe3686-7e8b-4968-b2b8-efb3f6f79495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f200887ca764a72b0640476fe3eb41b, user_id=5b9aff45fefe408fa1667e5298f8ff6c, role_id=bf8b5076a92449fba2f54db6ae519ba6)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.055274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398d09-1544-4f74-b17a-c478d67ce7df admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.057981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe3686-7e8b-4968-b2b8-efb3f6f79495 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.060023 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e9b91-a47d-497e-a640-67ce2033bed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.060999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e9b91-a47d-497e-a640-67ce2033bed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.061528 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e9b91-a47d-497e-a640-67ce2033bed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.062226 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e9b91-a47d-497e-a640-67ce2033bed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.063222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e9b91-a47d-497e-a640-67ce2033bed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:17.063863 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e9b91-a47d-497e-a640-67ce2033bed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.065900 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e9b91-a47d-497e-a640-67ce2033bed8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.073728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 291/575] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:19:17 2021] PUT /identity/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/5b9aff45fefe408fa1667e5298f8ff6c/roles/bf8b5076a92449fba2f54db6ae519ba6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:19:17.080454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 285/576] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:17.087212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe3686-7e8b-4968-b2b8-efb3f6f79495 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.157584 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe3686-7e8b-4968-b2b8-efb3f6f79495 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.162552 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f238ab-d100-4a8a-970d-c38d414a212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.163479 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f238ab-d100-4a8a-970d-c38d414a212f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.163764 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f238ab-d100-4a8a-970d-c38d414a212f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.164041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f238ab-d100-4a8a-970d-c38d414a212f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.172221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f238ab-d100-4a8a-970d-c38d414a212f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.174538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f238ab-d100-4a8a-970d-c38d414a212f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.189674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-a1f238ab-d100-4a8a-970d-c38d414a212f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:17.190951 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 292/577] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:17.197804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e9b91-a47d-497e-a640-67ce2033bed8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.221275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e9b91-a47d-497e-a640-67ce2033bed8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.229106 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3eded-c78b-4197-82a8-e318c9592e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.229783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3eded-c78b-4197-82a8-e318c9592e82 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.230066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3eded-c78b-4197-82a8-e318c9592e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.230345 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3eded-c78b-4197-82a8-e318c9592e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.231201 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3eded-c78b-4197-82a8-e318c9592e82 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:17.231514 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3eded-c78b-4197-82a8-e318c9592e82 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.233391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3eded-c78b-4197-82a8-e318c9592e82 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.257668 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 286/578] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:17.263595 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f238ab-d100-4a8a-970d-c38d414a212f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.275106 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f238ab-d100-4a8a-970d-c38d414a212f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.289325 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413a3d1-f673-4afa-8592-7691393c5c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.290251 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413a3d1-f673-4afa-8592-7691393c5c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.290533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413a3d1-f673-4afa-8592-7691393c5c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.290811 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413a3d1-f673-4afa-8592-7691393c5c2f admin admin] PATH_INFO: `/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/69bf09fafcb24a13a1ef14cba8da380a/roles/bf8b5076a92449fba2f54db6ae519ba6` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.295826 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89422728-cb8c-4132-ae1e-68908c56b2e6 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.296140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89422728-cb8c-4132-ae1e-68908c56b2e6 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.296384 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89422728-cb8c-4132-ae1e-68908c56b2e6 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.298756 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 287/579] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:19:17.313966 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12099494-0a12-470c-a583-e30dae79789d None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.313966 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12099494-0a12-470c-a583-e30dae79789d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.313966 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12099494-0a12-470c-a583-e30dae79789d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.317673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413a3d1-f673-4afa-8592-7691393c5c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f200887ca764a72b0640476fe3eb41b, user_id=69bf09fafcb24a13a1ef14cba8da380a, role_id=bf8b5076a92449fba2f54db6ae519ba6)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.320763 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413a3d1-f673-4afa-8592-7691393c5c2f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.337583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 293/580] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:19:17 2021] PUT /identity/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/69bf09fafcb24a13a1ef14cba8da380a/roles/bf8b5076a92449fba2f54db6ae519ba6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:19:17.346597 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-12099494-0a12-470c-a583-e30dae79789d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:17.348301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-12099494-0a12-470c-a583-e30dae79789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:17.415674 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 288/581] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Dec 15 13:19:17.462400 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413a3d1-f673-4afa-8592-7691393c5c2f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.472580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413a3d1-f673-4afa-8592-7691393c5c2f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.480658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aac0e-3879-4f30-9db7-99deeb706a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.481465 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aac0e-3879-4f30-9db7-99deeb706a7b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.481750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aac0e-3879-4f30-9db7-99deeb706a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.482049 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aac0e-3879-4f30-9db7-99deeb706a7b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.498151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766aac0e-3879-4f30-9db7-99deeb706a7b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:17.509391 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-766aac0e-3879-4f30-9db7-99deeb706a7b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:17.510640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 294/582] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:17.516874 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12099494-0a12-470c-a583-e30dae79789d None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.530577 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12099494-0a12-470c-a583-e30dae79789d None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.541927 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fe912-9f29-4404-8065-17f07bb0cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.543015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fe912-9f29-4404-8065-17f07bb0cde2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.543550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fe912-9f29-4404-8065-17f07bb0cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.544225 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fe912-9f29-4404-8065-17f07bb0cde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.545266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fe912-9f29-4404-8065-17f07bb0cde2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:17.545777 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fe912-9f29-4404-8065-17f07bb0cde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.547711 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fe912-9f29-4404-8065-17f07bb0cde2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.561779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 289/583] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:17.567489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aac0e-3879-4f30-9db7-99deeb706a7b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.577954 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aac0e-3879-4f30-9db7-99deeb706a7b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.591263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb4962-2744-4d8a-9269-e7ce190686d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.592063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb4962-2744-4d8a-9269-e7ce190686d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.592343 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb4962-2744-4d8a-9269-e7ce190686d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.592615 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb4962-2744-4d8a-9269-e7ce190686d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.612748 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb4962-2744-4d8a-9269-e7ce190686d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.615180 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb4962-2744-4d8a-9269-e7ce190686d9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.636967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-62fb4962-2744-4d8a-9269-e7ce190686d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:17.638395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 295/584] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:17.644506 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fe912-9f29-4404-8065-17f07bb0cde2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.660405 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fe912-9f29-4404-8065-17f07bb0cde2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.671107 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3336da0-a236-4a17-9c9f-492b334fe13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.672190 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3336da0-a236-4a17-9c9f-492b334fe13c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.672733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3336da0-a236-4a17-9c9f-492b334fe13c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.673204 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3336da0-a236-4a17-9c9f-492b334fe13c admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.674481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3336da0-a236-4a17-9c9f-492b334fe13c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:17.675061 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3336da0-a236-4a17-9c9f-492b334fe13c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.677034 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3336da0-a236-4a17-9c9f-492b334fe13c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.699400 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 290/585] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:17.704955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb4962-2744-4d8a-9269-e7ce190686d9 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.716760 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb4962-2744-4d8a-9269-e7ce190686d9 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.717809 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc318b8c-2e9a-4699-bb6f-82f592f29930 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.718097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc318b8c-2e9a-4699-bb6f-82f592f29930 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.718382 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc318b8c-2e9a-4699-bb6f-82f592f29930 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.720769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 291/586] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:19:17.727217 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd8e0c-4335-402e-ba66-31dc56f163b0 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.727669 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd8e0c-4335-402e-ba66-31dc56f163b0 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.727782 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83997926-5356-429b-8b57-6ea156881ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.728225 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd8e0c-4335-402e-ba66-31dc56f163b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.728479 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83997926-5356-429b-8b57-6ea156881ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.728763 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83997926-5356-429b-8b57-6ea156881ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.729039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83997926-5356-429b-8b57-6ea156881ab0 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.741832 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83997926-5356-429b-8b57-6ea156881ab0 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.744868 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83997926-5356-429b-8b57-6ea156881ab0 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.753231 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-afbd8e0c-4335-402e-ba66-31dc56f163b0 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:17.754550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-afbd8e0c-4335-402e-ba66-31dc56f163b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:17.762111 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-83997926-5356-429b-8b57-6ea156881ab0 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 13:19:17.767558 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 292/588] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:19:17.767701 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 296/588] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/users/neutron => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:17.774974 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83997926-5356-429b-8b57-6ea156881ab0 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.784322 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83997926-5356-429b-8b57-6ea156881ab0 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.789386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09451ff3-9bf8-45e9-b644-63a5fb616aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.790041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09451ff3-9bf8-45e9-b644-63a5fb616aff admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.790320 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09451ff3-9bf8-45e9-b644-63a5fb616aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.790598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09451ff3-9bf8-45e9-b644-63a5fb616aff admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.791480 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09451ff3-9bf8-45e9-b644-63a5fb616aff admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:17.791790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09451ff3-9bf8-45e9-b644-63a5fb616aff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.793638 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09451ff3-9bf8-45e9-b644-63a5fb616aff admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.800439 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd8e0c-4335-402e-ba66-31dc56f163b0 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.810305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd8e0c-4335-402e-ba66-31dc56f163b0 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.816868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79e470-3c32-4d3e-9dbf-2449a4d23500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.817741 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79e470-3c32-4d3e-9dbf-2449a4d23500 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.817968 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79e470-3c32-4d3e-9dbf-2449a4d23500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.818299 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79e470-3c32-4d3e-9dbf-2449a4d23500 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.818960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 297/589] 10.222.0.60 () {56 vars in 1160 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:17.822178 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09451ff3-9bf8-45e9-b644-63a5fb616aff admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.829984 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79e470-3c32-4d3e-9dbf-2449a4d23500 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:17.832306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09451ff3-9bf8-45e9-b644-63a5fb616aff admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.838223 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-fa79e470-3c32-4d3e-9dbf-2449a4d23500 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:17.838338 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc78f72-1467-41d2-9751-77980eaa7f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.839104 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78f72-1467-41d2-9751-77980eaa7f61 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.839391 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78f72-1467-41d2-9751-77980eaa7f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.839719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 293/590] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:17.839836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78f72-1467-41d2-9751-77980eaa7f61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.845729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79e470-3c32-4d3e-9dbf-2449a4d23500 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.852881 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc78f72-1467-41d2-9751-77980eaa7f61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.855132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc78f72-1467-41d2-9751-77980eaa7f61 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.855982 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79e470-3c32-4d3e-9dbf-2449a4d23500 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.860654 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72eaa2c-5d02-4e49-8414-cff664f1e193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.861357 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72eaa2c-5d02-4e49-8414-cff664f1e193 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.861638 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72eaa2c-5d02-4e49-8414-cff664f1e193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.861937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72eaa2c-5d02-4e49-8414-cff664f1e193 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.862701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72eaa2c-5d02-4e49-8414-cff664f1e193 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:17.863074 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72eaa2c-5d02-4e49-8414-cff664f1e193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.864703 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72eaa2c-5d02-4e49-8414-cff664f1e193 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.873762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 294/591] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:17.874410 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-9bc78f72-1467-41d2-9751-77980eaa7f61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:17.878677 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 298/592] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:17.879516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72eaa2c-5d02-4e49-8414-cff664f1e193 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.882307 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc78f72-1467-41d2-9751-77980eaa7f61 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.889006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72eaa2c-5d02-4e49-8414-cff664f1e193 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.893239 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc78f72-1467-41d2-9751-77980eaa7f61 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.893609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9ed68-ab8a-4008-9514-0c7fec09f0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.894436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9ed68-ab8a-4008-9514-0c7fec09f0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.894717 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9ed68-ab8a-4008-9514-0c7fec09f0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.895050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9ed68-ab8a-4008-9514-0c7fec09f0f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.898771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b1256-2066-4fae-aecd-c83ebbdc6285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.899451 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b1256-2066-4fae-aecd-c83ebbdc6285 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.899739 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b1256-2066-4fae-aecd-c83ebbdc6285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.900014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b1256-2066-4fae-aecd-c83ebbdc6285 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.900752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b1256-2066-4fae-aecd-c83ebbdc6285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:17.901060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b1256-2066-4fae-aecd-c83ebbdc6285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.903130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b1256-2066-4fae-aecd-c83ebbdc6285 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.906487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9ed68-ab8a-4008-9514-0c7fec09f0f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.908306 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9ed68-ab8a-4008-9514-0c7fec09f0f5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.922960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 299/593] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:17.924608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b1256-2066-4fae-aecd-c83ebbdc6285 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.935319 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b1256-2066-4fae-aecd-c83ebbdc6285 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.941834 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d1e12-b413-418e-a4d8-9b95fadefb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.942698 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1e12-b413-418e-a4d8-9b95fadefb40 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.943051 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1e12-b413-418e-a4d8-9b95fadefb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.943334 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1e12-b413-418e-a4d8-9b95fadefb40 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.947212 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-d1b9ed68-ab8a-4008-9514-0c7fec09f0f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:17.948407 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 295/594] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:17.951297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d1e12-b413-418e-a4d8-9b95fadefb40 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.953503 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d1e12-b413-418e-a4d8-9b95fadefb40 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:17.959765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9ed68-ab8a-4008-9514-0c7fec09f0f5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.969288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-bf7d1e12-b413-418e-a4d8-9b95fadefb40 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:17.975543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 300/595] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:17.978091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d1e12-b413-418e-a4d8-9b95fadefb40 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:17.982391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9ed68-ab8a-4008-9514-0c7fec09f0f5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.988680 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d1e12-b413-418e-a4d8-9b95fadefb40 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:17.994015 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d63ad-fc80-4331-b409-ac4570d5b2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.995074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d63ad-fc80-4331-b409-ac4570d5b2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:17.995374 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d63ad-fc80-4331-b409-ac4570d5b2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:17.995637 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d63ad-fc80-4331-b409-ac4570d5b2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:17.996853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d63ad-fc80-4331-b409-ac4570d5b2b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:17.997168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d63ad-fc80-4331-b409-ac4570d5b2b6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:17.999491 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad7e2d-82d2-4a57-b628-b1a91771edcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:17.999720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d63ad-fc80-4331-b409-ac4570d5b2b6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:18.000153 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7e2d-82d2-4a57-b628-b1a91771edcc admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:18.000430 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7e2d-82d2-4a57-b628-b1a91771edcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:18.000706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7e2d-82d2-4a57-b628-b1a91771edcc admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:18.001453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad7e2d-82d2-4a57-b628-b1a91771edcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:18.001761 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad7e2d-82d2-4a57-b628-b1a91771edcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:18.003385 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad7e2d-82d2-4a57-b628-b1a91771edcc admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:18.019275 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 301/596] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:18.020507 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d63ad-fc80-4331-b409-ac4570d5b2b6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:18.031313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d63ad-fc80-4331-b409-ac4570d5b2b6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:18.033320 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 296/597] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:18.036755 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31de5c-65f6-49cb-9d20-0a74983f7461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:18.037693 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31de5c-65f6-49cb-9d20-0a74983f7461 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:18.038027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31de5c-65f6-49cb-9d20-0a74983f7461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:18.038310 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31de5c-65f6-49cb-9d20-0a74983f7461 admin admin] PATH_INFO: `/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/c9a44a13e31941b5af9579d8bec345ea/roles/bf8b5076a92449fba2f54db6ae519ba6` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:18.039638 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad7e2d-82d2-4a57-b628-b1a91771edcc admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:18.055549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31de5c-65f6-49cb-9d20-0a74983f7461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f200887ca764a72b0640476fe3eb41b, user_id=c9a44a13e31941b5af9579d8bec345ea, role_id=bf8b5076a92449fba2f54db6ae519ba6)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:18.059127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31de5c-65f6-49cb-9d20-0a74983f7461 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:18.065503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad7e2d-82d2-4a57-b628-b1a91771edcc admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:18.078883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 302/598] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:19:18 2021] PUT /identity/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/c9a44a13e31941b5af9579d8bec345ea/roles/bf8b5076a92449fba2f54db6ae519ba6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:19:18.080798 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f995f-156f-4830-a689-7a0bc2396c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:18.081613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f995f-156f-4830-a689-7a0bc2396c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:18.081894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f995f-156f-4830-a689-7a0bc2396c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:18.082174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f995f-156f-4830-a689-7a0bc2396c9c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:18.104333 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f995f-156f-4830-a689-7a0bc2396c9c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:18.106440 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f995f-156f-4830-a689-7a0bc2396c9c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:18.130749 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-3b7f995f-156f-4830-a689-7a0bc2396c9c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 13:19:18.132017 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 297/599] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:19:18 2021] GET /identity/v3/users/swift => generated 83 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:18.138358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31de5c-65f6-49cb-9d20-0a74983f7461 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:18.235705 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31de5c-65f6-49cb-9d20-0a74983f7461 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:18.243254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774f8a1-4b97-4067-9bc3-0dbaa901684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:18.243945 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774f8a1-4b97-4067-9bc3-0dbaa901684e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:18.244221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774f8a1-4b97-4067-9bc3-0dbaa901684e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:18.244495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774f8a1-4b97-4067-9bc3-0dbaa901684e admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:18.245369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774f8a1-4b97-4067-9bc3-0dbaa901684e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:18.245678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774f8a1-4b97-4067-9bc3-0dbaa901684e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:18.247569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774f8a1-4b97-4067-9bc3-0dbaa901684e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:18.285634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 303/600] 10.222.0.60 () {56 vars in 1156 bytes} [Wed Dec 15 13:19:18 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:18.291916 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f995f-156f-4830-a689-7a0bc2396c9c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:18.308503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f995f-156f-4830-a689-7a0bc2396c9c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:18.317227 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b8b70-03f4-4117-8b54-ffdeee6993b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:18.318656 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b8b70-03f4-4117-8b54-ffdeee6993b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:18.318961 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b8b70-03f4-4117-8b54-ffdeee6993b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:18.319239 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b8b70-03f4-4117-8b54-ffdeee6993b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:18.329910 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b8b70-03f4-4117-8b54-ffdeee6993b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:18.331662 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b8b70-03f4-4117-8b54-ffdeee6993b4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:18.342503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 298/601] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:19:18.348193 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774f8a1-4b97-4067-9bc3-0dbaa901684e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:18.361844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774f8a1-4b97-4067-9bc3-0dbaa901684e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:18.367165 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf6288-ed61-482d-aa39-80fe61211d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:18.367946 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf6288-ed61-482d-aa39-80fe61211d09 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:18.368224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf6288-ed61-482d-aa39-80fe61211d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:18.368492 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf6288-ed61-482d-aa39-80fe61211d09 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:18.378836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf6288-ed61-482d-aa39-80fe61211d09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:18.381220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf6288-ed61-482d-aa39-80fe61211d09 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:18.398730 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-dcbf6288-ed61-482d-aa39-80fe61211d09 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:18.400272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 304/602] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:18.405891 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b8b70-03f4-4117-8b54-ffdeee6993b4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:18.421537 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b8b70-03f4-4117-8b54-ffdeee6993b4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:18.431506 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b140a-ece8-4fd1-a4cb-36ae45158a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:18.432168 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b140a-ece8-4fd1-a4cb-36ae45158a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:18.432457 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b140a-ece8-4fd1-a4cb-36ae45158a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:18.432739 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b140a-ece8-4fd1-a4cb-36ae45158a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:18.433487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b140a-ece8-4fd1-a4cb-36ae45158a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:18.433793 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b140a-ece8-4fd1-a4cb-36ae45158a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:18.435429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b140a-ece8-4fd1-a4cb-36ae45158a1f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:18.460441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 299/603] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:18.466688 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf6288-ed61-482d-aa39-80fe61211d09 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:18.479797 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf6288-ed61-482d-aa39-80fe61211d09 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:18.491527 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a77ce-fdc4-4175-b0bf-eafa23532556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:18.492339 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a77ce-fdc4-4175-b0bf-eafa23532556 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:18.492603 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a77ce-fdc4-4175-b0bf-eafa23532556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:18.492876 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a77ce-fdc4-4175-b0bf-eafa23532556 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:18.504065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a77ce-fdc4-4175-b0bf-eafa23532556 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:18.506634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a77ce-fdc4-4175-b0bf-eafa23532556 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:18.524060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-069a77ce-fdc4-4175-b0bf-eafa23532556 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:18.525420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 305/604] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:18.533027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b140a-ece8-4fd1-a4cb-36ae45158a1f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:18.548020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b140a-ece8-4fd1-a4cb-36ae45158a1f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:18.559044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a4100-6fe7-4c6e-b8f9-0b76dde02946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:18.560020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a4100-6fe7-4c6e-b8f9-0b76dde02946 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:18.560501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a4100-6fe7-4c6e-b8f9-0b76dde02946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:18.561025 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a4100-6fe7-4c6e-b8f9-0b76dde02946 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:18.562057 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a4100-6fe7-4c6e-b8f9-0b76dde02946 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:18.562584 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a4100-6fe7-4c6e-b8f9-0b76dde02946 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:18.564791 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a4100-6fe7-4c6e-b8f9-0b76dde02946 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:18.588950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 300/605] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:18.595818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a77ce-fdc4-4175-b0bf-eafa23532556 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:18.611759 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a77ce-fdc4-4175-b0bf-eafa23532556 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:18.621575 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe160c-e180-4097-b887-de7d59c749ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:18.622223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe160c-e180-4097-b887-de7d59c749ee admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:18.622502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe160c-e180-4097-b887-de7d59c749ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:18.622773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe160c-e180-4097-b887-de7d59c749ee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:18.623656 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe160c-e180-4097-b887-de7d59c749ee admin admin] RBAC: Adding query filter params (role.id=bf8b5076a92449fba2f54db6ae519ba6, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=27fd1a6075694b2c833b345485d5319c) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:18.623960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe160c-e180-4097-b887-de7d59c749ee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:18.625780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe160c-e180-4097-b887-de7d59c749ee admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:18.632562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 306/606] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:18 2021] GET /identity/v3/role_assignments?user.id=27fd1a6075694b2c833b345485d5319c&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=bf8b5076a92449fba2f54db6ae519ba6 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:19.986640 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9890bab-ee4f-4a69-9807-5e651546c283 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:19.987204 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9890bab-ee4f-4a69-9807-5e651546c283 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:19.987204 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9890bab-ee4f-4a69-9807-5e651546c283 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:19.989786 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 301/607] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:19.996413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46716a6-2cad-4314-ac3d-3021ef4239a5 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:19.997389 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46716a6-2cad-4314-ac3d-3021ef4239a5 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:19.997879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46716a6-2cad-4314-ac3d-3021ef4239a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.023134 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-e46716a6-2cad-4314-ac3d-3021ef4239a5 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:20.024636 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e46716a6-2cad-4314-ac3d-3021ef4239a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:20.038132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 307/608] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:19:20.078868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9890bab-ee4f-4a69-9807-5e651546c283 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.096197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9890bab-ee4f-4a69-9807-5e651546c283 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.106802 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158f6aa-c9d1-45ca-9315-41be79dd2868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.107605 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158f6aa-c9d1-45ca-9315-41be79dd2868 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.107885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158f6aa-c9d1-45ca-9315-41be79dd2868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.108158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158f6aa-c9d1-45ca-9315-41be79dd2868 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.124718 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158f6aa-c9d1-45ca-9315-41be79dd2868 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:20.132270 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-f158f6aa-c9d1-45ca-9315-41be79dd2868 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:20.133800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 302/609] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:20.139567 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46716a6-2cad-4314-ac3d-3021ef4239a5 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.151739 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46716a6-2cad-4314-ac3d-3021ef4239a5 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.159130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8eb6b0-4f92-488a-a860-873f3b7287e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.160052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8eb6b0-4f92-488a-a860-873f3b7287e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.160544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8eb6b0-4f92-488a-a860-873f3b7287e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.161035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8eb6b0-4f92-488a-a860-873f3b7287e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.161989 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8eb6b0-4f92-488a-a860-873f3b7287e1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:20.162488 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8eb6b0-4f92-488a-a860-873f3b7287e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.164293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8eb6b0-4f92-488a-a860-873f3b7287e1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.179244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 308/610] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:20.184745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158f6aa-c9d1-45ca-9315-41be79dd2868 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.197819 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8460bc-2f6a-48d6-8ef3-11d594f5378c None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.198284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158f6aa-c9d1-45ca-9315-41be79dd2868 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.198640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8460bc-2f6a-48d6-8ef3-11d594f5378c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.199150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8460bc-2f6a-48d6-8ef3-11d594f5378c None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.201325 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 309/611] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:19:20.207132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2a141-335c-474a-a110-8cdd9bfe5e1d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.207416 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2a141-335c-474a-a110-8cdd9bfe5e1d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.207645 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557f98-db95-4aee-8c76-3d1fcfcefb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.207775 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2a141-335c-474a-a110-8cdd9bfe5e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.208827 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557f98-db95-4aee-8c76-3d1fcfcefb13 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.209312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557f98-db95-4aee-8c76-3d1fcfcefb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.209851 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557f98-db95-4aee-8c76-3d1fcfcefb13 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.234083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec557f98-db95-4aee-8c76-3d1fcfcefb13 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.236332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec557f98-db95-4aee-8c76-3d1fcfcefb13 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.242162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-56a2a141-335c-474a-a110-8cdd9bfe5e1d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:20.247173 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-56a2a141-335c-474a-a110-8cdd9bfe5e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:20.264860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 310/612] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:20.266566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-ec557f98-db95-4aee-8c76-3d1fcfcefb13 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:20.268225 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 303/613] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:20.273721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2a141-335c-474a-a110-8cdd9bfe5e1d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.283319 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2a141-335c-474a-a110-8cdd9bfe5e1d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.289758 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2e48b-f2cc-44be-813f-d831f50cffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.290741 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e48b-f2cc-44be-813f-d831f50cffb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.291246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e48b-f2cc-44be-813f-d831f50cffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.291748 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e48b-f2cc-44be-813f-d831f50cffb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.292724 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2e48b-f2cc-44be-813f-d831f50cffb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:20.293220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2e48b-f2cc-44be-813f-d831f50cffb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.295305 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2e48b-f2cc-44be-813f-d831f50cffb7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.302312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557f98-db95-4aee-8c76-3d1fcfcefb13 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.313990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557f98-db95-4aee-8c76-3d1fcfcefb13 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.324284 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 311/614] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:20.325191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a804d-bd19-4dfa-8f79-ef9e6aacd789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.326266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a804d-bd19-4dfa-8f79-ef9e6aacd789 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.326799 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a804d-bd19-4dfa-8f79-ef9e6aacd789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.327285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a804d-bd19-4dfa-8f79-ef9e6aacd789 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.330483 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2e48b-f2cc-44be-813f-d831f50cffb7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.348054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2e48b-f2cc-44be-813f-d831f50cffb7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.349431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a804d-bd19-4dfa-8f79-ef9e6aacd789 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:20.360277 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4d33b-a53f-48b2-94ca-36c29dceb790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.361341 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4d33b-a53f-48b2-94ca-36c29dceb790 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.361819 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4d33b-a53f-48b2-94ca-36c29dceb790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.362369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4d33b-a53f-48b2-94ca-36c29dceb790 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.364099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-530a804d-bd19-4dfa-8f79-ef9e6aacd789 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:20.368381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 304/615] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:20.373484 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a804d-bd19-4dfa-8f79-ef9e6aacd789 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.377864 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4d33b-a53f-48b2-94ca-36c29dceb790 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.383355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4d33b-a53f-48b2-94ca-36c29dceb790 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.393297 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a804d-bd19-4dfa-8f79-ef9e6aacd789 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.403548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ea0ba-a85a-4229-88b9-6532bd943a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.404465 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ea0ba-a85a-4229-88b9-6532bd943a9e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.404938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ea0ba-a85a-4229-88b9-6532bd943a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.405450 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ea0ba-a85a-4229-88b9-6532bd943a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.406427 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ea0ba-a85a-4229-88b9-6532bd943a9e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:20.407025 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ea0ba-a85a-4229-88b9-6532bd943a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.410562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ea0ba-a85a-4229-88b9-6532bd943a9e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.413352 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-57f4d33b-a53f-48b2-94ca-36c29dceb790 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:19:20.418983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 312/616] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/users/nova => generated 82 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:20.423156 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 305/617] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:20.425098 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4d33b-a53f-48b2-94ca-36c29dceb790 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.430031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ea0ba-a85a-4229-88b9-6532bd943a9e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.441563 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4d33b-a53f-48b2-94ca-36c29dceb790 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.447280 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ea0ba-a85a-4229-88b9-6532bd943a9e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.458950 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e33f0-4629-4089-8d96-9fbab6ae53d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.458950 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e33f0-4629-4089-8d96-9fbab6ae53d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.458950 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e33f0-4629-4089-8d96-9fbab6ae53d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.458950 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e33f0-4629-4089-8d96-9fbab6ae53d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.459255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e33f0-4629-4089-8d96-9fbab6ae53d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:20.459255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e33f0-4629-4089-8d96-9fbab6ae53d6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.459255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e33f0-4629-4089-8d96-9fbab6ae53d6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.464929 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43085a95-cff8-44a0-b769-e19fdd03f226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.465717 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43085a95-cff8-44a0-b769-e19fdd03f226 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.466000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43085a95-cff8-44a0-b769-e19fdd03f226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.466266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43085a95-cff8-44a0-b769-e19fdd03f226 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.476015 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 313/618] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:20.477459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ab88b-6559-468d-988b-a3b242f08e76 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.477750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ab88b-6559-468d-988b-a3b242f08e76 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.478029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ab88b-6559-468d-988b-a3b242f08e76 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.481855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43085a95-cff8-44a0-b769-e19fdd03f226 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.483771 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43085a95-cff8-44a0-b769-e19fdd03f226 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.484159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 314/619] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:20.484923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ab88b-6559-468d-988b-a3b242f08e76 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.502231 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-43085a95-cff8-44a0-b769-e19fdd03f226 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:20.502481 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ab88b-6559-468d-988b-a3b242f08e76 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.503796 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 306/620] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:20.505786 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cda8f-5e4a-46b5-869c-47ec1068b0f8 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.506161 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cda8f-5e4a-46b5-869c-47ec1068b0f8 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.506537 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cda8f-5e4a-46b5-869c-47ec1068b0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.507893 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc205e25-9363-4ed4-a446-1d34bc03a6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.508566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc205e25-9363-4ed4-a446-1d34bc03a6ad admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.509011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc205e25-9363-4ed4-a446-1d34bc03a6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.509182 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc205e25-9363-4ed4-a446-1d34bc03a6ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.517558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc205e25-9363-4ed4-a446-1d34bc03a6ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.519332 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc205e25-9363-4ed4-a446-1d34bc03a6ad admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.526983 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-3e8cda8f-5e4a-46b5-869c-47ec1068b0f8 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:20.528254 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-3e8cda8f-5e4a-46b5-869c-47ec1068b0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:20.528989 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 315/621] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:19:20.529677 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc205e25-9363-4ed4-a446-1d34bc03a6ad admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.539876 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc205e25-9363-4ed4-a446-1d34bc03a6ad admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.542326 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 307/622] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:20.543356 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cda8f-5e4a-46b5-869c-47ec1068b0f8 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.548885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fd06a-94de-4850-b077-096cd5d5ddc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.549566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fd06a-94de-4850-b077-096cd5d5ddc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.549851 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fd06a-94de-4850-b077-096cd5d5ddc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.550130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fd06a-94de-4850-b077-096cd5d5ddc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.550915 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fd06a-94de-4850-b077-096cd5d5ddc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:20.555344 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fd06a-94de-4850-b077-096cd5d5ddc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.556995 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fd06a-94de-4850-b077-096cd5d5ddc6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.570601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cda8f-5e4a-46b5-869c-47ec1068b0f8 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.578288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2843fe-d494-42f0-bb50-5c0053aff098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.579121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2843fe-d494-42f0-bb50-5c0053aff098 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.579402 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2843fe-d494-42f0-bb50-5c0053aff098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.579683 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2843fe-d494-42f0-bb50-5c0053aff098 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.582041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 316/623] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:20.584410 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fd06a-94de-4850-b077-096cd5d5ddc6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.591899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2843fe-d494-42f0-bb50-5c0053aff098 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.593887 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2843fe-d494-42f0-bb50-5c0053aff098 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.597086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fd06a-94de-4850-b077-096cd5d5ddc6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.602254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af539cb-b7ff-44f6-9008-1a28a745c9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.603696 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af539cb-b7ff-44f6-9008-1a28a745c9bc admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.604365 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af539cb-b7ff-44f6-9008-1a28a745c9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.604783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af539cb-b7ff-44f6-9008-1a28a745c9bc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.611928 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-0b2843fe-d494-42f0-bb50-5c0053aff098 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:20.613333 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 308/624] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:20.617365 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af539cb-b7ff-44f6-9008-1a28a745c9bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:20.619103 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2843fe-d494-42f0-bb50-5c0053aff098 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.625825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-7af539cb-b7ff-44f6-9008-1a28a745c9bc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:20.627566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 317/625] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:20.630909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2843fe-d494-42f0-bb50-5c0053aff098 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.631870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af539cb-b7ff-44f6-9008-1a28a745c9bc admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.638315 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6124645-95a2-4b56-b142-4d7e559687fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.639403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124645-95a2-4b56-b142-4d7e559687fb admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.640319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124645-95a2-4b56-b142-4d7e559687fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.640708 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124645-95a2-4b56-b142-4d7e559687fb admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.644112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af539cb-b7ff-44f6-9008-1a28a745c9bc admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.649558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13c215-8130-4240-8145-3d01acd1af35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.650424 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6124645-95a2-4b56-b142-4d7e559687fb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.650722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13c215-8130-4240-8145-3d01acd1af35 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.651162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13c215-8130-4240-8145-3d01acd1af35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.651579 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13c215-8130-4240-8145-3d01acd1af35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.652506 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13c215-8130-4240-8145-3d01acd1af35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:20.652932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6124645-95a2-4b56-b142-4d7e559687fb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.653144 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13c215-8130-4240-8145-3d01acd1af35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.654981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13c215-8130-4240-8145-3d01acd1af35 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.670868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-f6124645-95a2-4b56-b142-4d7e559687fb admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 13:19:20.671797 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 318/626] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:20.678080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 309/627] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/users/glance => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:20.678205 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13c215-8130-4240-8145-3d01acd1af35 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.679604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6124645-95a2-4b56-b142-4d7e559687fb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.694206 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6124645-95a2-4b56-b142-4d7e559687fb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.697315 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13c215-8130-4240-8145-3d01acd1af35 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.703641 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1d32d-4eca-4a59-8546-8990f93b9f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.704419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d32d-4eca-4a59-8546-8990f93b9f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.704540 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c33d41-145f-40f9-a56e-d383545d010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.704753 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d32d-4eca-4a59-8546-8990f93b9f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.704956 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d32d-4eca-4a59-8546-8990f93b9f49 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.706005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c33d41-145f-40f9-a56e-d383545d010e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.706491 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c33d41-145f-40f9-a56e-d383545d010e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.707124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c33d41-145f-40f9-a56e-d383545d010e admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.708116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c33d41-145f-40f9-a56e-d383545d010e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:20.708657 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c33d41-145f-40f9-a56e-d383545d010e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.710493 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c33d41-145f-40f9-a56e-d383545d010e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.712216 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1d32d-4eca-4a59-8546-8990f93b9f49 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.714029 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1d32d-4eca-4a59-8546-8990f93b9f49 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.720919 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 319/628] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:20.722357 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c33d41-145f-40f9-a56e-d383545d010e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.732397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c33d41-145f-40f9-a56e-d383545d010e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.732530 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-35e1d32d-4eca-4a59-8546-8990f93b9f49 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:20.733730 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 310/629] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:20.734968 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1d32d-4eca-4a59-8546-8990f93b9f49 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.752455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ad45c-c55b-4e0d-83d1-8a9cfd1942b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.753525 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ad45c-c55b-4e0d-83d1-8a9cfd1942b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.754026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ad45c-c55b-4e0d-83d1-8a9cfd1942b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.754519 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ad45c-c55b-4e0d-83d1-8a9cfd1942b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.756306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ad45c-c55b-4e0d-83d1-8a9cfd1942b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:20.756622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ad45c-c55b-4e0d-83d1-8a9cfd1942b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.758324 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1d32d-4eca-4a59-8546-8990f93b9f49 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.758433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ad45c-c55b-4e0d-83d1-8a9cfd1942b6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.764510 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a93dd-d496-4ae8-ac60-7902a0391f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.765773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a93dd-d496-4ae8-ac60-7902a0391f3c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.766379 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a93dd-d496-4ae8-ac60-7902a0391f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.766960 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a93dd-d496-4ae8-ac60-7902a0391f3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.776984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 320/630] 10.222.0.60 () {56 vars in 1158 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:20.778222 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ad45c-c55b-4e0d-83d1-8a9cfd1942b6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.782380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a93dd-d496-4ae8-ac60-7902a0391f3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.785593 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a93dd-d496-4ae8-ac60-7902a0391f3c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.787288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ad45c-c55b-4e0d-83d1-8a9cfd1942b6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.791836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea54ab-107d-41f9-8553-6fb8e36da84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.792463 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea54ab-107d-41f9-8553-6fb8e36da84c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.792748 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea54ab-107d-41f9-8553-6fb8e36da84c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.793021 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea54ab-107d-41f9-8553-6fb8e36da84c admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.793812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea54ab-107d-41f9-8553-6fb8e36da84c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:20.794118 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea54ab-107d-41f9-8553-6fb8e36da84c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.795957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea54ab-107d-41f9-8553-6fb8e36da84c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.813728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 321/631] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:20.813728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea54ab-107d-41f9-8553-6fb8e36da84c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.813953 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-282a93dd-d496-4ae8-ac60-7902a0391f3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:20.813953 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 311/632] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:20.818791 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a93dd-d496-4ae8-ac60-7902a0391f3c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.828025 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea54ab-107d-41f9-8553-6fb8e36da84c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.828250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a93dd-d496-4ae8-ac60-7902a0391f3c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.832724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b09ae0-b4d5-4eba-b3a6-589d81f404af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.833344 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b09ae0-b4d5-4eba-b3a6-589d81f404af admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.833627 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b09ae0-b4d5-4eba-b3a6-589d81f404af admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.833901 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b09ae0-b4d5-4eba-b3a6-589d81f404af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.834514 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59462a-fec7-4e51-a113-438e02402fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.834733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b09ae0-b4d5-4eba-b3a6-589d81f404af admin admin] RBAC: Adding query filter params (role.id=bf8b5076a92449fba2f54db6ae519ba6, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=d61a8e4d64664e68a5710fdf766e4685) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:20.835083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b09ae0-b4d5-4eba-b3a6-589d81f404af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.835925 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59462a-fec7-4e51-a113-438e02402fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.836399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59462a-fec7-4e51-a113-438e02402fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.836868 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59462a-fec7-4e51-a113-438e02402fd8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.836969 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b09ae0-b4d5-4eba-b3a6-589d81f404af admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.843859 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 312/633] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/role_assignments?user.id=d61a8e4d64664e68a5710fdf766e4685&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=bf8b5076a92449fba2f54db6ae519ba6 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:20.851884 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b09ae0-b4d5-4eba-b3a6-589d81f404af admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.859344 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59462a-fec7-4e51-a113-438e02402fd8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.861214 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59462a-fec7-4e51-a113-438e02402fd8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.871397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b09ae0-b4d5-4eba-b3a6-589d81f404af admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.879334 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 322/634] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:19:20.884441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cabaf4-7dda-41b2-a307-1577d44444dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.885119 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cabaf4-7dda-41b2-a307-1577d44444dc admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.885403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cabaf4-7dda-41b2-a307-1577d44444dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.885686 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cabaf4-7dda-41b2-a307-1577d44444dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.886461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cabaf4-7dda-41b2-a307-1577d44444dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:20.886772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cabaf4-7dda-41b2-a307-1577d44444dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.887922 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59462a-fec7-4e51-a113-438e02402fd8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.888475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cabaf4-7dda-41b2-a307-1577d44444dc admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.901800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 313/635] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:20.909698 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59462a-fec7-4e51-a113-438e02402fd8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.911808 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cabaf4-7dda-41b2-a307-1577d44444dc admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.923977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cabaf4-7dda-41b2-a307-1577d44444dc admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.927616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a233c06-64e8-4573-93fb-9d22d4994e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.928428 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a233c06-64e8-4573-93fb-9d22d4994e0b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.928707 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a233c06-64e8-4573-93fb-9d22d4994e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.929008 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a233c06-64e8-4573-93fb-9d22d4994e0b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.929771 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2d526-399f-4419-83ae-49bd23b25d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:20.930684 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2d526-399f-4419-83ae-49bd23b25d5a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:20.931104 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2d526-399f-4419-83ae-49bd23b25d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:20.931446 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2d526-399f-4419-83ae-49bd23b25d5a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:20.941247 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2d526-399f-4419-83ae-49bd23b25d5a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.944085 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2d526-399f-4419-83ae-49bd23b25d5a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.960148 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a233c06-64e8-4573-93fb-9d22d4994e0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:20.960734 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-eda2d526-399f-4419-83ae-49bd23b25d5a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 13:19:20.961992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a233c06-64e8-4573-93fb-9d22d4994e0b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:20.962543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 314/636] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:20.970222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2d526-399f-4419-83ae-49bd23b25d5a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:20.991667 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2d526-399f-4419-83ae-49bd23b25d5a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:20.997893 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-9a233c06-64e8-4573-93fb-9d22d4994e0b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:21.001053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 323/637] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:21.001764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ca500-fbcf-43d7-a657-9ea4e6375f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.002634 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca500-fbcf-43d7-a657-9ea4e6375f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.002879 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca500-fbcf-43d7-a657-9ea4e6375f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.003210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca500-fbcf-43d7-a657-9ea4e6375f01 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.004127 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ca500-fbcf-43d7-a657-9ea4e6375f01 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.004434 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ca500-fbcf-43d7-a657-9ea4e6375f01 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.007176 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ca500-fbcf-43d7-a657-9ea4e6375f01 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.009184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a233c06-64e8-4573-93fb-9d22d4994e0b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.021113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a233c06-64e8-4573-93fb-9d22d4994e0b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.026621 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbd901-0002-4a88-9b2f-ea363dc80c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.027397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbd901-0002-4a88-9b2f-ea363dc80c32 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.027679 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbd901-0002-4a88-9b2f-ea363dc80c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.027957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbd901-0002-4a88-9b2f-ea363dc80c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.028757 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbd901-0002-4a88-9b2f-ea363dc80c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.029063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbd901-0002-4a88-9b2f-ea363dc80c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.030882 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbd901-0002-4a88-9b2f-ea363dc80c32 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.034451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 315/638] 10.222.0.60 () {56 vars in 1158 bytes} [Wed Dec 15 13:19:20 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:21.036667 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eda4fe-628c-4800-b243-c207fc9f24e8 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.037104 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eda4fe-628c-4800-b243-c207fc9f24e8 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.037551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eda4fe-628c-4800-b243-c207fc9f24e8 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.039489 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 316/639] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:21.045848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe06ca9-eac3-40ec-9bf0-35dfd9722609 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.046348 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe06ca9-eac3-40ec-9bf0-35dfd9722609 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.047044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe06ca9-eac3-40ec-9bf0-35dfd9722609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.050307 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 324/640] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:21.051305 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbd901-0002-4a88-9b2f-ea363dc80c32 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.062108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbd901-0002-4a88-9b2f-ea363dc80c32 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.067106 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b434b-ce04-43c7-aa49-ba73797864f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.067826 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b434b-ce04-43c7-aa49-ba73797864f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.068104 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b434b-ce04-43c7-aa49-ba73797864f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.068378 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b434b-ce04-43c7-aa49-ba73797864f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.069053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-afe06ca9-eac3-40ec-9bf0-35dfd9722609 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:21.070532 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-afe06ca9-eac3-40ec-9bf0-35dfd9722609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:21.078461 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b434b-ce04-43c7-aa49-ba73797864f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.079893 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 317/641] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:19:21.086893 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b434b-ce04-43c7-aa49-ba73797864f9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.087465 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe06ca9-eac3-40ec-9bf0-35dfd9722609 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.090896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 325/642] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:19:21.097213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b434b-ce04-43c7-aa49-ba73797864f9 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.097884 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe06ca9-eac3-40ec-9bf0-35dfd9722609 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.110883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b34c2-e322-4e03-ac3b-764997f41e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.110883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b34c2-e322-4e03-ac3b-764997f41e4b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.110883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b34c2-e322-4e03-ac3b-764997f41e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.110883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b34c2-e322-4e03-ac3b-764997f41e4b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.112039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b34c2-e322-4e03-ac3b-764997f41e4b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.114580 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b34c2-e322-4e03-ac3b-764997f41e4b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.117824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b434b-ce04-43c7-aa49-ba73797864f9 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.128304 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-648b34c2-e322-4e03-ac3b-764997f41e4b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:21.129241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac652500-4b61-4ad9-95cf-05d507e41fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.129829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 318/643] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:21.130568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652500-4b61-4ad9-95cf-05d507e41fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.130679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b34c2-e322-4e03-ac3b-764997f41e4b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.131259 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652500-4b61-4ad9-95cf-05d507e41fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.131763 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652500-4b61-4ad9-95cf-05d507e41fe6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.147068 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b34c2-e322-4e03-ac3b-764997f41e4b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.148608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac652500-4b61-4ad9-95cf-05d507e41fe6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.150590 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac652500-4b61-4ad9-95cf-05d507e41fe6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.151861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6388aa1-0a67-46be-b311-36a92fc33864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.152650 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388aa1-0a67-46be-b311-36a92fc33864 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.152937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388aa1-0a67-46be-b311-36a92fc33864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.153219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388aa1-0a67-46be-b311-36a92fc33864 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.166818 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6388aa1-0a67-46be-b311-36a92fc33864 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:21.175667 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-ac652500-4b61-4ad9-95cf-05d507e41fe6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:21.177099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-d6388aa1-0a67-46be-b311-36a92fc33864 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:21.178665 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 326/644] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:21.178665 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac652500-4b61-4ad9-95cf-05d507e41fe6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.183398 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 319/645] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:21.185000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6388aa1-0a67-46be-b311-36a92fc33864 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.188017 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac652500-4b61-4ad9-95cf-05d507e41fe6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.193300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e297f8b-b991-4033-906d-3baa01d272ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.193967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e297f8b-b991-4033-906d-3baa01d272ee admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.194224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e297f8b-b991-4033-906d-3baa01d272ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.194495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e297f8b-b991-4033-906d-3baa01d272ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.195301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6388aa1-0a67-46be-b311-36a92fc33864 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.195423 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e297f8b-b991-4033-906d-3baa01d272ee admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.195614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e297f8b-b991-4033-906d-3baa01d272ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.197437 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e297f8b-b991-4033-906d-3baa01d272ee admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.200069 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e6bff-d70f-46a0-9569-07ac690b7672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.200774 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e6bff-d70f-46a0-9569-07ac690b7672 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.201066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e6bff-d70f-46a0-9569-07ac690b7672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.201389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e6bff-d70f-46a0-9569-07ac690b7672 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.202215 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e6bff-d70f-46a0-9569-07ac690b7672 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.202521 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e6bff-d70f-46a0-9569-07ac690b7672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.204321 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e6bff-d70f-46a0-9569-07ac690b7672 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.209617 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 327/646] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:21.210681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e297f8b-b991-4033-906d-3baa01d272ee admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.214131 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 320/647] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:21.220174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e6bff-d70f-46a0-9569-07ac690b7672 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.221973 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e297f8b-b991-4033-906d-3baa01d272ee admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.227844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837013c-7a82-4f19-9c6a-7430342da740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.228496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837013c-7a82-4f19-9c6a-7430342da740 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.228875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837013c-7a82-4f19-9c6a-7430342da740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.229152 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837013c-7a82-4f19-9c6a-7430342da740 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.229933 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837013c-7a82-4f19-9c6a-7430342da740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.230235 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837013c-7a82-4f19-9c6a-7430342da740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.231570 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e6bff-d70f-46a0-9569-07ac690b7672 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.231872 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837013c-7a82-4f19-9c6a-7430342da740 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.243810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3dc87-79ce-4a6e-a3b5-633760d0ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.244751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3dc87-79ce-4a6e-a3b5-633760d0ab86 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.245137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3dc87-79ce-4a6e-a3b5-633760d0ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.245511 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3dc87-79ce-4a6e-a3b5-633760d0ab86 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.246690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 328/648] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:21.247784 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837013c-7a82-4f19-9c6a-7430342da740 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.257805 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837013c-7a82-4f19-9c6a-7430342da740 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.262306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07f4fd-b4bc-4653-87d0-76201bf546f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.263109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3dc87-79ce-4a6e-a3b5-633760d0ab86 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.263224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07f4fd-b4bc-4653-87d0-76201bf546f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.263575 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07f4fd-b4bc-4653-87d0-76201bf546f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.263943 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07f4fd-b4bc-4653-87d0-76201bf546f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.264879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07f4fd-b4bc-4653-87d0-76201bf546f1 admin admin] RBAC: Adding query filter params (role.id=bf8b5076a92449fba2f54db6ae519ba6, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=5b9aff45fefe408fa1667e5298f8ff6c) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.264993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3dc87-79ce-4a6e-a3b5-633760d0ab86 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.265402 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07f4fd-b4bc-4653-87d0-76201bf546f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.267318 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07f4fd-b4bc-4653-87d0-76201bf546f1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.273561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 329/649] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/role_assignments?user.id=5b9aff45fefe408fa1667e5298f8ff6c&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=bf8b5076a92449fba2f54db6ae519ba6 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:21.274447 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07f4fd-b4bc-4653-87d0-76201bf546f1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.284225 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07f4fd-b4bc-4653-87d0-76201bf546f1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.286984 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-93b3dc87-79ce-4a6e-a3b5-633760d0ab86 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:21.288652 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 321/650] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:21.295146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3dc87-79ce-4a6e-a3b5-633760d0ab86 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.297142 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c1d17-7cda-4844-aac2-9af71abcd0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.297960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c1d17-7cda-4844-aac2-9af71abcd0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.298515 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c1d17-7cda-4844-aac2-9af71abcd0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.298791 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c1d17-7cda-4844-aac2-9af71abcd0f8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.306611 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3dc87-79ce-4a6e-a3b5-633760d0ab86 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.311692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7785c-ea66-4e9c-8581-2f8818b61453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.312399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7785c-ea66-4e9c-8581-2f8818b61453 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.312779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7785c-ea66-4e9c-8581-2f8818b61453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.313148 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7785c-ea66-4e9c-8581-2f8818b61453 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.313781 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c1d17-7cda-4844-aac2-9af71abcd0f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.314102 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7785c-ea66-4e9c-8581-2f8818b61453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.314503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7785c-ea66-4e9c-8581-2f8818b61453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.316355 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7785c-ea66-4e9c-8581-2f8818b61453 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.316847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c1d17-7cda-4844-aac2-9af71abcd0f8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.329582 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 322/651] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:21.331191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf0400-6c16-4dac-98b1-e48b62f4f186 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.331576 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf0400-6c16-4dac-98b1-e48b62f4f186 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.331948 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf0400-6c16-4dac-98b1-e48b62f4f186 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.334048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 323/652] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:21.335000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf0400-6c16-4dac-98b1-e48b62f4f186 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.335329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-d30c1d17-7cda-4844-aac2-9af71abcd0f8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:21.342890 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 330/653] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:21.346778 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fb603-33c0-437f-8b61-d342322c7798 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.347652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fb603-33c0-437f-8b61-d342322c7798 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.348881 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fb603-33c0-437f-8b61-d342322c7798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.363523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf0400-6c16-4dac-98b1-e48b62f4f186 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.371430 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c7055-8c7f-4ece-94a7-c5b2f03576b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.372564 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c7055-8c7f-4ece-94a7-c5b2f03576b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.372999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c7055-8c7f-4ece-94a7-c5b2f03576b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.373466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c7055-8c7f-4ece-94a7-c5b2f03576b2 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.375038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-087fb603-33c0-437f-8b61-d342322c7798 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:21.376351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-087fb603-33c0-437f-8b61-d342322c7798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:21.384436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c7055-8c7f-4ece-94a7-c5b2f03576b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.385131 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 331/654] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:21.386950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c7055-8c7f-4ece-94a7-c5b2f03576b2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.391141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fb603-33c0-437f-8b61-d342322c7798 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.403508 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-d60c7055-8c7f-4ece-94a7-c5b2f03576b2 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 13:19:21.405155 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 324/655] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/users/neutron => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:21.407857 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fb603-33c0-437f-8b61-d342322c7798 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.414897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c7055-8c7f-4ece-94a7-c5b2f03576b2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.421682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d69569-6b92-4b39-832f-2aac0a8d0284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.422554 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d69569-6b92-4b39-832f-2aac0a8d0284 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.423322 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d69569-6b92-4b39-832f-2aac0a8d0284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.423727 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d69569-6b92-4b39-832f-2aac0a8d0284 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.424709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d69569-6b92-4b39-832f-2aac0a8d0284 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.425165 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d69569-6b92-4b39-832f-2aac0a8d0284 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.427369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d69569-6b92-4b39-832f-2aac0a8d0284 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.427711 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c7055-8c7f-4ece-94a7-c5b2f03576b2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.438565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f2e23-6493-4ff7-bc53-0d4192dc5f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.439661 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f2e23-6493-4ff7-bc53-0d4192dc5f63 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.440061 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f2e23-6493-4ff7-bc53-0d4192dc5f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.440432 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f2e23-6493-4ff7-bc53-0d4192dc5f63 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.441420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f2e23-6493-4ff7-bc53-0d4192dc5f63 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.441940 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 332/656] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:21.442229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f2e23-6493-4ff7-bc53-0d4192dc5f63 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.443240 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d69569-6b92-4b39-832f-2aac0a8d0284 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.444580 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f2e23-6493-4ff7-bc53-0d4192dc5f63 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.461440 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d69569-6b92-4b39-832f-2aac0a8d0284 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.467144 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3bf4f-5036-4d28-a15c-c7b4065bdb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.468446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3bf4f-5036-4d28-a15c-c7b4065bdb94 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.468833 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3bf4f-5036-4d28-a15c-c7b4065bdb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.469222 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3bf4f-5036-4d28-a15c-c7b4065bdb94 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.470705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 325/657] 10.222.0.60 () {56 vars in 1160 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:21.477413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f2e23-6493-4ff7-bc53-0d4192dc5f63 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.482833 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3bf4f-5036-4d28-a15c-c7b4065bdb94 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:21.488764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f2e23-6493-4ff7-bc53-0d4192dc5f63 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.492207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-d3c3bf4f-5036-4d28-a15c-c7b4065bdb94 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:21.493939 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 333/658] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:21.494355 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ae82d-ae0b-4179-a5a1-b65a0a35162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.495242 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ae82d-ae0b-4179-a5a1-b65a0a35162f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.495662 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ae82d-ae0b-4179-a5a1-b65a0a35162f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.496136 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ae82d-ae0b-4179-a5a1-b65a0a35162f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.497134 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ae82d-ae0b-4179-a5a1-b65a0a35162f admin admin] RBAC: Adding query filter params (role.id=bf8b5076a92449fba2f54db6ae519ba6, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=69bf09fafcb24a13a1ef14cba8da380a) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.497647 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ae82d-ae0b-4179-a5a1-b65a0a35162f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.499663 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3bf4f-5036-4d28-a15c-c7b4065bdb94 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.499962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ae82d-ae0b-4179-a5a1-b65a0a35162f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.506880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 326/659] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/role_assignments?user.id=69bf09fafcb24a13a1ef14cba8da380a&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=bf8b5076a92449fba2f54db6ae519ba6 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:21.507910 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ae82d-ae0b-4179-a5a1-b65a0a35162f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.514753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3bf4f-5036-4d28-a15c-c7b4065bdb94 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.521140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ae82d-ae0b-4179-a5a1-b65a0a35162f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.522578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016b4f5-0bf4-4228-bd04-bf2d7a04b572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.522578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b4f5-0bf4-4228-bd04-bf2d7a04b572 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.522815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b4f5-0bf4-4228-bd04-bf2d7a04b572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.522923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b4f5-0bf4-4228-bd04-bf2d7a04b572 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.527701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dfe0d-2084-4e87-a26f-baf6a7cb3d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.528670 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dfe0d-2084-4e87-a26f-baf6a7cb3d41 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.529102 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dfe0d-2084-4e87-a26f-baf6a7cb3d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.529528 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dfe0d-2084-4e87-a26f-baf6a7cb3d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.530470 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dfe0d-2084-4e87-a26f-baf6a7cb3d41 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.530978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dfe0d-2084-4e87-a26f-baf6a7cb3d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.532592 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016b4f5-0bf4-4228-bd04-bf2d7a04b572 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.534319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dfe0d-2084-4e87-a26f-baf6a7cb3d41 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.534489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016b4f5-0bf4-4228-bd04-bf2d7a04b572 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.545813 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 327/660] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:21.547049 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 334/661] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:19:21.552737 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dfe0d-2084-4e87-a26f-baf6a7cb3d41 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.553554 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016b4f5-0bf4-4228-bd04-bf2d7a04b572 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.563055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016b4f5-0bf4-4228-bd04-bf2d7a04b572 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.564196 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dfe0d-2084-4e87-a26f-baf6a7cb3d41 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.568977 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1285d-96f2-4b48-b91c-cd8235581190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.569860 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40ea30-5f49-475f-8973-9e1b8c262cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.570213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1285d-96f2-4b48-b91c-cd8235581190 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.570639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1285d-96f2-4b48-b91c-cd8235581190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.571031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40ea30-5f49-475f-8973-9e1b8c262cab admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.571247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1285d-96f2-4b48-b91c-cd8235581190 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.571490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40ea30-5f49-475f-8973-9e1b8c262cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.571934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40ea30-5f49-475f-8973-9e1b8c262cab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.584235 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1285d-96f2-4b48-b91c-cd8235581190 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.586478 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1285d-96f2-4b48-b91c-cd8235581190 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.587645 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40ea30-5f49-475f-8973-9e1b8c262cab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.589831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40ea30-5f49-475f-8973-9e1b8c262cab admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.607169 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-81d1285d-96f2-4b48-b91c-cd8235581190 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:21.608987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 335/662] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:21.612633 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-9b40ea30-5f49-475f-8973-9e1b8c262cab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:21.612633 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 328/663] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:21.615629 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1285d-96f2-4b48-b91c-cd8235581190 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.617237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40ea30-5f49-475f-8973-9e1b8c262cab admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.628483 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1285d-96f2-4b48-b91c-cd8235581190 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.630210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40ea30-5f49-475f-8973-9e1b8c262cab admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.634399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e157a-7450-4b7f-9221-aca297001794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.635330 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e0a78-dc59-49b3-ab93-e5bd162c7b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.635555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e157a-7450-4b7f-9221-aca297001794 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.636026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e157a-7450-4b7f-9221-aca297001794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.636280 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e0a78-dc59-49b3-ab93-e5bd162c7b2b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.636601 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e157a-7450-4b7f-9221-aca297001794 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.636721 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e0a78-dc59-49b3-ab93-e5bd162c7b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.637088 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e0a78-dc59-49b3-ab93-e5bd162c7b2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.637800 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e157a-7450-4b7f-9221-aca297001794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.638046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e0a78-dc59-49b3-ab93-e5bd162c7b2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.638400 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e157a-7450-4b7f-9221-aca297001794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.638522 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e0a78-dc59-49b3-ab93-e5bd162c7b2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.640285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e0a78-dc59-49b3-ab93-e5bd162c7b2b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.640606 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e157a-7450-4b7f-9221-aca297001794 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.656023 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 336/664] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:21.661631 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 329/665] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:21.664272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e157a-7450-4b7f-9221-aca297001794 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.664410 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e0a78-dc59-49b3-ab93-e5bd162c7b2b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.676874 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e157a-7450-4b7f-9221-aca297001794 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.677273 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e0a78-dc59-49b3-ab93-e5bd162c7b2b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.683559 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a55979-9963-491b-bb7c-fa491494f476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.683559 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a55979-9963-491b-bb7c-fa491494f476 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.683559 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a55979-9963-491b-bb7c-fa491494f476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.688785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a55979-9963-491b-bb7c-fa491494f476 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.692249 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a55979-9963-491b-bb7c-fa491494f476 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.694470 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a55979-9963-491b-bb7c-fa491494f476 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.695432 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bde9fd-e296-40a8-a349-fcfb19d19f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.696473 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bde9fd-e296-40a8-a349-fcfb19d19f25 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.696926 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bde9fd-e296-40a8-a349-fcfb19d19f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.697399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bde9fd-e296-40a8-a349-fcfb19d19f25 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.706588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bde9fd-e296-40a8-a349-fcfb19d19f25 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.709531 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bde9fd-e296-40a8-a349-fcfb19d19f25 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.712339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-35a55979-9963-491b-bb7c-fa491494f476 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:21.714630 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 330/666] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:21.721574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a55979-9963-491b-bb7c-fa491494f476 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.726144 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-b9bde9fd-e296-40a8-a349-fcfb19d19f25 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 13:19:21.729521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 337/667] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/users/swift => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:21.734740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bde9fd-e296-40a8-a349-fcfb19d19f25 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.736692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a55979-9963-491b-bb7c-fa491494f476 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.743133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a1199-8ccb-4b6a-8cd2-f2a56d4b5eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.743956 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a1199-8ccb-4b6a-8cd2-f2a56d4b5eed admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.744603 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a1199-8ccb-4b6a-8cd2-f2a56d4b5eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.745015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a1199-8ccb-4b6a-8cd2-f2a56d4b5eed admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.745930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a1199-8ccb-4b6a-8cd2-f2a56d4b5eed admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.746367 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a1199-8ccb-4b6a-8cd2-f2a56d4b5eed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.747419 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bde9fd-e296-40a8-a349-fcfb19d19f25 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.748705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a1199-8ccb-4b6a-8cd2-f2a56d4b5eed admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.753450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89484c4-14cc-4cea-81ec-b1ba02ba2982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.754359 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89484c4-14cc-4cea-81ec-b1ba02ba2982 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.754836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89484c4-14cc-4cea-81ec-b1ba02ba2982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.755394 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89484c4-14cc-4cea-81ec-b1ba02ba2982 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.756488 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89484c4-14cc-4cea-81ec-b1ba02ba2982 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.756981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89484c4-14cc-4cea-81ec-b1ba02ba2982 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.759747 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89484c4-14cc-4cea-81ec-b1ba02ba2982 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.764924 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 331/668] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:21.772972 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a1199-8ccb-4b6a-8cd2-f2a56d4b5eed admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.789341 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a1199-8ccb-4b6a-8cd2-f2a56d4b5eed admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.793732 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 338/669] 10.222.0.60 () {56 vars in 1156 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:21.797023 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed234a-ee51-4fc2-9d14-4c4a3109544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.797660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed234a-ee51-4fc2-9d14-4c4a3109544c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.798203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed234a-ee51-4fc2-9d14-4c4a3109544c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.798488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed234a-ee51-4fc2-9d14-4c4a3109544c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.799462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed234a-ee51-4fc2-9d14-4c4a3109544c admin admin] RBAC: Adding query filter params (role.id=bf8b5076a92449fba2f54db6ae519ba6, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=c9a44a13e31941b5af9579d8bec345ea) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.799760 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed234a-ee51-4fc2-9d14-4c4a3109544c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.800112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89484c4-14cc-4cea-81ec-b1ba02ba2982 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.801920 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed234a-ee51-4fc2-9d14-4c4a3109544c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.809265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 332/670] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/role_assignments?user.id=c9a44a13e31941b5af9579d8bec345ea&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=bf8b5076a92449fba2f54db6ae519ba6 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:21.811959 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89484c4-14cc-4cea-81ec-b1ba02ba2982 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.818147 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bb7b2-687c-4324-8236-168d56c65eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.819615 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bb7b2-687c-4324-8236-168d56c65eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.819615 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bb7b2-687c-4324-8236-168d56c65eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.820429 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bb7b2-687c-4324-8236-168d56c65eb5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.833466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bb7b2-687c-4324-8236-168d56c65eb5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.835676 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bb7b2-687c-4324-8236-168d56c65eb5 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.855788 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-ef3bb7b2-687c-4324-8236-168d56c65eb5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:21.857627 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 339/671] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:21.864066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed234a-ee51-4fc2-9d14-4c4a3109544c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.875318 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed234a-ee51-4fc2-9d14-4c4a3109544c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.880942 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0e96a-2847-4f1c-9506-be0fca6678f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.881938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0e96a-2847-4f1c-9506-be0fca6678f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.882369 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0e96a-2847-4f1c-9506-be0fca6678f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.882799 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0e96a-2847-4f1c-9506-be0fca6678f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.883780 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0e96a-2847-4f1c-9506-be0fca6678f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.884241 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0e96a-2847-4f1c-9506-be0fca6678f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.886156 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0e96a-2847-4f1c-9506-be0fca6678f5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.901267 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 333/672] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:21.907730 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bb7b2-687c-4324-8236-168d56c65eb5 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.918682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bb7b2-687c-4324-8236-168d56c65eb5 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.924121 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcda3b-d0f4-4932-8f09-fb51305e4dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.925283 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcda3b-d0f4-4932-8f09-fb51305e4dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.925714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcda3b-d0f4-4932-8f09-fb51305e4dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.926293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcda3b-d0f4-4932-8f09-fb51305e4dbc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.934721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcda3b-d0f4-4932-8f09-fb51305e4dbc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.937079 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcda3b-d0f4-4932-8f09-fb51305e4dbc admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:21.952912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-acfcda3b-d0f4-4932-8f09-fb51305e4dbc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:21.955502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 340/673] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:21.963693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0e96a-2847-4f1c-9506-be0fca6678f5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:21.975842 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0e96a-2847-4f1c-9506-be0fca6678f5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:21.980924 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58963b-afce-42c1-b895-e6ae44feaf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:21.981833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58963b-afce-42c1-b895-e6ae44feaf20 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:21.982264 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58963b-afce-42c1-b895-e6ae44feaf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:21.982716 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58963b-afce-42c1-b895-e6ae44feaf20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:21.983695 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58963b-afce-42c1-b895-e6ae44feaf20 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:21.984150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58963b-afce-42c1-b895-e6ae44feaf20 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:21.986237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58963b-afce-42c1-b895-e6ae44feaf20 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:22.000008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 334/674] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:22.012081 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcda3b-d0f4-4932-8f09-fb51305e4dbc admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:22.024845 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcda3b-d0f4-4932-8f09-fb51305e4dbc admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:22.035583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225550b-6938-466d-8cf8-c013e33581e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:22.036536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225550b-6938-466d-8cf8-c013e33581e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:22.036818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225550b-6938-466d-8cf8-c013e33581e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:22.037093 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225550b-6938-466d-8cf8-c013e33581e8 admin admin] PATH_INFO: `/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/27fd1a6075694b2c833b345485d5319c/roles/bf8b5076a92449fba2f54db6ae519ba6` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:22.053595 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225550b-6938-466d-8cf8-c013e33581e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f200887ca764a72b0640476fe3eb41b, user_id=27fd1a6075694b2c833b345485d5319c, role_id=bf8b5076a92449fba2f54db6ae519ba6)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:22.056388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225550b-6938-466d-8cf8-c013e33581e8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:22.077223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 341/675] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:19:22 2021] PUT /identity/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/27fd1a6075694b2c833b345485d5319c/roles/bf8b5076a92449fba2f54db6ae519ba6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:19:23.783810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbcbd1-3cf9-4743-9d45-29f97fc5a9c5 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:23.784314 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbcbd1-3cf9-4743-9d45-29f97fc5a9c5 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:23.784414 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbcbd1-3cf9-4743-9d45-29f97fc5a9c5 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:23.786407 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 335/676] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:23.792536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031a8ea-a41b-4ad2-9269-35480ab20459 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:23.792931 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031a8ea-a41b-4ad2-9269-35480ab20459 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:23.793109 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031a8ea-a41b-4ad2-9269-35480ab20459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:23.814174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-e031a8ea-a41b-4ad2-9269-35480ab20459 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:23.815386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e031a8ea-a41b-4ad2-9269-35480ab20459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:23.878523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 342/677] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:19:23.917181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbcbd1-3cf9-4743-9d45-29f97fc5a9c5 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:23.936399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbcbd1-3cf9-4743-9d45-29f97fc5a9c5 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:23.940837 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8936e-df19-4aa4-8b25-ba50cf23a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:23.942101 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8936e-df19-4aa4-8b25-ba50cf23a63d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:23.942381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8936e-df19-4aa4-8b25-ba50cf23a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:23.942658 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8936e-df19-4aa4-8b25-ba50cf23a63d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:23.955585 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8936e-df19-4aa4-8b25-ba50cf23a63d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:23.962362 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-88d8936e-df19-4aa4-8b25-ba50cf23a63d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:19:23.963836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 336/678] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:19:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:23.969722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031a8ea-a41b-4ad2-9269-35480ab20459 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:23.984763 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031a8ea-a41b-4ad2-9269-35480ab20459 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:23.989858 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436a50f-835c-45b4-be05-895aafbbfd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:23.990484 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436a50f-835c-45b4-be05-895aafbbfd9d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:23.990766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436a50f-835c-45b4-be05-895aafbbfd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:23.991472 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436a50f-835c-45b4-be05-895aafbbfd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:23.992260 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436a50f-835c-45b4-be05-895aafbbfd9d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:23.992568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436a50f-835c-45b4-be05-895aafbbfd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:23.994449 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436a50f-835c-45b4-be05-895aafbbfd9d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.006912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 343/679] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:24.012892 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8936e-df19-4aa4-8b25-ba50cf23a63d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.023867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8936e-df19-4aa4-8b25-ba50cf23a63d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.030963 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73280d91-dd88-4639-bced-2ba91f1c4b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.031833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280d91-dd88-4639-bced-2ba91f1c4b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.032235 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280d91-dd88-4639-bced-2ba91f1c4b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.032608 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280d91-dd88-4639-bced-2ba91f1c4b1b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.049203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73280d91-dd88-4639-bced-2ba91f1c4b1b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.051799 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73280d91-dd88-4639-bced-2ba91f1c4b1b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.069046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-73280d91-dd88-4639-bced-2ba91f1c4b1b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:24.070695 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 337/680] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:24.076491 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436a50f-835c-45b4-be05-895aafbbfd9d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.096938 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436a50f-835c-45b4-be05-895aafbbfd9d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.101897 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a481430-e9d9-4ff7-8141-a93e06c1be2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.102558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a481430-e9d9-4ff7-8141-a93e06c1be2b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.102919 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a481430-e9d9-4ff7-8141-a93e06c1be2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.103203 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a481430-e9d9-4ff7-8141-a93e06c1be2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.103948 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a481430-e9d9-4ff7-8141-a93e06c1be2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:24.104258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a481430-e9d9-4ff7-8141-a93e06c1be2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.105840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a481430-e9d9-4ff7-8141-a93e06c1be2b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.129395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 344/681] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:24.135097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73280d91-dd88-4639-bced-2ba91f1c4b1b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.145457 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73280d91-dd88-4639-bced-2ba91f1c4b1b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.162319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469f7f-37bf-4fa3-9ac6-498178e8a2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.163314 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469f7f-37bf-4fa3-9ac6-498178e8a2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.163696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469f7f-37bf-4fa3-9ac6-498178e8a2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.164075 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469f7f-37bf-4fa3-9ac6-498178e8a2d7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.179775 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28469f7f-37bf-4fa3-9ac6-498178e8a2d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.181955 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28469f7f-37bf-4fa3-9ac6-498178e8a2d7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.200692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-28469f7f-37bf-4fa3-9ac6-498178e8a2d7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:19:24.202248 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 338/682] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/users/nova => generated 82 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:24.208009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a481430-e9d9-4ff7-8141-a93e06c1be2b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.229634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a481430-e9d9-4ff7-8141-a93e06c1be2b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.236166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8177fe8-ec29-4363-9ac0-cb6e112b2704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.236862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8177fe8-ec29-4363-9ac0-cb6e112b2704 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.237144 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8177fe8-ec29-4363-9ac0-cb6e112b2704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.237425 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8177fe8-ec29-4363-9ac0-cb6e112b2704 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.238888 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8177fe8-ec29-4363-9ac0-cb6e112b2704 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:24.239207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8177fe8-ec29-4363-9ac0-cb6e112b2704 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.241182 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8177fe8-ec29-4363-9ac0-cb6e112b2704 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.274569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 345/683] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:24.280162 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469f7f-37bf-4fa3-9ac6-498178e8a2d7 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.294918 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469f7f-37bf-4fa3-9ac6-498178e8a2d7 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.303636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972016c-08e0-4a32-b9a8-ae2f642d2c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.304388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972016c-08e0-4a32-b9a8-ae2f642d2c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.304773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972016c-08e0-4a32-b9a8-ae2f642d2c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.305186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972016c-08e0-4a32-b9a8-ae2f642d2c62 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.321781 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972016c-08e0-4a32-b9a8-ae2f642d2c62 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.325736 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972016c-08e0-4a32-b9a8-ae2f642d2c62 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.343731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 339/684] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:19:24.350252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8177fe8-ec29-4363-9ac0-cb6e112b2704 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.369188 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8177fe8-ec29-4363-9ac0-cb6e112b2704 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.380390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af884b-419e-4c3e-8458-0dbec56e7412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.381193 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af884b-419e-4c3e-8458-0dbec56e7412 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.381479 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af884b-419e-4c3e-8458-0dbec56e7412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.381753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af884b-419e-4c3e-8458-0dbec56e7412 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.398521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af884b-419e-4c3e-8458-0dbec56e7412 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.400386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af884b-419e-4c3e-8458-0dbec56e7412 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.429403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-39af884b-419e-4c3e-8458-0dbec56e7412 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:24.430942 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 346/685] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:24.436683 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972016c-08e0-4a32-b9a8-ae2f642d2c62 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.446046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972016c-08e0-4a32-b9a8-ae2f642d2c62 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.465628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0166b-1d68-4c7d-8323-a6d75e4b60c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.466493 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0166b-1d68-4c7d-8323-a6d75e4b60c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.466876 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0166b-1d68-4c7d-8323-a6d75e4b60c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.467261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0166b-1d68-4c7d-8323-a6d75e4b60c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.468142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0166b-1d68-4c7d-8323-a6d75e4b60c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:24.468557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0166b-1d68-4c7d-8323-a6d75e4b60c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.470292 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0166b-1d68-4c7d-8323-a6d75e4b60c5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.490136 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 340/686] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:24.496080 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af884b-419e-4c3e-8458-0dbec56e7412 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.511907 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af884b-419e-4c3e-8458-0dbec56e7412 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.521565 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f2889-e410-4c06-be9a-b507c03a226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.522361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2889-e410-4c06-be9a-b507c03a226b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.522643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2889-e410-4c06-be9a-b507c03a226b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.522940 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2889-e410-4c06-be9a-b507c03a226b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.539511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f2889-e410-4c06-be9a-b507c03a226b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.541541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f2889-e410-4c06-be9a-b507c03a226b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.563135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-8d3f2889-e410-4c06-be9a-b507c03a226b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:24.564663 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 347/687] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:24.570507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0166b-1d68-4c7d-8323-a6d75e4b60c5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.593885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0166b-1d68-4c7d-8323-a6d75e4b60c5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.603804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99bf70-b430-4dae-bc2e-e181a78bcf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.604749 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99bf70-b430-4dae-bc2e-e181a78bcf27 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.605198 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99bf70-b430-4dae-bc2e-e181a78bcf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.605619 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99bf70-b430-4dae-bc2e-e181a78bcf27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.606576 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99bf70-b430-4dae-bc2e-e181a78bcf27 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:24.607028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99bf70-b430-4dae-bc2e-e181a78bcf27 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.607932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713b27-c183-4183-a293-df002d894a02 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.608221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713b27-c183-4183-a293-df002d894a02 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.608500 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713b27-c183-4183-a293-df002d894a02 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.609423 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99bf70-b430-4dae-bc2e-e181a78bcf27 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.610495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 348/688] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:19:24.617212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851119c-a467-41cd-b21d-4cdfdca29ecd None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.617212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851119c-a467-41cd-b21d-4cdfdca29ecd None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.617212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851119c-a467-41cd-b21d-4cdfdca29ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.625783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 341/689] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:24.630613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99bf70-b430-4dae-bc2e-e181a78bcf27 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.641282 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99bf70-b430-4dae-bc2e-e181a78bcf27 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.649661 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed24640-68bf-4abd-8a3d-0891d3fc0459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.649661 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed24640-68bf-4abd-8a3d-0891d3fc0459 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.649661 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed24640-68bf-4abd-8a3d-0891d3fc0459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.649661 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed24640-68bf-4abd-8a3d-0891d3fc0459 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.649999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed24640-68bf-4abd-8a3d-0891d3fc0459 admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=d61a8e4d64664e68a5710fdf766e4685) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:24.649999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed24640-68bf-4abd-8a3d-0891d3fc0459 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.654868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed24640-68bf-4abd-8a3d-0891d3fc0459 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.660688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 342/690] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/role_assignments?user.id=d61a8e4d64664e68a5710fdf766e4685&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:24.668429 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-5851119c-a467-41cd-b21d-4cdfdca29ecd None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:24.669732 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5851119c-a467-41cd-b21d-4cdfdca29ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:24.681447 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 349/691] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:19:24.718137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed24640-68bf-4abd-8a3d-0891d3fc0459 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.729090 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed24640-68bf-4abd-8a3d-0891d3fc0459 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.734285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab597c9a-daec-4386-ad54-6f776e57f70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.735145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab597c9a-daec-4386-ad54-6f776e57f70f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.735432 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab597c9a-daec-4386-ad54-6f776e57f70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.735762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab597c9a-daec-4386-ad54-6f776e57f70f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.747408 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab597c9a-daec-4386-ad54-6f776e57f70f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.749303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab597c9a-daec-4386-ad54-6f776e57f70f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.767403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-ab597c9a-daec-4386-ad54-6f776e57f70f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:24.768955 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 343/692] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:24.776115 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851119c-a467-41cd-b21d-4cdfdca29ecd None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.785757 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851119c-a467-41cd-b21d-4cdfdca29ecd None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.790517 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd31d37-d76a-4180-994d-897a1d3f247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.791230 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd31d37-d76a-4180-994d-897a1d3f247e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.791514 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd31d37-d76a-4180-994d-897a1d3f247e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.792382 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd31d37-d76a-4180-994d-897a1d3f247e admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.793130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd31d37-d76a-4180-994d-897a1d3f247e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:24.793770 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd31d37-d76a-4180-994d-897a1d3f247e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.795268 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd31d37-d76a-4180-994d-897a1d3f247e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.809555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 350/693] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:24.815570 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab597c9a-daec-4386-ad54-6f776e57f70f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.820495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6d110-2064-4138-a405-824166323955 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.820827 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6d110-2064-4138-a405-824166323955 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.821114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6d110-2064-4138-a405-824166323955 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.824036 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 351/694] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:24.829692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab597c9a-daec-4386-ad54-6f776e57f70f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.830143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20433b-97cf-4099-8f83-6e61d201aa60 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.830430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20433b-97cf-4099-8f83-6e61d201aa60 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.830761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20433b-97cf-4099-8f83-6e61d201aa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.835141 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b9d97-2daf-43ce-9be9-467b5f30ac59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.835865 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b9d97-2daf-43ce-9be9-467b5f30ac59 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.836210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b9d97-2daf-43ce-9be9-467b5f30ac59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.836498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b9d97-2daf-43ce-9be9-467b5f30ac59 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.837306 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b9d97-2daf-43ce-9be9-467b5f30ac59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.839443 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b9d97-2daf-43ce-9be9-467b5f30ac59 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.859672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-8d20433b-97cf-4099-8f83-6e61d201aa60 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:24.861123 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8d20433b-97cf-4099-8f83-6e61d201aa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:24.871202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 344/695] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:19:24 2021] POST /identity/v3/users => generated 254 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:24.877285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 352/696] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:19:24.902601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b9d97-2daf-43ce-9be9-467b5f30ac59 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.913909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b9d97-2daf-43ce-9be9-467b5f30ac59 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.918956 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa01891-a897-4003-bb20-59df609c368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.919846 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa01891-a897-4003-bb20-59df609c368d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.920174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa01891-a897-4003-bb20-59df609c368d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.920501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa01891-a897-4003-bb20-59df609c368d admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.921451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa01891-a897-4003-bb20-59df609c368d admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.922885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-bfa01891-a897-4003-bb20-59df609c368d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:24.922885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:19:24.922885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:19:24.923846 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa01891-a897-4003-bb20-59df609c368d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.938788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-bfa01891-a897-4003-bb20-59df609c368d admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 13:19:24.940479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 345/697] 10.222.0.60 () {56 vars in 1150 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:24.947707 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20433b-97cf-4099-8f83-6e61d201aa60 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.958734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20433b-97cf-4099-8f83-6e61d201aa60 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.962662 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff2690-4e4a-4488-9764-29dea9c292b0 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.962978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff2690-4e4a-4488-9764-29dea9c292b0 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.963362 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff2690-4e4a-4488-9764-29dea9c292b0 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.963742 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a08b2-557b-4416-8287-9cfd726acd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.964417 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a08b2-557b-4416-8287-9cfd726acd81 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.964747 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a08b2-557b-4416-8287-9cfd726acd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.965023 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a08b2-557b-4416-8287-9cfd726acd81 admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.965186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 346/698] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:24.965753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a08b2-557b-4416-8287-9cfd726acd81 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:24.966117 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a08b2-557b-4416-8287-9cfd726acd81 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:24.967287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-892a08b2-557b-4416-8287-9cfd726acd81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:24.967287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:19:24.967287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:19:24.968239 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a08b2-557b-4416-8287-9cfd726acd81 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:24.973033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884e396-435c-4224-8439-685e18dc4af7 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.973355 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884e396-435c-4224-8439-685e18dc4af7 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.973584 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884e396-435c-4224-8439-685e18dc4af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.973976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 353/699] 10.222.0.60 () {56 vars in 1145 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:24.980491 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a08b2-557b-4416-8287-9cfd726acd81 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:24.991343 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a08b2-557b-4416-8287-9cfd726acd81 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:24.996609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105b1d3-4806-4983-b0ec-e920ab41ebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:24.997428 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105b1d3-4806-4983-b0ec-e920ab41ebeb admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:24.997712 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105b1d3-4806-4983-b0ec-e920ab41ebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:24.997986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105b1d3-4806-4983-b0ec-e920ab41ebeb admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:24.998784 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105b1d3-4806-4983-b0ec-e920ab41ebeb admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:24.999131 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105b1d3-4806-4983-b0ec-e920ab41ebeb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.000887 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105b1d3-4806-4983-b0ec-e920ab41ebeb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.007964 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e884e396-435c-4224-8439-685e18dc4af7 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:25.008708 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 354/700] 10.222.0.60 () {56 vars in 1145 bytes} [Wed Dec 15 13:19:24 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:25.009192 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e884e396-435c-4224-8439-685e18dc4af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:25.029519 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 347/701] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:25.051857 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ba0f-fa4d-47f5-b9e1-095cad9ddb51 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.052174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ba0f-fa4d-47f5-b9e1-095cad9ddb51 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.052407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ba0f-fa4d-47f5-b9e1-095cad9ddb51 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.054617 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 355/702] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:25.060859 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad3456-a4b5-4eae-9a41-24435997aea1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.061209 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad3456-a4b5-4eae-9a41-24435997aea1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.061402 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad3456-a4b5-4eae-9a41-24435997aea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.065517 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11ba0f-fa4d-47f5-b9e1-095cad9ddb51 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.083810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11ba0f-fa4d-47f5-b9e1-095cad9ddb51 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.091648 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-87ad3456-a4b5-4eae-9a41-24435997aea1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:25.092899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-87ad3456-a4b5-4eae-9a41-24435997aea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:25.108158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 348/703] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:25.115036 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb505ad7-60f3-4d24-9251-95a4f9d28f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.115036 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb505ad7-60f3-4d24-9251-95a4f9d28f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.115036 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb505ad7-60f3-4d24-9251-95a4f9d28f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.115036 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb505ad7-60f3-4d24-9251-95a4f9d28f5a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.144690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb505ad7-60f3-4d24-9251-95a4f9d28f5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:25.151879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-eb505ad7-60f3-4d24-9251-95a4f9d28f5a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:25.153507 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 356/704] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:25.157199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad3456-a4b5-4eae-9a41-24435997aea1 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.169302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb505ad7-60f3-4d24-9251-95a4f9d28f5a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.170761 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad3456-a4b5-4eae-9a41-24435997aea1 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.176588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb255a43-8569-4e27-9253-3b426c2747f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.177804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb255a43-8569-4e27-9253-3b426c2747f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.178353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb255a43-8569-4e27-9253-3b426c2747f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.178836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb255a43-8569-4e27-9253-3b426c2747f0 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.179808 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb255a43-8569-4e27-9253-3b426c2747f0 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.182015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb255a43-8569-4e27-9253-3b426c2747f0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.188360 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb505ad7-60f3-4d24-9251-95a4f9d28f5a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.195805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-bb255a43-8569-4e27-9253-3b426c2747f0 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 13:19:25.197703 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 349/705] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/services/network => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:25.204414 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb255a43-8569-4e27-9253-3b426c2747f0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.206619 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2220d-2958-4baf-8ae4-8901e6996249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.207617 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2220d-2958-4baf-8ae4-8901e6996249 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.208124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2220d-2958-4baf-8ae4-8901e6996249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.208614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2220d-2958-4baf-8ae4-8901e6996249 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.209613 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2220d-2958-4baf-8ae4-8901e6996249 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:25.210132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2220d-2958-4baf-8ae4-8901e6996249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.213065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2220d-2958-4baf-8ae4-8901e6996249 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.218568 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb255a43-8569-4e27-9253-3b426c2747f0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.224425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55f3fd-3282-4617-be7f-bce2abd0da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.230750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55f3fd-3282-4617-be7f-bce2abd0da31 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.230750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55f3fd-3282-4617-be7f-bce2abd0da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.230750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55f3fd-3282-4617-be7f-bce2abd0da31 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.231091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 357/706] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:25.231167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55f3fd-3282-4617-be7f-bce2abd0da31 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:25.231167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55f3fd-3282-4617-be7f-bce2abd0da31 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.231167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-2f55f3fd-3282-4617-be7f-bce2abd0da31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:25.231167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:19:25.231167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:19:25.231167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55f3fd-3282-4617-be7f-bce2abd0da31 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.232116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2220d-2958-4baf-8ae4-8901e6996249 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.233774 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 350/707] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/services?name=network => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:25.240321 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55f3fd-3282-4617-be7f-bce2abd0da31 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.246090 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2220d-2958-4baf-8ae4-8901e6996249 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.250656 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55f3fd-3282-4617-be7f-bce2abd0da31 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.251497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c35bd-f165-4109-a08a-5b8bec763729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.252542 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c35bd-f165-4109-a08a-5b8bec763729 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.252818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c35bd-f165-4109-a08a-5b8bec763729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.253090 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c35bd-f165-4109-a08a-5b8bec763729 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.260153 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0b7ff-b97b-4fa8-97e8-e3c69de10fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.261150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0b7ff-b97b-4fa8-97e8-e3c69de10fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.262102 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0b7ff-b97b-4fa8-97e8-e3c69de10fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.262652 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0b7ff-b97b-4fa8-97e8-e3c69de10fd1 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.263596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0b7ff-b97b-4fa8-97e8-e3c69de10fd1 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:25.264169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0b7ff-b97b-4fa8-97e8-e3c69de10fd1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.266073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0b7ff-b97b-4fa8-97e8-e3c69de10fd1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.269068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c35bd-f165-4109-a08a-5b8bec763729 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.270943 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c35bd-f165-4109-a08a-5b8bec763729 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.272792 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 351/708] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/services?type=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:25.293762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-e11c35bd-f165-4109-a08a-5b8bec763729 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:25.295309 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 358/709] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:25.302649 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0b7ff-b97b-4fa8-97e8-e3c69de10fd1 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.315518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0b7ff-b97b-4fa8-97e8-e3c69de10fd1 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.321240 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb978013-831a-494a-bee0-5d4de404dd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.322232 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb978013-831a-494a-bee0-5d4de404dd6f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.322690 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb978013-831a-494a-bee0-5d4de404dd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.323160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb978013-831a-494a-bee0-5d4de404dd6f admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.324087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb978013-831a-494a-bee0-5d4de404dd6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:25.324588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb978013-831a-494a-bee0-5d4de404dd6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.326413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb978013-831a-494a-bee0-5d4de404dd6f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.345920 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 352/710] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:25.352561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c35bd-f165-4109-a08a-5b8bec763729 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.364674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c35bd-f165-4109-a08a-5b8bec763729 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.369639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502c33c-3c95-49f0-8773-7aded8b42427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.370769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502c33c-3c95-49f0-8773-7aded8b42427 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.371257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502c33c-3c95-49f0-8773-7aded8b42427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.371705 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502c33c-3c95-49f0-8773-7aded8b42427 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.383926 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502c33c-3c95-49f0-8773-7aded8b42427 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.386255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502c33c-3c95-49f0-8773-7aded8b42427 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.403468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-a502c33c-3c95-49f0-8773-7aded8b42427 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 13:19:25.404966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 359/711] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:25.411568 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb978013-831a-494a-bee0-5d4de404dd6f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.423355 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb978013-831a-494a-bee0-5d4de404dd6f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.429312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762385b-0d6b-4222-b91b-3153ffd674cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.430411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762385b-0d6b-4222-b91b-3153ffd674cc admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.430931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762385b-0d6b-4222-b91b-3153ffd674cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.431441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762385b-0d6b-4222-b91b-3153ffd674cc admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.432565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762385b-0d6b-4222-b91b-3153ffd674cc admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:25.433113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762385b-0d6b-4222-b91b-3153ffd674cc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.435471 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762385b-0d6b-4222-b91b-3153ffd674cc admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.460736 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 353/712] 10.222.0.60 () {56 vars in 1156 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:25.464464 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502c33c-3c95-49f0-8773-7aded8b42427 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.475200 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502c33c-3c95-49f0-8773-7aded8b42427 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.480178 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3918c-5af6-4432-8370-c39a00112a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.481189 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3918c-5af6-4432-8370-c39a00112a8e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.481729 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3918c-5af6-4432-8370-c39a00112a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.482220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3918c-5af6-4432-8370-c39a00112a8e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.492109 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3918c-5af6-4432-8370-c39a00112a8e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.494263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3918c-5af6-4432-8370-c39a00112a8e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.505232 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 360/713] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:19:25.512173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762385b-0d6b-4222-b91b-3153ffd674cc admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.523342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762385b-0d6b-4222-b91b-3153ffd674cc admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.528168 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87017a-7cd7-4bb5-b8c2-48f27facdee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.529265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87017a-7cd7-4bb5-b8c2-48f27facdee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.529795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87017a-7cd7-4bb5-b8c2-48f27facdee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.530288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87017a-7cd7-4bb5-b8c2-48f27facdee8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.541909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87017a-7cd7-4bb5-b8c2-48f27facdee8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.544059 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87017a-7cd7-4bb5-b8c2-48f27facdee8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.563763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-ba87017a-7cd7-4bb5-b8c2-48f27facdee8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:25.570229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 354/714] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:25.571786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3918c-5af6-4432-8370-c39a00112a8e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.580870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3918c-5af6-4432-8370-c39a00112a8e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.585558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b33c8-39dc-47f3-aa8c-568722d69812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.586475 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b33c8-39dc-47f3-aa8c-568722d69812 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.586983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b33c8-39dc-47f3-aa8c-568722d69812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.587458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b33c8-39dc-47f3-aa8c-568722d69812 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.588378 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b33c8-39dc-47f3-aa8c-568722d69812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:25.588879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b33c8-39dc-47f3-aa8c-568722d69812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.590654 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b33c8-39dc-47f3-aa8c-568722d69812 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.606955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 361/715] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:25.609834 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87017a-7cd7-4bb5-b8c2-48f27facdee8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.620391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87017a-7cd7-4bb5-b8c2-48f27facdee8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.625205 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f6a6e-e9a4-41f8-9ee1-f60ef03ad52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.626295 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f6a6e-e9a4-41f8-9ee1-f60ef03ad52f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.626786 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f6a6e-e9a4-41f8-9ee1-f60ef03ad52f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.627340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f6a6e-e9a4-41f8-9ee1-f60ef03ad52f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.634991 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f6a6e-e9a4-41f8-9ee1-f60ef03ad52f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.637252 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f6a6e-e9a4-41f8-9ee1-f60ef03ad52f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.651692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-b59f6a6e-e9a4-41f8-9ee1-f60ef03ad52f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:25.653145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 355/716] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:25.660331 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b33c8-39dc-47f3-aa8c-568722d69812 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.671024 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b33c8-39dc-47f3-aa8c-568722d69812 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.676779 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acad3fb-c0f4-4d9a-ad69-43ff8bcf0dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.677766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acad3fb-c0f4-4d9a-ad69-43ff8bcf0dfc admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.678246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acad3fb-c0f4-4d9a-ad69-43ff8bcf0dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.678753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acad3fb-c0f4-4d9a-ad69-43ff8bcf0dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.679780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acad3fb-c0f4-4d9a-ad69-43ff8bcf0dfc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:25.680321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acad3fb-c0f4-4d9a-ad69-43ff8bcf0dfc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.683176 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acad3fb-c0f4-4d9a-ad69-43ff8bcf0dfc admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.697257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 362/717] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:25.704182 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f6a6e-e9a4-41f8-9ee1-f60ef03ad52f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:25.715019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f6a6e-e9a4-41f8-9ee1-f60ef03ad52f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:25.719856 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec6c3a-b393-4a42-ab76-82caf3aba46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:25.720784 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec6c3a-b393-4a42-ab76-82caf3aba46e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:25.721262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec6c3a-b393-4a42-ab76-82caf3aba46e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:25.721786 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec6c3a-b393-4a42-ab76-82caf3aba46e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:25.723472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec6c3a-b393-4a42-ab76-82caf3aba46e admin admin] RBAC: Adding query filter params (role.id=bf8b5076a92449fba2f54db6ae519ba6, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=27fd1a6075694b2c833b345485d5319c) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:25.724051 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec6c3a-b393-4a42-ab76-82caf3aba46e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:25.726212 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec6c3a-b393-4a42-ab76-82caf3aba46e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:25.736852 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 356/718] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:25 2021] GET /identity/v3/role_assignments?user.id=27fd1a6075694b2c833b345485d5319c&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=bf8b5076a92449fba2f54db6ae519ba6 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:27.664208 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c9115-9beb-4d40-a6c5-0f3fd5c46a8d None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:27.665210 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c9115-9beb-4d40-a6c5-0f3fd5c46a8d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:27.665717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c9115-9beb-4d40-a6c5-0f3fd5c46a8d None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:27.667728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 363/719] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:27.673960 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67580ac4-ee06-40cc-a98d-624d3db09168 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:27.674789 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67580ac4-ee06-40cc-a98d-624d3db09168 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:27.675294 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67580ac4-ee06-40cc-a98d-624d3db09168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:27.698550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-67580ac4-ee06-40cc-a98d-624d3db09168 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:27.699791 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-67580ac4-ee06-40cc-a98d-624d3db09168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:27.712940 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 357/720] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:27.747606 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c9115-9beb-4d40-a6c5-0f3fd5c46a8d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:27.764887 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c9115-9beb-4d40-a6c5-0f3fd5c46a8d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:27.770013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfd792-f896-4c29-902b-5396689a230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:27.770822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfd792-f896-4c29-902b-5396689a230e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:27.771130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfd792-f896-4c29-902b-5396689a230e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:27.771406 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfd792-f896-4c29-902b-5396689a230e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:27.794315 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfd792-f896-4c29-902b-5396689a230e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:27.801542 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-ccbfd792-f896-4c29-902b-5396689a230e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:19:27.802975 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 364/721] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:19:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:27.809114 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67580ac4-ee06-40cc-a98d-624d3db09168 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:27.824761 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67580ac4-ee06-40cc-a98d-624d3db09168 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:27.834701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7db42-5d63-459b-a29a-44d464a41efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:27.835403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7db42-5d63-459b-a29a-44d464a41efb admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:27.835689 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7db42-5d63-459b-a29a-44d464a41efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:27.835971 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7db42-5d63-459b-a29a-44d464a41efb admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:27.836751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7db42-5d63-459b-a29a-44d464a41efb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:27.837065 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7db42-5d63-459b-a29a-44d464a41efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:27.838692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7db42-5d63-459b-a29a-44d464a41efb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:27.848498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 358/722] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:27.854831 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfd792-f896-4c29-902b-5396689a230e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:27.867384 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfd792-f896-4c29-902b-5396689a230e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:27.871822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ea33f-4b17-49af-bc24-5d121b1a5a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:27.872612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ea33f-4b17-49af-bc24-5d121b1a5a5c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:27.872895 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ea33f-4b17-49af-bc24-5d121b1a5a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:27.874970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb9e80-06ec-4264-b37a-b08070c3409d None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:27.875258 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb9e80-06ec-4264-b37a-b08070c3409d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:27.875444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ea33f-4b17-49af-bc24-5d121b1a5a5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:27.875611 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb9e80-06ec-4264-b37a-b08070c3409d None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:27.877366 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 359/723] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:27.885211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c94e08-f226-4cc3-b62d-25b448aa079e None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:27.885715 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c94e08-f226-4cc3-b62d-25b448aa079e None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:27.886150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c94e08-f226-4cc3-b62d-25b448aa079e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:27.892753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ea33f-4b17-49af-bc24-5d121b1a5a5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:27.895571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ea33f-4b17-49af-bc24-5d121b1a5a5c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:27.913075 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-26c94e08-f226-4cc3-b62d-25b448aa079e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:27.914327 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-26c94e08-f226-4cc3-b62d-25b448aa079e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:27.916047 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-f43ea33f-4b17-49af-bc24-5d121b1a5a5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:27.917693 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 365/724] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:27.919118 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ac9bb-06df-465d-a497-97c1e52be6bb None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:27.919626 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ac9bb-06df-465d-a497-97c1e52be6bb None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:27.920095 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ac9bb-06df-465d-a497-97c1e52be6bb None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:27.922572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 366/725] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:27.923477 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ac9bb-06df-465d-a497-97c1e52be6bb None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:27.932010 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 360/726] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:19:27.933308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e916-2f5e-49e4-acc4-951a5dc0a516 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:27.938865 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e916-2f5e-49e4-acc4-951a5dc0a516 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:27.938865 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e916-2f5e-49e4-acc4-951a5dc0a516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:27.944082 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ac9bb-06df-465d-a497-97c1e52be6bb None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:27.959634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45905e-eede-4962-8127-73fab0715ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:27.960297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45905e-eede-4962-8127-73fab0715ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:27.960579 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45905e-eede-4962-8127-73fab0715ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:27.960856 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45905e-eede-4962-8127-73fab0715ae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:27.961591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45905e-eede-4962-8127-73fab0715ae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:27.961899 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45905e-eede-4962-8127-73fab0715ae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:27.963877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45905e-eede-4962-8127-73fab0715ae0 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:27.968231 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-c162e916-2f5e-49e4-acc4-951a5dc0a516 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:27.969689 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c162e916-2f5e-49e4-acc4-951a5dc0a516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:27.976906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 367/727] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:27.977730 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45905e-eede-4962-8127-73fab0715ae0 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:27.979729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 361/728] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:19:27.984721 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162e916-2f5e-49e4-acc4-951a5dc0a516 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.000451 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45905e-eede-4962-8127-73fab0715ae0 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.003831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162e916-2f5e-49e4-acc4-951a5dc0a516 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.009517 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8c17-afa4-4cc2-8cba-05f0704f4662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.010302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8c17-afa4-4cc2-8cba-05f0704f4662 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.010579 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8c17-afa4-4cc2-8cba-05f0704f4662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.010877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8c17-afa4-4cc2-8cba-05f0704f4662 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.016550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79054d-d9c4-4e6f-b179-c552a2557294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.017316 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79054d-d9c4-4e6f-b179-c552a2557294 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.017592 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79054d-d9c4-4e6f-b179-c552a2557294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.017858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79054d-d9c4-4e6f-b179-c552a2557294 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.028067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a8c17-afa4-4cc2-8cba-05f0704f4662 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:28.029796 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79054d-d9c4-4e6f-b179-c552a2557294 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.031860 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79054d-d9c4-4e6f-b179-c552a2557294 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.045155 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-bd2a8c17-afa4-4cc2-8cba-05f0704f4662 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:28.047265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-1b79054d-d9c4-4e6f-b179-c552a2557294 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:19:28.047516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 368/729] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:28.048466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8c17-afa4-4cc2-8cba-05f0704f4662 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.053651 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 362/730] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Dec 15 13:19:27 2021] GET /identity/v3/users/nova => generated 82 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:28.058637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79054d-d9c4-4e6f-b179-c552a2557294 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.068651 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79054d-d9c4-4e6f-b179-c552a2557294 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.069076 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8c17-afa4-4cc2-8cba-05f0704f4662 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.073470 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c8af4-ce61-4802-919d-f41db6d4a66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.074278 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c8af4-ce61-4802-919d-f41db6d4a66f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.074719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c8af4-ce61-4802-919d-f41db6d4a66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.074829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed9113-c393-4b5d-b94d-05d4da6a05e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.075286 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c8af4-ce61-4802-919d-f41db6d4a66f admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.075733 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed9113-c393-4b5d-b94d-05d4da6a05e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.076164 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed9113-c393-4b5d-b94d-05d4da6a05e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.076485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c8af4-ce61-4802-919d-f41db6d4a66f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:28.076589 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed9113-c393-4b5d-b94d-05d4da6a05e7 admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.077023 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c8af4-ce61-4802-919d-f41db6d4a66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.077562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed9113-c393-4b5d-b94d-05d4da6a05e7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.078720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-caed9113-c393-4b5d-b94d-05d4da6a05e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:28.078720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:19:28.078720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:19:28.079189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c8af4-ce61-4802-919d-f41db6d4a66f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.079934 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed9113-c393-4b5d-b94d-05d4da6a05e7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.089173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 363/731] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:28.094265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c8af4-ce61-4802-919d-f41db6d4a66f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.102988 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 369/732] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Dec 15 13:19:28 2021] POST /identity/v3/services => generated 251 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:28.104187 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed9113-c393-4b5d-b94d-05d4da6a05e7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.115553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c8af4-ce61-4802-919d-f41db6d4a66f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.143876 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cea90-8fd4-4fb3-8fa8-74ddb6526a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.144854 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cea90-8fd4-4fb3-8fa8-74ddb6526a66 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.145308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cea90-8fd4-4fb3-8fa8-74ddb6526a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.145756 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cea90-8fd4-4fb3-8fa8-74ddb6526a66 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.146818 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cea90-8fd4-4fb3-8fa8-74ddb6526a66 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:28.147329 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cea90-8fd4-4fb3-8fa8-74ddb6526a66 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.149403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cea90-8fd4-4fb3-8fa8-74ddb6526a66 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.168490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 364/733] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:28.172031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed9113-c393-4b5d-b94d-05d4da6a05e7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.179253 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c923f00-6e12-4be9-9929-ce3a0353ec34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.180210 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c923f00-6e12-4be9-9929-ce3a0353ec34 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.180548 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c923f00-6e12-4be9-9929-ce3a0353ec34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.180835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c923f00-6e12-4be9-9929-ce3a0353ec34 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.181052 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cea90-8fd4-4fb3-8fa8-74ddb6526a66 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.194880 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c923f00-6e12-4be9-9929-ce3a0353ec34 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.196059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c923f00-6e12-4be9-9929-ce3a0353ec34 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.205313 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cea90-8fd4-4fb3-8fa8-74ddb6526a66 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.212722 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bac17-8523-4dbb-ad99-71f615d0d9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.213515 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bac17-8523-4dbb-ad99-71f615d0d9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.213793 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bac17-8523-4dbb-ad99-71f615d0d9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.214065 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bac17-8523-4dbb-ad99-71f615d0d9b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.218096 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-0c923f00-6e12-4be9-9929-ce3a0353ec34 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:28.219612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 370/734] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:28.220900 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2eb67-444e-4336-9d3d-28093d245701 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.221190 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2eb67-444e-4336-9d3d-28093d245701 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.222051 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2eb67-444e-4336-9d3d-28093d245701 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.224568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 371/735] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:28.226353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2eb67-444e-4336-9d3d-28093d245701 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.229760 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bac17-8523-4dbb-ad99-71f615d0d9b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.231695 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bac17-8523-4dbb-ad99-71f615d0d9b4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.241661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2eb67-444e-4336-9d3d-28093d245701 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.247065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972b59c-dc66-4915-9c8e-41e7ae2eb62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.247735 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972b59c-dc66-4915-9c8e-41e7ae2eb62e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.248018 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972b59c-dc66-4915-9c8e-41e7ae2eb62e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.248295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972b59c-dc66-4915-9c8e-41e7ae2eb62e admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.249037 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972b59c-dc66-4915-9c8e-41e7ae2eb62e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:28.249346 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972b59c-dc66-4915-9c8e-41e7ae2eb62e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.250976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972b59c-dc66-4915-9c8e-41e7ae2eb62e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.252698 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-4d7bac17-8523-4dbb-ad99-71f615d0d9b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:28.255418 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 365/736] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:28.256688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c08c5-1879-4661-8c9b-25ff2f3bc930 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.256972 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c08c5-1879-4661-8c9b-25ff2f3bc930 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.257281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c08c5-1879-4661-8c9b-25ff2f3bc930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.269776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 372/737] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:28.270628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972b59c-dc66-4915-9c8e-41e7ae2eb62e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.286084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972b59c-dc66-4915-9c8e-41e7ae2eb62e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.286886 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-4e6c08c5-1879-4661-8c9b-25ff2f3bc930 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:28.288146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4e6c08c5-1879-4661-8c9b-25ff2f3bc930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:28.292045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ca16c-1753-4893-a1fa-6d6f90223e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.293161 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ca16c-1753-4893-a1fa-6d6f90223e67 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.293629 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ca16c-1753-4893-a1fa-6d6f90223e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.294091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ca16c-1753-4893-a1fa-6d6f90223e67 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.295249 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ca16c-1753-4893-a1fa-6d6f90223e67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:28.295890 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ca16c-1753-4893-a1fa-6d6f90223e67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.297274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 366/738] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:28 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:28.298238 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c08c5-1879-4661-8c9b-25ff2f3bc930 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.298445 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ca16c-1753-4893-a1fa-6d6f90223e67 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.319014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 373/739] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:28.325666 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c08c5-1879-4661-8c9b-25ff2f3bc930 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.337347 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ca16c-1753-4893-a1fa-6d6f90223e67 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.337529 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5fe1c-e564-4395-bc8c-af4a76179a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.338335 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5fe1c-e564-4395-bc8c-af4a76179a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.338613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5fe1c-e564-4395-bc8c-af4a76179a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.338944 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5fe1c-e564-4395-bc8c-af4a76179a1f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.349081 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5fe1c-e564-4395-bc8c-af4a76179a1f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.350504 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ca16c-1753-4893-a1fa-6d6f90223e67 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.351145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5fe1c-e564-4395-bc8c-af4a76179a1f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.356716 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27805c3-67a6-4313-81a0-56abb85c60d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.357825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27805c3-67a6-4313-81a0-56abb85c60d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.358593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27805c3-67a6-4313-81a0-56abb85c60d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.359049 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27805c3-67a6-4313-81a0-56abb85c60d6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.366832 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-2cf5fe1c-e564-4395-bc8c-af4a76179a1f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 13:19:28.368053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 367/740] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:28.368382 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27805c3-67a6-4313-81a0-56abb85c60d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.368802 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5fe1c-e564-4395-bc8c-af4a76179a1f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.371194 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27805c3-67a6-4313-81a0-56abb85c60d6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.379441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5fe1c-e564-4395-bc8c-af4a76179a1f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.384810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf8aa1-1938-44cb-8bbb-ac7bc61f8959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.385457 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf8aa1-1938-44cb-8bbb-ac7bc61f8959 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.385795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf8aa1-1938-44cb-8bbb-ac7bc61f8959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.386075 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf8aa1-1938-44cb-8bbb-ac7bc61f8959 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.386813 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf8aa1-1938-44cb-8bbb-ac7bc61f8959 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.387995 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-4adf8aa1-1938-44cb-8bbb-ac7bc61f8959 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:28.387995 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:19:28.387995 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:19:28.388944 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-c27805c3-67a6-4313-81a0-56abb85c60d6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:28.389584 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf8aa1-1938-44cb-8bbb-ac7bc61f8959 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.390316 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 374/741] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:28.394962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27805c3-67a6-4313-81a0-56abb85c60d6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.402370 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27805c3-67a6-4313-81a0-56abb85c60d6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.407745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe11197-a3df-4cc0-a32c-4a14d71f76ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.408337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 368/742] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Dec 15 13:19:28 2021] POST /identity/v3/services => generated 240 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:28.408444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe11197-a3df-4cc0-a32c-4a14d71f76ae admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.408668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe11197-a3df-4cc0-a32c-4a14d71f76ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.409031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe11197-a3df-4cc0-a32c-4a14d71f76ae admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.409894 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe11197-a3df-4cc0-a32c-4a14d71f76ae admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:28.410179 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf8aa1-1938-44cb-8bbb-ac7bc61f8959 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.410278 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe11197-a3df-4cc0-a32c-4a14d71f76ae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.412253 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe11197-a3df-4cc0-a32c-4a14d71f76ae admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.434392 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf8aa1-1938-44cb-8bbb-ac7bc61f8959 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.435084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 375/743] 10.222.0.60 () {56 vars in 1170 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:28.442169 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe11197-a3df-4cc0-a32c-4a14d71f76ae admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.444183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34240ad-4d73-401e-8340-bc196dca22fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.445280 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34240ad-4d73-401e-8340-bc196dca22fd admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.445826 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34240ad-4d73-401e-8340-bc196dca22fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.446342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34240ad-4d73-401e-8340-bc196dca22fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.447757 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34240ad-4d73-401e-8340-bc196dca22fd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:28.448357 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34240ad-4d73-401e-8340-bc196dca22fd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.451669 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34240ad-4d73-401e-8340-bc196dca22fd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.452602 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe11197-a3df-4cc0-a32c-4a14d71f76ae admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.464746 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50439c-e6fe-4368-8701-97b76985b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.465865 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50439c-e6fe-4368-8701-97b76985b346 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.466386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50439c-e6fe-4368-8701-97b76985b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.466905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50439c-e6fe-4368-8701-97b76985b346 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.470274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 369/744] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:28.477051 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34240ad-4d73-401e-8340-bc196dca22fd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.483901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50439c-e6fe-4368-8701-97b76985b346 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.487437 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50439c-e6fe-4368-8701-97b76985b346 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.494409 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34240ad-4d73-401e-8340-bc196dca22fd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.497974 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 376/745] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:19:28.506670 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50439c-e6fe-4368-8701-97b76985b346 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.508565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d60f61-a349-4654-839e-a8ca119b44fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.509696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d60f61-a349-4654-839e-a8ca119b44fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.510145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d60f61-a349-4654-839e-a8ca119b44fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.510599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d60f61-a349-4654-839e-a8ca119b44fb admin admin] PATH_INFO: `/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/d61a8e4d64664e68a5710fdf766e4685/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.513150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d60f61-a349-4654-839e-a8ca119b44fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f200887ca764a72b0640476fe3eb41b, user_id=d61a8e4d64664e68a5710fdf766e4685, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.516439 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d60f61-a349-4654-839e-a8ca119b44fb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.518131 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50439c-e6fe-4368-8701-97b76985b346 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.524661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d89c38-344d-4fc1-b055-a2bd98f7c61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.525578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d89c38-344d-4fc1-b055-a2bd98f7c61f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.526011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d89c38-344d-4fc1-b055-a2bd98f7c61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.526318 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d89c38-344d-4fc1-b055-a2bd98f7c61f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.535806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 370/746] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:19:28 2021] PUT /identity/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/d61a8e4d64664e68a5710fdf766e4685/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:19:28.543059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d89c38-344d-4fc1-b055-a2bd98f7c61f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.543059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d89c38-344d-4fc1-b055-a2bd98f7c61f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.572787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-97d89c38-344d-4fc1-b055-a2bd98f7c61f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:28.574802 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 377/747] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:28.580847 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d60f61-a349-4654-839e-a8ca119b44fb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.654261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d60f61-a349-4654-839e-a8ca119b44fb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.659996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c681c34-16d5-4d31-b9bf-9973304dcba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.661000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c681c34-16d5-4d31-b9bf-9973304dcba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.661461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c681c34-16d5-4d31-b9bf-9973304dcba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.661929 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c681c34-16d5-4d31-b9bf-9973304dcba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.662888 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c681c34-16d5-4d31-b9bf-9973304dcba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:28.663438 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c681c34-16d5-4d31-b9bf-9973304dcba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.665246 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c681c34-16d5-4d31-b9bf-9973304dcba5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.681112 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 371/748] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:28.686901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d89c38-344d-4fc1-b055-a2bd98f7c61f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.704478 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d89c38-344d-4fc1-b055-a2bd98f7c61f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.715599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b4d8d-7606-4652-ba69-de2b54499756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.716489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4d8d-7606-4652-ba69-de2b54499756 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.716920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4d8d-7606-4652-ba69-de2b54499756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.717264 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4d8d-7606-4652-ba69-de2b54499756 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.731578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b4d8d-7606-4652-ba69-de2b54499756 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.733671 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b4d8d-7606-4652-ba69-de2b54499756 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.748430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-826b4d8d-7606-4652-ba69-de2b54499756 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:28.750170 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 378/749] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:28.756146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c681c34-16d5-4d31-b9bf-9973304dcba5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.775559 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c681c34-16d5-4d31-b9bf-9973304dcba5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.781998 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b7ceb-8412-43d4-8d8a-316fa8c12a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.783183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b7ceb-8412-43d4-8d8a-316fa8c12a2c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.784241 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b7ceb-8412-43d4-8d8a-316fa8c12a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.784753 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b7ceb-8412-43d4-8d8a-316fa8c12a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.785884 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b7ceb-8412-43d4-8d8a-316fa8c12a2c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:28.786416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b7ceb-8412-43d4-8d8a-316fa8c12a2c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.788771 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b7ceb-8412-43d4-8d8a-316fa8c12a2c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.813177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 372/750] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:28.819336 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b4d8d-7606-4652-ba69-de2b54499756 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:28.832453 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b4d8d-7606-4652-ba69-de2b54499756 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:28.843450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f818d2-ec26-4f78-8eb8-b613b9dc9ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:28.844531 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f818d2-ec26-4f78-8eb8-b613b9dc9ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:28.845015 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f818d2-ec26-4f78-8eb8-b613b9dc9ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:28.845561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f818d2-ec26-4f78-8eb8-b613b9dc9ae1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:28.847260 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f818d2-ec26-4f78-8eb8-b613b9dc9ae1 admin admin] RBAC: Adding query filter params (role.id=bf8b5076a92449fba2f54db6ae519ba6, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=77744968b6b14415b5b85423db1cfd25) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:28.847695 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f818d2-ec26-4f78-8eb8-b613b9dc9ae1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:28.849661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f818d2-ec26-4f78-8eb8-b613b9dc9ae1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:28.859184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 379/751] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:28 2021] GET /identity/v3/role_assignments?user.id=77744968b6b14415b5b85423db1cfd25&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=bf8b5076a92449fba2f54db6ae519ba6 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:29.216731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9936b0-e009-4649-980b-12584b16a625 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:29.217173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9936b0-e009-4649-980b-12584b16a625 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:29.217594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9936b0-e009-4649-980b-12584b16a625 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:29.219840 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 373/752] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:29.227229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e8423-de12-4635-8428-56bc6715136a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:29.227636 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e8423-de12-4635-8428-56bc6715136a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:29.228011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e8423-de12-4635-8428-56bc6715136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:29.249081 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-271e8423-de12-4635-8428-56bc6715136a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:29.250485 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-271e8423-de12-4635-8428-56bc6715136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:29.258682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 380/753] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:29 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:19:29.304343 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9936b0-e009-4649-980b-12584b16a625 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:29.319804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9936b0-e009-4649-980b-12584b16a625 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:29.324312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5eddf6-aa16-46db-9ddd-90d6b11d9220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:29.325089 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5eddf6-aa16-46db-9ddd-90d6b11d9220 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:29.325367 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5eddf6-aa16-46db-9ddd-90d6b11d9220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:29.325639 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5eddf6-aa16-46db-9ddd-90d6b11d9220 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:29.347487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5eddf6-aa16-46db-9ddd-90d6b11d9220 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:29.354232 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-fd5eddf6-aa16-46db-9ddd-90d6b11d9220 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:19:29.355788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 374/754] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:19:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:29.361967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e8423-de12-4635-8428-56bc6715136a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:29.375856 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e8423-de12-4635-8428-56bc6715136a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:29.384747 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bc6f2-1410-407e-8e1f-5b45dc9e9ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:29.385585 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bc6f2-1410-407e-8e1f-5b45dc9e9ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:29.386006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bc6f2-1410-407e-8e1f-5b45dc9e9ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:29.386421 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bc6f2-1410-407e-8e1f-5b45dc9e9ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:29.387367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bc6f2-1410-407e-8e1f-5b45dc9e9ce7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:29.387835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bc6f2-1410-407e-8e1f-5b45dc9e9ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:29.389552 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bc6f2-1410-407e-8e1f-5b45dc9e9ce7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:29.406122 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 381/755] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:29.412373 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5eddf6-aa16-46db-9ddd-90d6b11d9220 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:29.427785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5eddf6-aa16-46db-9ddd-90d6b11d9220 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:29.434899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071ee90-6141-427c-87bb-4bcfd32878c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:29.435669 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071ee90-6141-427c-87bb-4bcfd32878c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:29.435951 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071ee90-6141-427c-87bb-4bcfd32878c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:29.436228 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071ee90-6141-427c-87bb-4bcfd32878c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:29.451334 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071ee90-6141-427c-87bb-4bcfd32878c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:29.453161 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071ee90-6141-427c-87bb-4bcfd32878c6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:29.473869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-6071ee90-6141-427c-87bb-4bcfd32878c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:29.479334 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 375/756] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:29.485362 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bc6f2-1410-407e-8e1f-5b45dc9e9ce7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:29.499120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bc6f2-1410-407e-8e1f-5b45dc9e9ce7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:29.508051 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfd1f9-0d98-4869-91f9-c37e8ff3afed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:29.508925 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfd1f9-0d98-4869-91f9-c37e8ff3afed admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:29.509360 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfd1f9-0d98-4869-91f9-c37e8ff3afed admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:29.509822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfd1f9-0d98-4869-91f9-c37e8ff3afed admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:29.510707 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfd1f9-0d98-4869-91f9-c37e8ff3afed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:29.511207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfd1f9-0d98-4869-91f9-c37e8ff3afed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:29.513028 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfd1f9-0d98-4869-91f9-c37e8ff3afed admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:29.533059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 382/757] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:29.539061 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071ee90-6141-427c-87bb-4bcfd32878c6 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:29.549511 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071ee90-6141-427c-87bb-4bcfd32878c6 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:29.560008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb8bef-8d41-43f6-80a0-8528cd9295d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:29.560795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb8bef-8d41-43f6-80a0-8528cd9295d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:29.561141 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb8bef-8d41-43f6-80a0-8528cd9295d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:29.561426 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb8bef-8d41-43f6-80a0-8528cd9295d7 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:29.570811 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb8bef-8d41-43f6-80a0-8528cd9295d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:29.572931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb8bef-8d41-43f6-80a0-8528cd9295d7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:29.593666 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-f9eb8bef-8d41-43f6-80a0-8528cd9295d7 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 13:19:29.599231 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 376/758] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:19:29 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:29.605181 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfd1f9-0d98-4869-91f9-c37e8ff3afed admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:29.620513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfd1f9-0d98-4869-91f9-c37e8ff3afed admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:29.635494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6192e-b5fb-44e5-a400-75d7366045d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:29.636375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6192e-b5fb-44e5-a400-75d7366045d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:29.636802 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6192e-b5fb-44e5-a400-75d7366045d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:29.637220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6192e-b5fb-44e5-a400-75d7366045d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:29.638226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6192e-b5fb-44e5-a400-75d7366045d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:29.638676 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6192e-b5fb-44e5-a400-75d7366045d9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:29.640661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6192e-b5fb-44e5-a400-75d7366045d9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:29.666100 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 383/759] 10.222.0.60 () {56 vars in 1156 bytes} [Wed Dec 15 13:19:29 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:29.672684 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb8bef-8d41-43f6-80a0-8528cd9295d7 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:29.685545 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb8bef-8d41-43f6-80a0-8528cd9295d7 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:29.695595 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8ed58-ad11-418c-9fae-772d15d9370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:29.696308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8ed58-ad11-418c-9fae-772d15d9370d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:29.696594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8ed58-ad11-418c-9fae-772d15d9370d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:29.696873 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8ed58-ad11-418c-9fae-772d15d9370d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:29.711646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8ed58-ad11-418c-9fae-772d15d9370d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:29.714477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8ed58-ad11-418c-9fae-772d15d9370d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:29.728153 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 377/760] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:29 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:19:29.734092 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6192e-b5fb-44e5-a400-75d7366045d9 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:29.746910 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6192e-b5fb-44e5-a400-75d7366045d9 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:29.756802 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0d997-4d2f-43d3-b5f0-ef0447f4c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:29.757582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d997-4d2f-43d3-b5f0-ef0447f4c8ff admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:29.757857 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d997-4d2f-43d3-b5f0-ef0447f4c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:29.758128 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d997-4d2f-43d3-b5f0-ef0447f4c8ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:29.778550 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0d997-4d2f-43d3-b5f0-ef0447f4c8ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:29.780414 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0d997-4d2f-43d3-b5f0-ef0447f4c8ff admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:29.804507 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-bbd0d997-4d2f-43d3-b5f0-ef0447f4c8ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:29.810759 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 384/761] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:29.812109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8ed58-ad11-418c-9fae-772d15d9370d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:29.828359 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8ed58-ad11-418c-9fae-772d15d9370d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:29.840473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb96e1-4e81-4ffe-bc35-a11bae09097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:29.841182 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb96e1-4e81-4ffe-bc35-a11bae09097a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:29.841471 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb96e1-4e81-4ffe-bc35-a11bae09097a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:29.841752 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb96e1-4e81-4ffe-bc35-a11bae09097a admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:29.842501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb96e1-4e81-4ffe-bc35-a11bae09097a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:29.842875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb96e1-4e81-4ffe-bc35-a11bae09097a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:29.844555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb96e1-4e81-4ffe-bc35-a11bae09097a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:29.867101 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 378/762] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:29.872824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0d997-4d2f-43d3-b5f0-ef0447f4c8ff admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:29.888427 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0d997-4d2f-43d3-b5f0-ef0447f4c8ff admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:29.904135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b343c-a20a-4d9e-85bc-f138a7a4e98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:29.904954 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b343c-a20a-4d9e-85bc-f138a7a4e98e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:29.905235 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b343c-a20a-4d9e-85bc-f138a7a4e98e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:29.905511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b343c-a20a-4d9e-85bc-f138a7a4e98e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:29.913113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b343c-a20a-4d9e-85bc-f138a7a4e98e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:29.915088 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b343c-a20a-4d9e-85bc-f138a7a4e98e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:29.933291 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-268b343c-a20a-4d9e-85bc-f138a7a4e98e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:29.935765 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 385/763] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:29.941732 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb96e1-4e81-4ffe-bc35-a11bae09097a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:29.953803 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb96e1-4e81-4ffe-bc35-a11bae09097a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:29.963666 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef39b5-c639-4ec9-9f34-d216833e9845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:29.964389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef39b5-c639-4ec9-9f34-d216833e9845 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:29.964675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef39b5-c639-4ec9-9f34-d216833e9845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:29.964954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef39b5-c639-4ec9-9f34-d216833e9845 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:29.965822 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef39b5-c639-4ec9-9f34-d216833e9845 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:29.966135 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef39b5-c639-4ec9-9f34-d216833e9845 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:29.968067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef39b5-c639-4ec9-9f34-d216833e9845 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:29.986187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 379/764] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:29.993043 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b343c-a20a-4d9e-85bc-f138a7a4e98e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:30.017521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b343c-a20a-4d9e-85bc-f138a7a4e98e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:30.027089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bb451-5650-43d8-b7e6-107c0d5f8b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:30.028002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bb451-5650-43d8-b7e6-107c0d5f8b03 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:30.028485 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bb451-5650-43d8-b7e6-107c0d5f8b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:30.028967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bb451-5650-43d8-b7e6-107c0d5f8b03 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:30.030070 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bb451-5650-43d8-b7e6-107c0d5f8b03 admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=27fd1a6075694b2c833b345485d5319c) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:30.030584 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bb451-5650-43d8-b7e6-107c0d5f8b03 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:30.032655 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bb451-5650-43d8-b7e6-107c0d5f8b03 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:30.048513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 386/765] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:29 2021] GET /identity/v3/role_assignments?user.id=27fd1a6075694b2c833b345485d5319c&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 259 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:31.141031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5657-163c-405d-9b06-c6f8a7ccf15a None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.141565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5657-163c-405d-9b06-c6f8a7ccf15a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.141565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5657-163c-405d-9b06-c6f8a7ccf15a None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.144106 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 380/766] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:31.150065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0247bf0-cc55-4f98-b879-ec723ebca480 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.150492 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0247bf0-cc55-4f98-b879-ec723ebca480 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.150690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0247bf0-cc55-4f98-b879-ec723ebca480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.175815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-d0247bf0-cc55-4f98-b879-ec723ebca480 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:31.177021 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d0247bf0-cc55-4f98-b879-ec723ebca480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:31.185366 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 387/767] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:31 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:31.208839 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac5657-163c-405d-9b06-c6f8a7ccf15a None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:31.224674 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac5657-163c-405d-9b06-c6f8a7ccf15a None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:31.229442 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58449681-c73b-4fac-8138-e114855f6f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:31.230269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58449681-c73b-4fac-8138-e114855f6f9b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.230553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58449681-c73b-4fac-8138-e114855f6f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.230828 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58449681-c73b-4fac-8138-e114855f6f9b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.231561 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58449681-c73b-4fac-8138-e114855f6f9b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:31.233220 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58449681-c73b-4fac-8138-e114855f6f9b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:31.250275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-58449681-c73b-4fac-8138-e114855f6f9b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 13:19:31.251730 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 381/768] 10.222.0.60 () {56 vars in 1150 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:31.258627 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0247bf0-cc55-4f98-b879-ec723ebca480 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:31.271907 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0247bf0-cc55-4f98-b879-ec723ebca480 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:31.281855 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79c7c9-ac67-4e15-a563-d868bc333dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:31.282571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79c7c9-ac67-4e15-a563-d868bc333dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.282877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79c7c9-ac67-4e15-a563-d868bc333dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.283206 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79c7c9-ac67-4e15-a563-d868bc333dd9 admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.283941 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79c7c9-ac67-4e15-a563-d868bc333dd9 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:31.284253 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79c7c9-ac67-4e15-a563-d868bc333dd9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:31.285855 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79c7c9-ac67-4e15-a563-d868bc333dd9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:31.291022 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 388/769] 10.222.0.60 () {56 vars in 1145 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:31.297097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58449681-c73b-4fac-8138-e114855f6f9b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:31.311427 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58449681-c73b-4fac-8138-e114855f6f9b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:31.316663 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb57af8-546b-4be3-92c7-00c140d21af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:31.317412 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb57af8-546b-4be3-92c7-00c140d21af8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.317706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb57af8-546b-4be3-92c7-00c140d21af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.318039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb57af8-546b-4be3-92c7-00c140d21af8 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.318772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb57af8-546b-4be3-92c7-00c140d21af8 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:31.319110 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb57af8-546b-4be3-92c7-00c140d21af8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:31.320794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb57af8-546b-4be3-92c7-00c140d21af8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:31.326906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 382/770] 10.222.0.60 () {56 vars in 1145 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:31.335951 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79c7c9-ac67-4e15-a563-d868bc333dd9 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:31.347855 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79c7c9-ac67-4e15-a563-d868bc333dd9 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:31.353283 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21d88d-7d5d-4e81-91ea-59c9aa9fb005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:31.353941 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d88d-7d5d-4e81-91ea-59c9aa9fb005 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.354278 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d88d-7d5d-4e81-91ea-59c9aa9fb005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.354605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d88d-7d5d-4e81-91ea-59c9aa9fb005 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.355447 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21d88d-7d5d-4e81-91ea-59c9aa9fb005 admin admin] RBAC: Adding query filter params (interface=public, service_id=36be841f64514a60ae0623f90125cdbf, region_id=RegionOne) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:31.355764 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21d88d-7d5d-4e81-91ea-59c9aa9fb005 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:31.356840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-7b21d88d-7d5d-4e81-91ea-59c9aa9fb005 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:31.356840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:19:31.356840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:19:31.357718 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21d88d-7d5d-4e81-91ea-59c9aa9fb005 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:31.369284 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 389/771] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/endpoints?service_id=36be841f64514a60ae0623f90125cdbf&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:31.375331 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb57af8-546b-4be3-92c7-00c140d21af8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:31.386071 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb57af8-546b-4be3-92c7-00c140d21af8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:31.395684 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb95567-ce1e-46eb-95c7-f724eeef3870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:31.396339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb95567-ce1e-46eb-95c7-f724eeef3870 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.396627 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb95567-ce1e-46eb-95c7-f724eeef3870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.396963 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb95567-ce1e-46eb-95c7-f724eeef3870 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.397680 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb95567-ce1e-46eb-95c7-f724eeef3870 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:31.399473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb95567-ce1e-46eb-95c7-f724eeef3870 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:31.405693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 383/772] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/services => generated 772 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:31.446502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0d3f8-f7b5-4e49-9b04-9e6a5cef49a2 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.446822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0d3f8-f7b5-4e49-9b04-9e6a5cef49a2 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.447130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0d3f8-f7b5-4e49-9b04-9e6a5cef49a2 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.449121 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 390/773] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:31.455301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e1293-d432-4732-a728-e61574d522a1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.455632 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e1293-d432-4732-a728-e61574d522a1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.455861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e1293-d432-4732-a728-e61574d522a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.475024 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-9b2e1293-d432-4732-a728-e61574d522a1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:31.476287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9b2e1293-d432-4732-a728-e61574d522a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:31.484529 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 384/774] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:31 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:19:31.508883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0d3f8-f7b5-4e49-9b04-9e6a5cef49a2 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:31.521883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0d3f8-f7b5-4e49-9b04-9e6a5cef49a2 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:31.526660 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747950e4-f170-4a1c-b95f-1102630c1b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:31.527603 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747950e4-f170-4a1c-b95f-1102630c1b87 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.527898 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747950e4-f170-4a1c-b95f-1102630c1b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.528177 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747950e4-f170-4a1c-b95f-1102630c1b87 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.528936 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747950e4-f170-4a1c-b95f-1102630c1b87 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:31.530043 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-747950e4-f170-4a1c-b95f-1102630c1b87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:31.530043 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:19:31.530043 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:19:31.530990 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747950e4-f170-4a1c-b95f-1102630c1b87 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:31.545360 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-747950e4-f170-4a1c-b95f-1102630c1b87 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 13:19:31.547278 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 391/775] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/services/network => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:31.554373 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e1293-d432-4732-a728-e61574d522a1 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:31.563950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e1293-d432-4732-a728-e61574d522a1 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:31.568804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b423384-1224-4edb-9ca2-ef7c7cac6ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:31.569531 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423384-1224-4edb-9ca2-ef7c7cac6ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.569823 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423384-1224-4edb-9ca2-ef7c7cac6ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.570104 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423384-1224-4edb-9ca2-ef7c7cac6ba2 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.570873 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b423384-1224-4edb-9ca2-ef7c7cac6ba2 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:31.571246 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b423384-1224-4edb-9ca2-ef7c7cac6ba2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:31.572894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b423384-1224-4edb-9ca2-ef7c7cac6ba2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:31.578661 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 385/776] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/services?name=network => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:31.585047 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747950e4-f170-4a1c-b95f-1102630c1b87 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:31.596573 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747950e4-f170-4a1c-b95f-1102630c1b87 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:31.601315 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105ce71-0c10-41df-8a32-4adec40749ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:31.602029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105ce71-0c10-41df-8a32-4adec40749ce admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.602317 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105ce71-0c10-41df-8a32-4adec40749ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.602597 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105ce71-0c10-41df-8a32-4adec40749ce admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.603416 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105ce71-0c10-41df-8a32-4adec40749ce admin admin] RBAC: Adding query filter params (type=network) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:31.603726 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105ce71-0c10-41df-8a32-4adec40749ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:31.605390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105ce71-0c10-41df-8a32-4adec40749ce admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:31.620062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 392/777] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/services?type=network => generated 350 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:31.626570 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b423384-1224-4edb-9ca2-ef7c7cac6ba2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:31.637558 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b423384-1224-4edb-9ca2-ef7c7cac6ba2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:31.647610 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156d96a-dc41-4036-b425-451e801f58aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:31.648267 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156d96a-dc41-4036-b425-451e801f58aa admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.648560 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156d96a-dc41-4036-b425-451e801f58aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.648845 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156d96a-dc41-4036-b425-451e801f58aa admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.649727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156d96a-dc41-4036-b425-451e801f58aa admin admin] RBAC: Adding query filter params (interface=public, service_id=543ad49aa9e942d3961d9d74d2aba9e5, region_id=RegionOne) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:31.650048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156d96a-dc41-4036-b425-451e801f58aa admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:31.651187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-b156d96a-dc41-4036-b425-451e801f58aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:31.651187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:19:31.651187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:19:31.656764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156d96a-dc41-4036-b425-451e801f58aa admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:31.665674 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 386/778] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/endpoints?service_id=543ad49aa9e942d3961d9d74d2aba9e5&interface=public®ion_id=RegionOne => generated 194 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:31.672170 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105ce71-0c10-41df-8a32-4adec40749ce admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:31.690808 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105ce71-0c10-41df-8a32-4adec40749ce admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:31.700777 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5c145-4649-469d-9123-4bca1bc4ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:31.701465 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c145-4649-469d-9123-4bca1bc4ca1b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.701743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c145-4649-469d-9123-4bca1bc4ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.702017 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c145-4649-469d-9123-4bca1bc4ca1b admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.702737 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5c145-4649-469d-9123-4bca1bc4ca1b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:31.704459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5c145-4649-469d-9123-4bca1bc4ca1b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:31.710177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa985b71-7bf3-4ab1-83ab-32d82461166a None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.710807 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa985b71-7bf3-4ab1-83ab-32d82461166a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.711311 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa985b71-7bf3-4ab1-83ab-32d82461166a None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.713515 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 387/779] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:19:31.718557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 393/780] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/services => generated 772 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:31.720996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcb6cf-8d1d-4265-b019-01a7e1c51510 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.721449 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcb6cf-8d1d-4265-b019-01a7e1c51510 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.721804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcb6cf-8d1d-4265-b019-01a7e1c51510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.742709 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-71dcb6cf-8d1d-4265-b019-01a7e1c51510 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:31.745264 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-71dcb6cf-8d1d-4265-b019-01a7e1c51510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:31.754005 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 388/781] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:31 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:31.779329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5c145-4649-469d-9123-4bca1bc4ca1b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:31.791644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5c145-4649-469d-9123-4bca1bc4ca1b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:31.802552 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09956cf6-6fb8-4736-81b1-d6f6a0be27e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:31.803748 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09956cf6-6fb8-4736-81b1-d6f6a0be27e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.804257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09956cf6-6fb8-4736-81b1-d6f6a0be27e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.804745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09956cf6-6fb8-4736-81b1-d6f6a0be27e1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.817382 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09956cf6-6fb8-4736-81b1-d6f6a0be27e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:31.825044 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-09956cf6-6fb8-4736-81b1-d6f6a0be27e1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:19:31.826817 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 394/782] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:31.833836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcb6cf-8d1d-4265-b019-01a7e1c51510 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:31.845135 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcb6cf-8d1d-4265-b019-01a7e1c51510 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:31.851225 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a7365-a283-44d7-b3c9-9db72f6c33cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:31.851911 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a7365-a283-44d7-b3c9-9db72f6c33cd admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.852189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a7365-a283-44d7-b3c9-9db72f6c33cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.852465 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a7365-a283-44d7-b3c9-9db72f6c33cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.853249 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a7365-a283-44d7-b3c9-9db72f6c33cd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:31.853628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a7365-a283-44d7-b3c9-9db72f6c33cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:31.856518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a7365-a283-44d7-b3c9-9db72f6c33cd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:31.867044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 389/783] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:31.873375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09956cf6-6fb8-4736-81b1-d6f6a0be27e1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:31.883830 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09956cf6-6fb8-4736-81b1-d6f6a0be27e1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:31.889734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32a117-55ac-498b-b4e4-02c69c095ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:31.890771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32a117-55ac-498b-b4e4-02c69c095ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.891255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32a117-55ac-498b-b4e4-02c69c095ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.891677 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32a117-55ac-498b-b4e4-02c69c095ed5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.903142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b39d60-8348-4ea4-a69f-1247c9b462ea None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.903496 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b39d60-8348-4ea4-a69f-1247c9b462ea None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.903878 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b39d60-8348-4ea4-a69f-1247c9b462ea None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.905774 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32a117-55ac-498b-b4e4-02c69c095ed5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:31.906326 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 390/784] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:19:31.908858 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32a117-55ac-498b-b4e4-02c69c095ed5 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:31.912592 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df1ab-9496-41d5-a766-0f237c95bfdf None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.912891 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df1ab-9496-41d5-a766-0f237c95bfdf None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.913176 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df1ab-9496-41d5-a766-0f237c95bfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.928340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-fd32a117-55ac-498b-b4e4-02c69c095ed5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:31.929782 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 395/785] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:31.942164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ad6df1ab-9496-41d5-a766-0f237c95bfdf None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:31.944091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32a117-55ac-498b-b4e4-02c69c095ed5 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:31.945281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ad6df1ab-9496-41d5-a766-0f237c95bfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:31.957196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32a117-55ac-498b-b4e4-02c69c095ed5 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:31.965785 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272bbe6-c7da-4060-9c9a-e42943b2a396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:31.966462 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272bbe6-c7da-4060-9c9a-e42943b2a396 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:31.966740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272bbe6-c7da-4060-9c9a-e42943b2a396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:31.967048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272bbe6-c7da-4060-9c9a-e42943b2a396 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:31.967792 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272bbe6-c7da-4060-9c9a-e42943b2a396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:31.968096 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272bbe6-c7da-4060-9c9a-e42943b2a396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:31.969724 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272bbe6-c7da-4060-9c9a-e42943b2a396 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:31.973293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 391/786] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:31 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:31.989863 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 396/787] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:31.995884 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6df1ab-9496-41d5-a766-0f237c95bfdf None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.008958 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272bbe6-c7da-4060-9c9a-e42943b2a396 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.011161 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6df1ab-9496-41d5-a766-0f237c95bfdf None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.017007 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427773c-68cf-4300-8f2c-5204909e9654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.018410 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427773c-68cf-4300-8f2c-5204909e9654 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.018602 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427773c-68cf-4300-8f2c-5204909e9654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.018875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427773c-68cf-4300-8f2c-5204909e9654 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.023151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272bbe6-c7da-4060-9c9a-e42943b2a396 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.029598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427773c-68cf-4300-8f2c-5204909e9654 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.029733 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e35d53-26f6-4a80-a946-9766dcdd44f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.030528 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e35d53-26f6-4a80-a946-9766dcdd44f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.030813 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e35d53-26f6-4a80-a946-9766dcdd44f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.031127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e35d53-26f6-4a80-a946-9766dcdd44f6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.031870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427773c-68cf-4300-8f2c-5204909e9654 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.044944 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e35d53-26f6-4a80-a946-9766dcdd44f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:32.049147 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-3427773c-68cf-4300-8f2c-5204909e9654 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:19:32.050625 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 392/788] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Dec 15 13:19:31 2021] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:32.052452 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-08e35d53-26f6-4a80-a946-9766dcdd44f6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:32.054876 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 397/789] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:32.059568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e35d53-26f6-4a80-a946-9766dcdd44f6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.059707 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427773c-68cf-4300-8f2c-5204909e9654 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.082353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427773c-68cf-4300-8f2c-5204909e9654 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.089127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e35d53-26f6-4a80-a946-9766dcdd44f6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.089924 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3949fc-667c-4f80-8787-0c71ad4a311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.090594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3949fc-667c-4f80-8787-0c71ad4a311d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.090888 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3949fc-667c-4f80-8787-0c71ad4a311d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.091167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3949fc-667c-4f80-8787-0c71ad4a311d admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.092020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3949fc-667c-4f80-8787-0c71ad4a311d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:32.092329 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3949fc-667c-4f80-8787-0c71ad4a311d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.094185 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3949fc-667c-4f80-8787-0c71ad4a311d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.104831 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ace2c-ce0a-42a9-a2af-e7253fe664a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.105492 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ace2c-ce0a-42a9-a2af-e7253fe664a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.105770 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ace2c-ce0a-42a9-a2af-e7253fe664a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.106040 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ace2c-ce0a-42a9-a2af-e7253fe664a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.106798 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ace2c-ce0a-42a9-a2af-e7253fe664a1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:32.107127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ace2c-ce0a-42a9-a2af-e7253fe664a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.108713 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ace2c-ce0a-42a9-a2af-e7253fe664a1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.120154 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 393/790] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:32.131854 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3949fc-667c-4f80-8787-0c71ad4a311d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.132886 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 398/791] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:32.138288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ace2c-ce0a-42a9-a2af-e7253fe664a1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.146008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3949fc-667c-4f80-8787-0c71ad4a311d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.157760 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf08fb-11f5-4f01-9c7e-deb6e4cf2964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.159671 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ace2c-ce0a-42a9-a2af-e7253fe664a1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.160771 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf08fb-11f5-4f01-9c7e-deb6e4cf2964 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.161199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf08fb-11f5-4f01-9c7e-deb6e4cf2964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.162303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf08fb-11f5-4f01-9c7e-deb6e4cf2964 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.171153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35553057-5c99-42dd-957e-9067b1c293db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.172828 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553057-5c99-42dd-957e-9067b1c293db admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.174286 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553057-5c99-42dd-957e-9067b1c293db admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.174751 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553057-5c99-42dd-957e-9067b1c293db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.179542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf08fb-11f5-4f01-9c7e-deb6e4cf2964 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.182387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf08fb-11f5-4f01-9c7e-deb6e4cf2964 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.195984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35553057-5c99-42dd-957e-9067b1c293db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.200674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35553057-5c99-42dd-957e-9067b1c293db admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.202250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 394/792] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:19:32.209212 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf08fb-11f5-4f01-9c7e-deb6e4cf2964 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.218596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf08fb-11f5-4f01-9c7e-deb6e4cf2964 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.231860 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2097685-8265-471b-8f01-49f1b41ed9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.233452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097685-8265-471b-8f01-49f1b41ed9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.234277 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097685-8265-471b-8f01-49f1b41ed9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.236442 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097685-8265-471b-8f01-49f1b41ed9a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.239410 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-35553057-5c99-42dd-957e-9067b1c293db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:32.247162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 399/793] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:32.254421 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2097685-8265-471b-8f01-49f1b41ed9a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.256465 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2097685-8265-471b-8f01-49f1b41ed9a0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.264693 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35553057-5c99-42dd-957e-9067b1c293db admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.275308 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35553057-5c99-42dd-957e-9067b1c293db admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.288569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1632457-ade0-4049-a869-a0938ac424d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.289425 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1632457-ade0-4049-a869-a0938ac424d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.291248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1632457-ade0-4049-a869-a0938ac424d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.291699 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1632457-ade0-4049-a869-a0938ac424d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.292650 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1632457-ade0-4049-a869-a0938ac424d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:32.293212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1632457-ade0-4049-a869-a0938ac424d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.297290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1632457-ade0-4049-a869-a0938ac424d1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.297605 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-a2097685-8265-471b-8f01-49f1b41ed9a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:32.300378 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 395/794] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:32.306335 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2097685-8265-471b-8f01-49f1b41ed9a0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.318759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2097685-8265-471b-8f01-49f1b41ed9a0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.322890 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 400/795] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:32.326816 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1632457-ade0-4049-a869-a0938ac424d1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.329477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df6da1-ec11-4e87-951c-4e2e8298d623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.330785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df6da1-ec11-4e87-951c-4e2e8298d623 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.331181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df6da1-ec11-4e87-951c-4e2e8298d623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.331553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df6da1-ec11-4e87-951c-4e2e8298d623 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.332388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df6da1-ec11-4e87-951c-4e2e8298d623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:32.332790 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df6da1-ec11-4e87-951c-4e2e8298d623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.338883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df6da1-ec11-4e87-951c-4e2e8298d623 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.344073 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1632457-ade0-4049-a869-a0938ac424d1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.347727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 396/796] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:32.353822 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df6da1-ec11-4e87-951c-4e2e8298d623 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.362494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c29ca8-5f9c-4947-bc33-1d07d72b8805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.363333 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c29ca8-5f9c-4947-bc33-1d07d72b8805 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.363616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c29ca8-5f9c-4947-bc33-1d07d72b8805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.363889 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c29ca8-5f9c-4947-bc33-1d07d72b8805 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.368739 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df6da1-ec11-4e87-951c-4e2e8298d623 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.376493 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c29ca8-5f9c-4947-bc33-1d07d72b8805 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.379051 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c29ca8-5f9c-4947-bc33-1d07d72b8805 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.382710 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae6e5c-4134-4960-81da-06612041cc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.383500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae6e5c-4134-4960-81da-06612041cc46 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.383782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae6e5c-4134-4960-81da-06612041cc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.384060 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae6e5c-4134-4960-81da-06612041cc46 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.397120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-e7c29ca8-5f9c-4947-bc33-1d07d72b8805 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 13:19:32.398624 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 401/797] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:32.400055 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae6e5c-4134-4960-81da-06612041cc46 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.402094 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae6e5c-4134-4960-81da-06612041cc46 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.404571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c29ca8-5f9c-4947-bc33-1d07d72b8805 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.414588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c29ca8-5f9c-4947-bc33-1d07d72b8805 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.419243 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01342d95-ea7a-4cc7-bcd5-e050e8989e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.419997 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01342d95-ea7a-4cc7-bcd5-e050e8989e71 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.420549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01342d95-ea7a-4cc7-bcd5-e050e8989e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.421152 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01342d95-ea7a-4cc7-bcd5-e050e8989e71 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.422121 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01342d95-ea7a-4cc7-bcd5-e050e8989e71 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:32.422504 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01342d95-ea7a-4cc7-bcd5-e050e8989e71 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.424598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01342d95-ea7a-4cc7-bcd5-e050e8989e71 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.426708 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-2dae6e5c-4134-4960-81da-06612041cc46 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:32.427935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 397/798] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:32.438536 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae6e5c-4134-4960-81da-06612041cc46 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.450615 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 402/799] 10.222.0.60 () {56 vars in 1170 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:32.457431 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01342d95-ea7a-4cc7-bcd5-e050e8989e71 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.460181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae6e5c-4134-4960-81da-06612041cc46 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.471599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01342d95-ea7a-4cc7-bcd5-e050e8989e71 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.473770 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd77888-5f54-43b8-b34a-8ad0a1767203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.474473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd77888-5f54-43b8-b34a-8ad0a1767203 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.474754 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd77888-5f54-43b8-b34a-8ad0a1767203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.475061 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd77888-5f54-43b8-b34a-8ad0a1767203 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.475865 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd77888-5f54-43b8-b34a-8ad0a1767203 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:32.476175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd77888-5f54-43b8-b34a-8ad0a1767203 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.478021 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd77888-5f54-43b8-b34a-8ad0a1767203 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.489384 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73219a23-aa49-41f3-b2ce-93d67810db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.490169 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219a23-aa49-41f3-b2ce-93d67810db21 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.490444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219a23-aa49-41f3-b2ce-93d67810db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.490716 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219a23-aa49-41f3-b2ce-93d67810db21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.498363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 398/800] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:32.510614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73219a23-aa49-41f3-b2ce-93d67810db21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.511777 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd77888-5f54-43b8-b34a-8ad0a1767203 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.512605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73219a23-aa49-41f3-b2ce-93d67810db21 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.530247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-73219a23-aa49-41f3-b2ce-93d67810db21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:32.531788 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 403/801] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:32.531957 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd77888-5f54-43b8-b34a-8ad0a1767203 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.538878 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73219a23-aa49-41f3-b2ce-93d67810db21 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.544391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88719e01-0d83-44b9-8592-3c84251824f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.546157 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88719e01-0d83-44b9-8592-3c84251824f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.546436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88719e01-0d83-44b9-8592-3c84251824f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.546724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88719e01-0d83-44b9-8592-3c84251824f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.549009 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88719e01-0d83-44b9-8592-3c84251824f1 admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=d61a8e4d64664e68a5710fdf766e4685) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:32.549328 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88719e01-0d83-44b9-8592-3c84251824f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.555750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88719e01-0d83-44b9-8592-3c84251824f1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.558349 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73219a23-aa49-41f3-b2ce-93d67810db21 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.566555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935572d-6e8a-45e5-a58b-cdbe596c4dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.569249 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 399/802] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/role_assignments?user.id=d61a8e4d64664e68a5710fdf766e4685&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:32.569466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935572d-6e8a-45e5-a58b-cdbe596c4dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.569754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935572d-6e8a-45e5-a58b-cdbe596c4dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.570136 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935572d-6e8a-45e5-a58b-cdbe596c4dc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.571015 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935572d-6e8a-45e5-a58b-cdbe596c4dc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:32.571330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935572d-6e8a-45e5-a58b-cdbe596c4dc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.573050 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935572d-6e8a-45e5-a58b-cdbe596c4dc8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.587550 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 404/803] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:32.593672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88719e01-0d83-44b9-8592-3c84251824f1 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.604152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88719e01-0d83-44b9-8592-3c84251824f1 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.610491 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c6b73-7404-4436-9913-663237a83f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.611356 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c6b73-7404-4436-9913-663237a83f54 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.611637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c6b73-7404-4436-9913-663237a83f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.611910 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c6b73-7404-4436-9913-663237a83f54 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.624183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c6b73-7404-4436-9913-663237a83f54 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.626193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c6b73-7404-4436-9913-663237a83f54 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.648446 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-786c6b73-7404-4436-9913-663237a83f54 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:32.649915 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 400/804] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:32.656145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935572d-6e8a-45e5-a58b-cdbe596c4dc8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.667668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935572d-6e8a-45e5-a58b-cdbe596c4dc8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.679642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3b715-b688-4829-a1b4-1d9f1b6a6320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.680337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3b715-b688-4829-a1b4-1d9f1b6a6320 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.680619 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3b715-b688-4829-a1b4-1d9f1b6a6320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.680896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3b715-b688-4829-a1b4-1d9f1b6a6320 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.681752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3b715-b688-4829-a1b4-1d9f1b6a6320 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:32.682061 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3b715-b688-4829-a1b4-1d9f1b6a6320 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.684095 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3b715-b688-4829-a1b4-1d9f1b6a6320 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.704323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 405/805] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:32.710727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c6b73-7404-4436-9913-663237a83f54 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:32.722583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c6b73-7404-4436-9913-663237a83f54 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:32.730434 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9e039-6990-4ec0-b913-f000666630f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:32.731392 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e039-6990-4ec0-b913-f000666630f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:32.731660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e039-6990-4ec0-b913-f000666630f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:32.731931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e039-6990-4ec0-b913-f000666630f3 admin admin] PATH_INFO: `/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/77744968b6b14415b5b85423db1cfd25/roles/bf8b5076a92449fba2f54db6ae519ba6` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:32.757518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9e039-6990-4ec0-b913-f000666630f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f200887ca764a72b0640476fe3eb41b, user_id=77744968b6b14415b5b85423db1cfd25, role_id=bf8b5076a92449fba2f54db6ae519ba6)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:32.760244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9e039-6990-4ec0-b913-f000666630f3 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:32.782440 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 401/806] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:19:32 2021] PUT /identity/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/77744968b6b14415b5b85423db1cfd25/roles/bf8b5076a92449fba2f54db6ae519ba6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:19:33.226920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a00c-54ef-4d14-8de1-438d43247a79 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:33.227612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a00c-54ef-4d14-8de1-438d43247a79 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:33.227612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a00c-54ef-4d14-8de1-438d43247a79 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:33.229448 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 406/807] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:33.236609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb44cdb-1b79-42b1-a530-ad3dea4b8088 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:33.237114 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb44cdb-1b79-42b1-a530-ad3dea4b8088 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:33.237263 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb44cdb-1b79-42b1-a530-ad3dea4b8088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:33.257913 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ebb44cdb-1b79-42b1-a530-ad3dea4b8088 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:33.259133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ebb44cdb-1b79-42b1-a530-ad3dea4b8088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:33.341385 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 402/808] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:33 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:33.376279 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401a00c-54ef-4d14-8de1-438d43247a79 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:33.399433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401a00c-54ef-4d14-8de1-438d43247a79 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:33.403862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4acb55-7bd9-40eb-8150-d6f04f56e501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:33.404634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4acb55-7bd9-40eb-8150-d6f04f56e501 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:33.404918 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4acb55-7bd9-40eb-8150-d6f04f56e501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:33.405195 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4acb55-7bd9-40eb-8150-d6f04f56e501 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:33.425456 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4acb55-7bd9-40eb-8150-d6f04f56e501 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:33.432155 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-fa4acb55-7bd9-40eb-8150-d6f04f56e501 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:19:33.438929 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 407/809] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:19:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:33.440170 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb44cdb-1b79-42b1-a530-ad3dea4b8088 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:33.455728 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb44cdb-1b79-42b1-a530-ad3dea4b8088 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:33.467451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e4a83-0d01-46d2-87ae-9947d2bd7070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:33.468108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e4a83-0d01-46d2-87ae-9947d2bd7070 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:33.468391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e4a83-0d01-46d2-87ae-9947d2bd7070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:33.468665 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e4a83-0d01-46d2-87ae-9947d2bd7070 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:33.469432 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e4a83-0d01-46d2-87ae-9947d2bd7070 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:33.469737 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e4a83-0d01-46d2-87ae-9947d2bd7070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:33.471390 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e4a83-0d01-46d2-87ae-9947d2bd7070 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:33.485450 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 403/810] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:33.491807 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4acb55-7bd9-40eb-8150-d6f04f56e501 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:33.502190 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4acb55-7bd9-40eb-8150-d6f04f56e501 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:33.511787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baae78-b506-4020-8bdc-a76ae6fcedfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:33.512872 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baae78-b506-4020-8bdc-a76ae6fcedfb admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:33.513371 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baae78-b506-4020-8bdc-a76ae6fcedfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:33.513841 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baae78-b506-4020-8bdc-a76ae6fcedfb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:33.529973 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baae78-b506-4020-8bdc-a76ae6fcedfb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:33.532101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baae78-b506-4020-8bdc-a76ae6fcedfb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:33.551883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-83baae78-b506-4020-8bdc-a76ae6fcedfb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:33.555009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 408/811] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:33.564659 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e4a83-0d01-46d2-87ae-9947d2bd7070 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:33.586038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e4a83-0d01-46d2-87ae-9947d2bd7070 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:33.594936 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dee8b-cda0-40d5-995e-f3b8cfc94e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:33.595630 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dee8b-cda0-40d5-995e-f3b8cfc94e0c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:33.595913 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dee8b-cda0-40d5-995e-f3b8cfc94e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:33.596189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dee8b-cda0-40d5-995e-f3b8cfc94e0c admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:33.596929 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dee8b-cda0-40d5-995e-f3b8cfc94e0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:33.597233 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dee8b-cda0-40d5-995e-f3b8cfc94e0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:33.598832 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dee8b-cda0-40d5-995e-f3b8cfc94e0c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:33.616588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 404/812] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:33.622331 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baae78-b506-4020-8bdc-a76ae6fcedfb admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:33.635784 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baae78-b506-4020-8bdc-a76ae6fcedfb admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:33.643229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d98d07-7cb4-4827-a99d-4c9905db2f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:33.644302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d98d07-7cb4-4827-a99d-4c9905db2f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:33.644783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d98d07-7cb4-4827-a99d-4c9905db2f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:33.645329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d98d07-7cb4-4827-a99d-4c9905db2f43 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:33.658388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d98d07-7cb4-4827-a99d-4c9905db2f43 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:33.660753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d98d07-7cb4-4827-a99d-4c9905db2f43 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:33.681733 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-30d98d07-7cb4-4827-a99d-4c9905db2f43 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 13:19:33.683298 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 409/813] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:19:33 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:33.699991 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dee8b-cda0-40d5-995e-f3b8cfc94e0c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:33.715888 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dee8b-cda0-40d5-995e-f3b8cfc94e0c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:33.722940 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41051877-3324-4915-8b19-ee3fc3fb77c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:33.723600 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41051877-3324-4915-8b19-ee3fc3fb77c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:33.723880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41051877-3324-4915-8b19-ee3fc3fb77c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:33.724157 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41051877-3324-4915-8b19-ee3fc3fb77c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:33.725014 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41051877-3324-4915-8b19-ee3fc3fb77c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:33.725326 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41051877-3324-4915-8b19-ee3fc3fb77c5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:33.727180 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41051877-3324-4915-8b19-ee3fc3fb77c5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:33.756201 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 405/814] 10.222.0.60 () {56 vars in 1156 bytes} [Wed Dec 15 13:19:33 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:33.761838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d98d07-7cb4-4827-a99d-4c9905db2f43 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:33.776518 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d98d07-7cb4-4827-a99d-4c9905db2f43 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:33.784204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873573e6-7942-4788-9b1f-b0b606b465e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:33.785247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873573e6-7942-4788-9b1f-b0b606b465e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:33.785763 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873573e6-7942-4788-9b1f-b0b606b465e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:33.786257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873573e6-7942-4788-9b1f-b0b606b465e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:33.804993 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873573e6-7942-4788-9b1f-b0b606b465e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:33.806822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873573e6-7942-4788-9b1f-b0b606b465e5 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:33.835363 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-873573e6-7942-4788-9b1f-b0b606b465e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:33.836928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 410/815] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:33.842661 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41051877-3324-4915-8b19-ee3fc3fb77c5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:33.856429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41051877-3324-4915-8b19-ee3fc3fb77c5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:33.872499 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5aa01-ac1e-48f6-936b-9150e7375f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:33.873190 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5aa01-ac1e-48f6-936b-9150e7375f04 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:33.873461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5aa01-ac1e-48f6-936b-9150e7375f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:33.873746 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5aa01-ac1e-48f6-936b-9150e7375f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:33.874501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5aa01-ac1e-48f6-936b-9150e7375f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:33.874814 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5aa01-ac1e-48f6-936b-9150e7375f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:33.876493 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5aa01-ac1e-48f6-936b-9150e7375f04 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:33.893544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 406/816] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:33.899184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873573e6-7942-4788-9b1f-b0b606b465e5 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:33.912457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873573e6-7942-4788-9b1f-b0b606b465e5 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:33.924137 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda10ab3-3bb2-404e-8595-e07d999f6cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:33.924951 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda10ab3-3bb2-404e-8595-e07d999f6cae admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:33.925227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda10ab3-3bb2-404e-8595-e07d999f6cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:33.925502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda10ab3-3bb2-404e-8595-e07d999f6cae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:33.938562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda10ab3-3bb2-404e-8595-e07d999f6cae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:33.940623 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda10ab3-3bb2-404e-8595-e07d999f6cae admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:33.961548 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-dda10ab3-3bb2-404e-8595-e07d999f6cae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:33.967366 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 411/817] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:33.973921 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5aa01-ac1e-48f6-936b-9150e7375f04 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:33.989373 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5aa01-ac1e-48f6-936b-9150e7375f04 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:34.005759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167330b3-5933-4c58-8e81-49dd9a9ba41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:34.006493 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167330b3-5933-4c58-8e81-49dd9a9ba41b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:34.006731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167330b3-5933-4c58-8e81-49dd9a9ba41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:34.007075 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167330b3-5933-4c58-8e81-49dd9a9ba41b admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:34.007871 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167330b3-5933-4c58-8e81-49dd9a9ba41b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:34.008186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167330b3-5933-4c58-8e81-49dd9a9ba41b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:34.010045 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167330b3-5933-4c58-8e81-49dd9a9ba41b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:34.030758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 407/818] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:34.037961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda10ab3-3bb2-404e-8595-e07d999f6cae admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:34.052294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda10ab3-3bb2-404e-8595-e07d999f6cae admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:34.059502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a51dbc-c142-46e7-b550-592bd90db983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:34.060394 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a51dbc-c142-46e7-b550-592bd90db983 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:34.060681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a51dbc-c142-46e7-b550-592bd90db983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:34.060956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a51dbc-c142-46e7-b550-592bd90db983 admin admin] PATH_INFO: `/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/27fd1a6075694b2c833b345485d5319c/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:34.062992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a51dbc-c142-46e7-b550-592bd90db983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f200887ca764a72b0640476fe3eb41b, user_id=27fd1a6075694b2c833b345485d5319c, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:34.065752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a51dbc-c142-46e7-b550-592bd90db983 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:34.087240 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 412/819] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:19:34 2021] PUT /identity/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/27fd1a6075694b2c833b345485d5319c/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:19:34.364094 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce635b89-2645-4c20-ac01-ce2a8d5d9fd4 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:34.364594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce635b89-2645-4c20-ac01-ce2a8d5d9fd4 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:34.364594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce635b89-2645-4c20-ac01-ce2a8d5d9fd4 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:34.366700 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 408/820] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:34.373166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bf04e-63ff-4932-90b0-169c228a992a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:34.374020 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bf04e-63ff-4932-90b0-169c228a992a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:34.374511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bf04e-63ff-4932-90b0-169c228a992a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:34.403403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-df5bf04e-63ff-4932-90b0-169c228a992a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:34.405011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-df5bf04e-63ff-4932-90b0-169c228a992a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:34.475139 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0d666-6213-41fd-9d20-d9c7513110dd None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:34.475481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0d666-6213-41fd-9d20-d9c7513110dd None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:34.475696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0d666-6213-41fd-9d20-d9c7513110dd None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:34.478469 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 409/821] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:19:34.484002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbcf4f-cb73-4984-bfaf-7bf4a8dfacb5 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:34.484687 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbcf4f-cb73-4984-bfaf-7bf4a8dfacb5 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:34.484969 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbcf4f-cb73-4984-bfaf-7bf4a8dfacb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:34.509995 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 413/822] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:34 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:34.511109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-eebbcf4f-cb73-4984-bfaf-7bf4a8dfacb5 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:34.512505 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-eebbcf4f-cb73-4984-bfaf-7bf4a8dfacb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:34.521703 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 410/823] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:34 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:19:34.538771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bf04e-63ff-4932-90b0-169c228a992a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:34.546519 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbcf4f-cb73-4984-bfaf-7bf4a8dfacb5 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:34.548400 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bf04e-63ff-4932-90b0-169c228a992a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:34.555994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b645a3-4018-4d50-af5e-77d0a3ada363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:34.556803 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b645a3-4018-4d50-af5e-77d0a3ada363 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:34.557078 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b645a3-4018-4d50-af5e-77d0a3ada363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:34.557354 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b645a3-4018-4d50-af5e-77d0a3ada363 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:34.558021 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b645a3-4018-4d50-af5e-77d0a3ada363 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:34.558453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbcf4f-cb73-4984-bfaf-7bf4a8dfacb5 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:34.561080 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b645a3-4018-4d50-af5e-77d0a3ada363 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:34.564907 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b90e7-423d-4ab6-b691-e09f0ace0b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:34.565925 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b90e7-423d-4ab6-b691-e09f0ace0b00 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:34.566416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b90e7-423d-4ab6-b691-e09f0ace0b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:34.566947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b90e7-423d-4ab6-b691-e09f0ace0b00 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:34.567814 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b90e7-423d-4ab6-b691-e09f0ace0b00 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:34.569623 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b90e7-423d-4ab6-b691-e09f0ace0b00 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:34.574065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-24b645a3-4018-4d50-af5e-77d0a3ada363 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 13:19:34.575564 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 414/824] 10.222.0.60 () {56 vars in 1150 bytes} [Wed Dec 15 13:19:34 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:34.582287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-d12b90e7-423d-4ab6-b691-e09f0ace0b00 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 13:19:34.583766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b645a3-4018-4d50-af5e-77d0a3ada363 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:34.584239 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 411/825] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:34 2021] GET /identity/v3/services/network => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:34.590336 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b90e7-423d-4ab6-b691-e09f0ace0b00 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:34.600034 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b645a3-4018-4d50-af5e-77d0a3ada363 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:34.602452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b90e7-423d-4ab6-b691-e09f0ace0b00 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:34.607152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f30e8-6ef0-4424-beb4-262754f02d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:34.608223 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f30e8-6ef0-4424-beb4-262754f02d05 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:34.608798 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f30e8-6ef0-4424-beb4-262754f02d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:34.609353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f30e8-6ef0-4424-beb4-262754f02d05 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:34.610281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f30e8-6ef0-4424-beb4-262754f02d05 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:34.610817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f30e8-6ef0-4424-beb4-262754f02d05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:34.612635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f30e8-6ef0-4424-beb4-262754f02d05 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:34.616978 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de330ecb-ad5a-4833-a86a-5ceeb312698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:34.617593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330ecb-ad5a-4833-a86a-5ceeb312698d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:34.617878 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330ecb-ad5a-4833-a86a-5ceeb312698d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:34.618156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330ecb-ad5a-4833-a86a-5ceeb312698d admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:34.618900 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de330ecb-ad5a-4833-a86a-5ceeb312698d admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:34.619291 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de330ecb-ad5a-4833-a86a-5ceeb312698d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:34.619491 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 412/826] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Dec 15 13:19:34 2021] GET /identity/v3/services?name=network => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:34.623029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de330ecb-ad5a-4833-a86a-5ceeb312698d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:34.625775 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f30e8-6ef0-4424-beb4-262754f02d05 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:34.631044 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 415/827] 10.222.0.60 () {56 vars in 1145 bytes} [Wed Dec 15 13:19:34 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:34.636532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de330ecb-ad5a-4833-a86a-5ceeb312698d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:34.637386 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f30e8-6ef0-4424-beb4-262754f02d05 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:34.642740 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78861289-7270-4891-9826-9dc70584d15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:34.643675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861289-7270-4891-9826-9dc70584d15d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:34.644222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861289-7270-4891-9826-9dc70584d15d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:34.644687 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861289-7270-4891-9826-9dc70584d15d admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:34.645701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78861289-7270-4891-9826-9dc70584d15d admin admin] RBAC: Adding query filter params (type=network) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:34.646211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78861289-7270-4891-9826-9dc70584d15d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:34.648245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78861289-7270-4891-9826-9dc70584d15d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:34.654831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 413/828] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Dec 15 13:19:34 2021] GET /identity/v3/services?type=network => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:34.661320 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de330ecb-ad5a-4833-a86a-5ceeb312698d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:34.664173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78861289-7270-4891-9826-9dc70584d15d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:34.672315 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356874d-bf4b-465a-a415-21d64dcdc07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:34.673265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356874d-bf4b-465a-a415-21d64dcdc07d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:34.673791 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356874d-bf4b-465a-a415-21d64dcdc07d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:34.674944 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356874d-bf4b-465a-a415-21d64dcdc07d admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:34.676279 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356874d-bf4b-465a-a415-21d64dcdc07d admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:34.677490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356874d-bf4b-465a-a415-21d64dcdc07d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:34.679800 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356874d-bf4b-465a-a415-21d64dcdc07d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:34.685476 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78861289-7270-4891-9826-9dc70584d15d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:34.694152 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 416/829] 10.222.0.60 () {56 vars in 1145 bytes} [Wed Dec 15 13:19:34 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:34.695599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ed1cc-c7d0-44c3-a647-7814c69b9c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:34.696521 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ed1cc-c7d0-44c3-a647-7814c69b9c13 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:34.697016 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ed1cc-c7d0-44c3-a647-7814c69b9c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:34.697530 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ed1cc-c7d0-44c3-a647-7814c69b9c13 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:34.698574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ed1cc-c7d0-44c3-a647-7814c69b9c13 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:34.699867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-667ed1cc-c7d0-44c3-a647-7814c69b9c13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:34.699867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:19:34.699867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:19:34.701191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ed1cc-c7d0-44c3-a647-7814c69b9c13 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:34.705467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356874d-bf4b-465a-a415-21d64dcdc07d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:34.715714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356874d-bf4b-465a-a415-21d64dcdc07d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:34.720572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0947c9-aabd-4331-8ea2-225dbb94eb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:34.721513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0947c9-aabd-4331-8ea2-225dbb94eb9f admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:34.722001 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0947c9-aabd-4331-8ea2-225dbb94eb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:34.722532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0947c9-aabd-4331-8ea2-225dbb94eb9f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:34.723496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0947c9-aabd-4331-8ea2-225dbb94eb9f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:34.724860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-3c0947c9-aabd-4331-8ea2-225dbb94eb9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:19:34.724860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:19:34.724860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:19:34.726112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0947c9-aabd-4331-8ea2-225dbb94eb9f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:34.748054 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 414/830] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Dec 15 13:19:34 2021] POST /identity/v3/endpoints => generated 327 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:34.755362 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 417/831] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Dec 15 13:19:34 2021] POST /identity/v3/endpoints => generated 346 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:19:35.556527 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e8278-d05d-4e96-a9c0-3a2691801f8c None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.557044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e8278-d05d-4e96-a9c0-3a2691801f8c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.557152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e8278-d05d-4e96-a9c0-3a2691801f8c None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.559121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 415/832] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:35.565494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae76771-a351-4d8e-9252-2d49f88ae68b None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.565881 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae76771-a351-4d8e-9252-2d49f88ae68b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.566045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae76771-a351-4d8e-9252-2d49f88ae68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.584456 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-9ae76771-a351-4d8e-9252-2d49f88ae68b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:35.585644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9ae76771-a351-4d8e-9252-2d49f88ae68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:35.602316 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 418/833] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:35 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:19:35.626683 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e8278-d05d-4e96-a9c0-3a2691801f8c None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:35.639031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e8278-d05d-4e96-a9c0-3a2691801f8c None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:35.643982 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83607e4-a4d4-4c09-8028-21ca22a7fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:35.644758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83607e4-a4d4-4c09-8028-21ca22a7fd04 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.645041 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83607e4-a4d4-4c09-8028-21ca22a7fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.645319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83607e4-a4d4-4c09-8028-21ca22a7fd04 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.656347 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83607e4-a4d4-4c09-8028-21ca22a7fd04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:35.663319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-a83607e4-a4d4-4c09-8028-21ca22a7fd04 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:19:35.664829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 416/834] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:19:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:35.671262 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae76771-a351-4d8e-9252-2d49f88ae68b None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:35.680738 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae76771-a351-4d8e-9252-2d49f88ae68b None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:35.685281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f1313-04c2-41de-abb3-99cb130088b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:35.685939 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f1313-04c2-41de-abb3-99cb130088b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.686219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f1313-04c2-41de-abb3-99cb130088b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.686496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f1313-04c2-41de-abb3-99cb130088b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.687308 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f1313-04c2-41de-abb3-99cb130088b1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:35.687614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f1313-04c2-41de-abb3-99cb130088b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:35.689776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f1313-04c2-41de-abb3-99cb130088b1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:35.698310 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 419/835] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:19:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:35.704534 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83607e4-a4d4-4c09-8028-21ca22a7fd04 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:35.714376 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83607e4-a4d4-4c09-8028-21ca22a7fd04 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:35.718972 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcab68-37f7-49da-bf8e-aaf37d1d4e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:35.719776 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcab68-37f7-49da-bf8e-aaf37d1d4e2e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.720138 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcab68-37f7-49da-bf8e-aaf37d1d4e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.720421 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcab68-37f7-49da-bf8e-aaf37d1d4e2e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.731447 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcab68-37f7-49da-bf8e-aaf37d1d4e2e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:35.733347 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcab68-37f7-49da-bf8e-aaf37d1d4e2e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:35.750304 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-e0bcab68-37f7-49da-bf8e-aaf37d1d4e2e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:35.752369 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 417/836] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:35.758377 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f1313-04c2-41de-abb3-99cb130088b1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:35.768153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f1313-04c2-41de-abb3-99cb130088b1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:35.772688 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c4831-fd4a-4c36-82bc-b0d6643e6d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:35.773342 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c4831-fd4a-4c36-82bc-b0d6643e6d85 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.773624 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c4831-fd4a-4c36-82bc-b0d6643e6d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.773904 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c4831-fd4a-4c36-82bc-b0d6643e6d85 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.774644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c4831-fd4a-4c36-82bc-b0d6643e6d85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:35.774983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c4831-fd4a-4c36-82bc-b0d6643e6d85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:35.776580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c4831-fd4a-4c36-82bc-b0d6643e6d85 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:35.789101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 420/837] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:35.794981 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcab68-37f7-49da-bf8e-aaf37d1d4e2e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:35.805481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcab68-37f7-49da-bf8e-aaf37d1d4e2e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:35.810065 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa2347-1235-42d7-9878-f2432da091be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:35.810800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa2347-1235-42d7-9878-f2432da091be admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.811111 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa2347-1235-42d7-9878-f2432da091be admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.811387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa2347-1235-42d7-9878-f2432da091be admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.820525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa2347-1235-42d7-9878-f2432da091be admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:35.822795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa2347-1235-42d7-9878-f2432da091be admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:35.836575 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e7423-d339-4580-b1e9-f9b2a7ff0702 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.836863 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e7423-d339-4580-b1e9-f9b2a7ff0702 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.837146 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e7423-d339-4580-b1e9-f9b2a7ff0702 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.837856 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-a9fa2347-1235-42d7-9878-f2432da091be admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 13:19:35.839316 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 421/838] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:35.839718 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 418/839] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Dec 15 13:19:35 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:35.844906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778633e-98bf-4d79-a7ae-c0ce807587b2 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.845194 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778633e-98bf-4d79-a7ae-c0ce807587b2 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.845475 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778633e-98bf-4d79-a7ae-c0ce807587b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.847733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa2347-1235-42d7-9878-f2432da091be admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:35.859797 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa2347-1235-42d7-9878-f2432da091be admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:35.864861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-7778633e-98bf-4d79-a7ae-c0ce807587b2 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:35.864975 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a5b8d-0dd0-4edb-8364-34eb3dbde437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:35.865509 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a5b8d-0dd0-4edb-8364-34eb3dbde437 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.865788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a5b8d-0dd0-4edb-8364-34eb3dbde437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.866062 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a5b8d-0dd0-4edb-8364-34eb3dbde437 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.866930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a5b8d-0dd0-4edb-8364-34eb3dbde437 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:35.867243 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a5b8d-0dd0-4edb-8364-34eb3dbde437 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:35.867616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-7778633e-98bf-4d79-a7ae-c0ce807587b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:35.869071 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a5b8d-0dd0-4edb-8364-34eb3dbde437 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:35.877293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 422/840] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:35 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:35.889911 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 419/841] 10.222.0.60 () {56 vars in 1170 bytes} [Wed Dec 15 13:19:35 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:35.896118 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778633e-98bf-4d79-a7ae-c0ce807587b2 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:35.898829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a5b8d-0dd0-4edb-8364-34eb3dbde437 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:35.906971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778633e-98bf-4d79-a7ae-c0ce807587b2 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:35.908574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a5b8d-0dd0-4edb-8364-34eb3dbde437 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:35.911501 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f2623-3561-45ba-be7d-9865bd19db25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:35.912138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f2623-3561-45ba-be7d-9865bd19db25 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.912421 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f2623-3561-45ba-be7d-9865bd19db25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.912702 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f2623-3561-45ba-be7d-9865bd19db25 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.913802 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a582d6d-fc38-455c-a097-cbdce72dad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:35.914574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a582d6d-fc38-455c-a097-cbdce72dad74 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.914929 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a582d6d-fc38-455c-a097-cbdce72dad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.915207 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a582d6d-fc38-455c-a097-cbdce72dad74 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.915910 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a582d6d-fc38-455c-a097-cbdce72dad74 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:35.917577 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a582d6d-fc38-455c-a097-cbdce72dad74 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:35.922022 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f2623-3561-45ba-be7d-9865bd19db25 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:35.924300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f2623-3561-45ba-be7d-9865bd19db25 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:35.930313 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-0a582d6d-fc38-455c-a097-cbdce72dad74 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 13:19:35.931487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 420/842] 10.222.0.60 () {56 vars in 1153 bytes} [Wed Dec 15 13:19:35 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:35.933966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 423/843] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:35 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:19:35.940197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a582d6d-fc38-455c-a097-cbdce72dad74 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:35.940311 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f2623-3561-45ba-be7d-9865bd19db25 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:35.949656 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a582d6d-fc38-455c-a097-cbdce72dad74 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:35.949824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f2623-3561-45ba-be7d-9865bd19db25 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:35.954519 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eef32a-e180-4d1f-970b-5d9210753ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:35.954725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fda170-d851-46fd-9044-f9ca142d8f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:35.955374 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fda170-d851-46fd-9044-f9ca142d8f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.955491 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eef32a-e180-4d1f-970b-5d9210753ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.955646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fda170-d851-46fd-9044-f9ca142d8f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.955736 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eef32a-e180-4d1f-970b-5d9210753ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.955921 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fda170-d851-46fd-9044-f9ca142d8f01 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.956018 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eef32a-e180-4d1f-970b-5d9210753ac4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.956815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fda170-d851-46fd-9044-f9ca142d8f01 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:35.957120 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fda170-d851-46fd-9044-f9ca142d8f01 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:35.958815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fda170-d851-46fd-9044-f9ca142d8f01 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:35.966959 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 421/844] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Dec 15 13:19:35 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:35.967610 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eef32a-e180-4d1f-970b-5d9210753ac4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:35.969488 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eef32a-e180-4d1f-970b-5d9210753ac4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:35.969648 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fda170-d851-46fd-9044-f9ca142d8f01 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:35.978955 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fda170-d851-46fd-9044-f9ca142d8f01 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:35.983288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bfc6e-98c5-4e8d-b7c3-e6a7bc5a2a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:35.983905 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bfc6e-98c5-4e8d-b7c3-e6a7bc5a2a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:35.984184 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bfc6e-98c5-4e8d-b7c3-e6a7bc5a2a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:35.984455 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bfc6e-98c5-4e8d-b7c3-e6a7bc5a2a42 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:35.985149 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bfc6e-98c5-4e8d-b7c3-e6a7bc5a2a42 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:35.985982 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bfc6e-98c5-4e8d-b7c3-e6a7bc5a2a42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:35.987563 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bfc6e-98c5-4e8d-b7c3-e6a7bc5a2a42 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:35.989778 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-b8eef32a-e180-4d1f-970b-5d9210753ac4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:35.991549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 424/845] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:35.997631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eef32a-e180-4d1f-970b-5d9210753ac4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:35.998329 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 422/846] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Dec 15 13:19:35 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:36.009119 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eef32a-e180-4d1f-970b-5d9210753ac4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:36.014128 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305b827-4479-4744-a62d-61734048f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:36.014885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305b827-4479-4744-a62d-61734048f2ee admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:36.015179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305b827-4479-4744-a62d-61734048f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:36.015507 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305b827-4479-4744-a62d-61734048f2ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:36.016267 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305b827-4479-4744-a62d-61734048f2ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:36.016771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305b827-4479-4744-a62d-61734048f2ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:36.019021 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305b827-4479-4744-a62d-61734048f2ee admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:36.034489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 425/847] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:36.040669 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bfc6e-98c5-4e8d-b7c3-e6a7bc5a2a42 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:36.052225 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bfc6e-98c5-4e8d-b7c3-e6a7bc5a2a42 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:36.057122 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ea773-b8d3-4f18-9751-b2b77b3c0312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:36.057995 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ea773-b8d3-4f18-9751-b2b77b3c0312 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:36.058277 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ea773-b8d3-4f18-9751-b2b77b3c0312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:36.058553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ea773-b8d3-4f18-9751-b2b77b3c0312 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:36.067087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ea773-b8d3-4f18-9751-b2b77b3c0312 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:36.069082 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ea773-b8d3-4f18-9751-b2b77b3c0312 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:36.084515 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-465ea773-b8d3-4f18-9751-b2b77b3c0312 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:36.086105 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 423/848] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:36.092548 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305b827-4479-4744-a62d-61734048f2ee admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:36.103487 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305b827-4479-4744-a62d-61734048f2ee admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:36.108274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20defe13-7470-43ee-a359-ce175c156b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:36.108998 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20defe13-7470-43ee-a359-ce175c156b7b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:36.109288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20defe13-7470-43ee-a359-ce175c156b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:36.109567 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20defe13-7470-43ee-a359-ce175c156b7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:36.111030 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20defe13-7470-43ee-a359-ce175c156b7b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:36.111346 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20defe13-7470-43ee-a359-ce175c156b7b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:36.113297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20defe13-7470-43ee-a359-ce175c156b7b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:36.136131 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 426/849] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:36.139592 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ea773-b8d3-4f18-9751-b2b77b3c0312 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:36.150101 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ea773-b8d3-4f18-9751-b2b77b3c0312 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:36.154993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86acea-5ce5-4c4c-bb58-b479cd17bbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:36.155558 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86acea-5ce5-4c4c-bb58-b479cd17bbec admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:36.155840 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86acea-5ce5-4c4c-bb58-b479cd17bbec admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:36.156127 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86acea-5ce5-4c4c-bb58-b479cd17bbec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:36.156997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86acea-5ce5-4c4c-bb58-b479cd17bbec admin admin] RBAC: Adding query filter params (role.id=bf8b5076a92449fba2f54db6ae519ba6, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=77744968b6b14415b5b85423db1cfd25) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:36.157854 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86acea-5ce5-4c4c-bb58-b479cd17bbec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:36.159806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86acea-5ce5-4c4c-bb58-b479cd17bbec admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:36.171158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 424/850] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:36 2021] GET /identity/v3/role_assignments?user.id=77744968b6b14415b5b85423db1cfd25&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=bf8b5076a92449fba2f54db6ae519ba6 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:36.812440 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b63f3e-8d8d-464b-be7a-e528684c7b74 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:36.813135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b63f3e-8d8d-464b-be7a-e528684c7b74 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:36.813135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b63f3e-8d8d-464b-be7a-e528684c7b74 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:36.815578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 427/851] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:36.821389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bbe9e-096d-4226-9bd0-3be1f489e956 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:36.821883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bbe9e-096d-4226-9bd0-3be1f489e956 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:36.822052 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bbe9e-096d-4226-9bd0-3be1f489e956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:36.840626 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-216bbe9e-096d-4226-9bd0-3be1f489e956 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:36.841806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-216bbe9e-096d-4226-9bd0-3be1f489e956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:36.849686 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 425/852] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:36 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:19:36.873441 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b63f3e-8d8d-464b-be7a-e528684c7b74 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:36.886576 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b63f3e-8d8d-464b-be7a-e528684c7b74 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:36.894341 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2765be-fb46-412d-8855-ced0390d3013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:36.895223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2765be-fb46-412d-8855-ced0390d3013 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:36.895511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2765be-fb46-412d-8855-ced0390d3013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:36.895785 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2765be-fb46-412d-8855-ced0390d3013 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:36.906942 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2765be-fb46-412d-8855-ced0390d3013 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:36.913848 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-2d2765be-fb46-412d-8855-ced0390d3013 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:19:36.915383 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 428/853] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:19:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:36.921987 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bbe9e-096d-4226-9bd0-3be1f489e956 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:36.931066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bbe9e-096d-4226-9bd0-3be1f489e956 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:36.935764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c8245-b860-4a99-9b26-c32e83a09c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:36.936421 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c8245-b860-4a99-9b26-c32e83a09c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:36.936754 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c8245-b860-4a99-9b26-c32e83a09c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:36.937038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c8245-b860-4a99-9b26-c32e83a09c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:36.937808 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c8245-b860-4a99-9b26-c32e83a09c14 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:36.938117 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c8245-b860-4a99-9b26-c32e83a09c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:36.940390 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c8245-b860-4a99-9b26-c32e83a09c14 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:36.949289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 426/854] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:36.955993 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2765be-fb46-412d-8855-ced0390d3013 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:36.965843 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2765be-fb46-412d-8855-ced0390d3013 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:36.970463 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42119368-53d1-47b6-87ce-50896da13452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:36.971301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42119368-53d1-47b6-87ce-50896da13452 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:36.971640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42119368-53d1-47b6-87ce-50896da13452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:36.971919 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42119368-53d1-47b6-87ce-50896da13452 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:36.984138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42119368-53d1-47b6-87ce-50896da13452 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:36.986035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42119368-53d1-47b6-87ce-50896da13452 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:37.003247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-42119368-53d1-47b6-87ce-50896da13452 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:37.004711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 429/855] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:37.010772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c8245-b860-4a99-9b26-c32e83a09c14 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:37.021400 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c8245-b860-4a99-9b26-c32e83a09c14 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:37.026138 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ce94e-582c-422e-8383-5fd937c67ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:37.026865 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ce94e-582c-422e-8383-5fd937c67ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:37.027161 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ce94e-582c-422e-8383-5fd937c67ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:37.027441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ce94e-582c-422e-8383-5fd937c67ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:37.028301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ce94e-582c-422e-8383-5fd937c67ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:37.028616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ce94e-582c-422e-8383-5fd937c67ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:37.030343 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ce94e-582c-422e-8383-5fd937c67ac0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:37.046267 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 427/856] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:37.052735 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42119368-53d1-47b6-87ce-50896da13452 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:37.063856 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42119368-53d1-47b6-87ce-50896da13452 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:37.068673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505631b3-1aa1-4999-a5e2-da94795e6ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:37.069471 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505631b3-1aa1-4999-a5e2-da94795e6ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:37.069807 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505631b3-1aa1-4999-a5e2-da94795e6ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:37.070091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505631b3-1aa1-4999-a5e2-da94795e6ec3 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:37.079593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505631b3-1aa1-4999-a5e2-da94795e6ec3 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:37.081741 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505631b3-1aa1-4999-a5e2-da94795e6ec3 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:37.095917 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-505631b3-1aa1-4999-a5e2-da94795e6ec3 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 13:19:37.097409 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 430/857] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:19:37 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:37.103555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ce94e-582c-422e-8383-5fd937c67ac0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:37.113584 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ce94e-582c-422e-8383-5fd937c67ac0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:37.118361 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696f3b-0932-4bc4-a116-d470ffb48d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:37.119105 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696f3b-0932-4bc4-a116-d470ffb48d36 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:37.119386 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696f3b-0932-4bc4-a116-d470ffb48d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:37.119714 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696f3b-0932-4bc4-a116-d470ffb48d36 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:37.120572 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25696f3b-0932-4bc4-a116-d470ffb48d36 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:37.120934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25696f3b-0932-4bc4-a116-d470ffb48d36 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:37.122855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25696f3b-0932-4bc4-a116-d470ffb48d36 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:37.142724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 428/858] 10.222.0.60 () {56 vars in 1156 bytes} [Wed Dec 15 13:19:37 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:37.148915 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505631b3-1aa1-4999-a5e2-da94795e6ec3 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:37.159125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505631b3-1aa1-4999-a5e2-da94795e6ec3 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:37.163822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdea65-85f9-4f7e-b12e-80350fb4f4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:37.164524 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdea65-85f9-4f7e-b12e-80350fb4f4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:37.164804 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdea65-85f9-4f7e-b12e-80350fb4f4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:37.165135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdea65-85f9-4f7e-b12e-80350fb4f4e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:37.174221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdea65-85f9-4f7e-b12e-80350fb4f4e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:37.176059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdea65-85f9-4f7e-b12e-80350fb4f4e0 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:37.185431 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 431/859] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:37 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:19:37.192222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696f3b-0932-4bc4-a116-d470ffb48d36 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:37.202370 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696f3b-0932-4bc4-a116-d470ffb48d36 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:37.207321 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510d90b-f020-4647-b2a1-67c5a50243db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:37.208181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d90b-f020-4647-b2a1-67c5a50243db admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:37.208463 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d90b-f020-4647-b2a1-67c5a50243db admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:37.208740 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d90b-f020-4647-b2a1-67c5a50243db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:37.220227 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510d90b-f020-4647-b2a1-67c5a50243db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:37.222068 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510d90b-f020-4647-b2a1-67c5a50243db admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:37.239949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-4510d90b-f020-4647-b2a1-67c5a50243db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:37.241483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 429/860] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:37.247705 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdea65-85f9-4f7e-b12e-80350fb4f4e0 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:37.257398 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdea65-85f9-4f7e-b12e-80350fb4f4e0 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:37.262172 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029524d8-1c0b-416e-b9e2-2a6eceb6e226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:37.262824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029524d8-1c0b-416e-b9e2-2a6eceb6e226 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:37.263137 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029524d8-1c0b-416e-b9e2-2a6eceb6e226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:37.263475 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029524d8-1c0b-416e-b9e2-2a6eceb6e226 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:37.264221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029524d8-1c0b-416e-b9e2-2a6eceb6e226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:37.264587 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029524d8-1c0b-416e-b9e2-2a6eceb6e226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:37.266257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029524d8-1c0b-416e-b9e2-2a6eceb6e226 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:37.278876 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 432/861] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:37.284958 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510d90b-f020-4647-b2a1-67c5a50243db admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:37.295144 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510d90b-f020-4647-b2a1-67c5a50243db admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:37.300409 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc4367-06dd-4d1e-93f6-b89b6c29ca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:37.301237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc4367-06dd-4d1e-93f6-b89b6c29ca5c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:37.301522 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc4367-06dd-4d1e-93f6-b89b6c29ca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:37.301803 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc4367-06dd-4d1e-93f6-b89b6c29ca5c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:37.309233 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc4367-06dd-4d1e-93f6-b89b6c29ca5c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:37.311300 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc4367-06dd-4d1e-93f6-b89b6c29ca5c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:37.325393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-0dfc4367-06dd-4d1e-93f6-b89b6c29ca5c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:37.326951 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 430/862] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:37.333380 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029524d8-1c0b-416e-b9e2-2a6eceb6e226 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:37.343479 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029524d8-1c0b-416e-b9e2-2a6eceb6e226 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:37.348259 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32eb56-8d5f-4dce-9126-d00b4bf5ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:37.349012 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32eb56-8d5f-4dce-9126-d00b4bf5ce21 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:37.349298 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32eb56-8d5f-4dce-9126-d00b4bf5ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:37.349580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32eb56-8d5f-4dce-9126-d00b4bf5ce21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:37.350440 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32eb56-8d5f-4dce-9126-d00b4bf5ce21 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:37.350756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32eb56-8d5f-4dce-9126-d00b4bf5ce21 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:37.352683 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32eb56-8d5f-4dce-9126-d00b4bf5ce21 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:37.365889 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 433/863] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:37.372333 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc4367-06dd-4d1e-93f6-b89b6c29ca5c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:37.383909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc4367-06dd-4d1e-93f6-b89b6c29ca5c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:37.388758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5f612-d95f-42eb-84dd-b90e483155de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:37.389472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5f612-d95f-42eb-84dd-b90e483155de admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:37.389757 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5f612-d95f-42eb-84dd-b90e483155de admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:37.390035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5f612-d95f-42eb-84dd-b90e483155de admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:37.391000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5f612-d95f-42eb-84dd-b90e483155de admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=27fd1a6075694b2c833b345485d5319c) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:37.391353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5f612-d95f-42eb-84dd-b90e483155de admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:37.393405 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5f612-d95f-42eb-84dd-b90e483155de admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:37.400801 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 431/864] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:37 2021] GET /identity/v3/role_assignments?user.id=27fd1a6075694b2c833b345485d5319c&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:37.476706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfec9a7-bbc3-4190-8576-364ad8d76c09 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:37.476706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfec9a7-bbc3-4190-8576-364ad8d76c09 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:37.476706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfec9a7-bbc3-4190-8576-364ad8d76c09 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:37.476706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 434/865] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:37.486560 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1dad2-a3f6-4f30-8272-8dd8ece7ef4f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:37.486560 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1dad2-a3f6-4f30-8272-8dd8ece7ef4f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:37.486560 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1dad2-a3f6-4f30-8272-8dd8ece7ef4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:37.505570 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-15a1dad2-a3f6-4f30-8272-8dd8ece7ef4f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:37.506785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-15a1dad2-a3f6-4f30-8272-8dd8ece7ef4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:37.515076 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 432/866] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:37 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:37.539134 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfec9a7-bbc3-4190-8576-364ad8d76c09 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:37.553315 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfec9a7-bbc3-4190-8576-364ad8d76c09 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:37.558734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cd04d-2abb-431b-9992-2b19e93c1493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:37.559969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cd04d-2abb-431b-9992-2b19e93c1493 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:37.560479 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cd04d-2abb-431b-9992-2b19e93c1493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:37.560975 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cd04d-2abb-431b-9992-2b19e93c1493 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:37.561971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cd04d-2abb-431b-9992-2b19e93c1493 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:37.563959 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cd04d-2abb-431b-9992-2b19e93c1493 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:37.576598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-df6cd04d-2abb-431b-9992-2b19e93c1493 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 13:19:37.583173 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 435/867] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:19:37 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:37.585947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1dad2-a3f6-4f30-8272-8dd8ece7ef4f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:37.596449 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1dad2-a3f6-4f30-8272-8dd8ece7ef4f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:37.601537 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44d1f9-24ec-4874-8ad4-1fecdc6e2943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:37.602553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44d1f9-24ec-4874-8ad4-1fecdc6e2943 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:37.603067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44d1f9-24ec-4874-8ad4-1fecdc6e2943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:37.603614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44d1f9-24ec-4874-8ad4-1fecdc6e2943 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:37.604590 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44d1f9-24ec-4874-8ad4-1fecdc6e2943 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:37.605115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44d1f9-24ec-4874-8ad4-1fecdc6e2943 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:37.607042 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44d1f9-24ec-4874-8ad4-1fecdc6e2943 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:37.618247 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 433/868] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:19:37 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:37.619917 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cd04d-2abb-431b-9992-2b19e93c1493 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:37.630194 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cd04d-2abb-431b-9992-2b19e93c1493 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:37.634865 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c453ee-23f7-4283-805f-084c72bd9295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:37.635628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c453ee-23f7-4283-805f-084c72bd9295 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:37.636009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c453ee-23f7-4283-805f-084c72bd9295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:37.636386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c453ee-23f7-4283-805f-084c72bd9295 admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:37.637214 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c453ee-23f7-4283-805f-084c72bd9295 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:37.637639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c453ee-23f7-4283-805f-084c72bd9295 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:37.639363 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c453ee-23f7-4283-805f-084c72bd9295 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:37.644714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 436/869] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:19:37 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:38.470046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27253bcc-32e6-47f5-b4fc-6750c7cc84e9 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:38.470590 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27253bcc-32e6-47f5-b4fc-6750c7cc84e9 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:38.470590 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27253bcc-32e6-47f5-b4fc-6750c7cc84e9 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:38.472628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 434/870] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:38.478628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c00ed-fd46-4f4d-acc7-eec42b858a7d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:38.479056 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c00ed-fd46-4f4d-acc7-eec42b858a7d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:38.479227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c00ed-fd46-4f4d-acc7-eec42b858a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:38.497275 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-ee9c00ed-fd46-4f4d-acc7-eec42b858a7d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:38.498458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-ee9c00ed-fd46-4f4d-acc7-eec42b858a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:38.507018 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 437/871] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:38 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:19:38.530646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27253bcc-32e6-47f5-b4fc-6750c7cc84e9 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:38.543227 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27253bcc-32e6-47f5-b4fc-6750c7cc84e9 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:38.547939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850e524-a3c8-4d08-b864-11958d8065fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:38.548594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850e524-a3c8-4d08-b864-11958d8065fc admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:38.548875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850e524-a3c8-4d08-b864-11958d8065fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:38.549151 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850e524-a3c8-4d08-b864-11958d8065fc admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:38.549902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850e524-a3c8-4d08-b864-11958d8065fc admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:38.551545 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850e524-a3c8-4d08-b864-11958d8065fc admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:38.567506 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 435/872] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Dec 15 13:19:38 2021] POST /identity/v3/services => generated 269 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:38.648722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f3fc-cfc3-49a6-833d-58752ae52742 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:38.649075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f3fc-cfc3-49a6-833d-58752ae52742 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:38.649333 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f3fc-cfc3-49a6-833d-58752ae52742 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:38.651505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 438/873] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:38.659468 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6c2e0-7d5d-4ba5-a16a-2b9be6a2c747 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:38.659842 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6c2e0-7d5d-4ba5-a16a-2b9be6a2c747 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:38.660135 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6c2e0-7d5d-4ba5-a16a-2b9be6a2c747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:38.680300 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-eeb6c2e0-7d5d-4ba5-a16a-2b9be6a2c747 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:38.681574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-eeb6c2e0-7d5d-4ba5-a16a-2b9be6a2c747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:38.699816 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 436/874] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:38 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:38.723750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3f3fc-cfc3-49a6-833d-58752ae52742 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:38.739981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3f3fc-cfc3-49a6-833d-58752ae52742 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:38.744633 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc63f1-64c2-4308-af59-627afdb32f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:38.745559 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc63f1-64c2-4308-af59-627afdb32f26 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:38.745852 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc63f1-64c2-4308-af59-627afdb32f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:38.746130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc63f1-64c2-4308-af59-627afdb32f26 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:38.759521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc63f1-64c2-4308-af59-627afdb32f26 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:38.767197 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-95fc63f1-64c2-4308-af59-627afdb32f26 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 13:19:38.768796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 439/875] 10.222.0.60 () {56 vars in 1141 bytes} [Wed Dec 15 13:19:38 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:38.775283 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6c2e0-7d5d-4ba5-a16a-2b9be6a2c747 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:38.785402 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6c2e0-7d5d-4ba5-a16a-2b9be6a2c747 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:38.790555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fc3ab-88e3-4579-8433-ca34ee9cf958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:38.791599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fc3ab-88e3-4579-8433-ca34ee9cf958 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:38.792120 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fc3ab-88e3-4579-8433-ca34ee9cf958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:38.792598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fc3ab-88e3-4579-8433-ca34ee9cf958 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:38.793569 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fc3ab-88e3-4579-8433-ca34ee9cf958 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:38.794133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fc3ab-88e3-4579-8433-ca34ee9cf958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:38.796275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fc3ab-88e3-4579-8433-ca34ee9cf958 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:38.807000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 437/876] 10.222.0.60 () {56 vars in 1136 bytes} [Wed Dec 15 13:19:38 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:38.814962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc63f1-64c2-4308-af59-627afdb32f26 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:38.825750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc63f1-64c2-4308-af59-627afdb32f26 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:38.831216 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cad5c3-fd3c-4e00-9d61-4ac9e07898b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:38.832009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cad5c3-fd3c-4e00-9d61-4ac9e07898b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:38.832296 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cad5c3-fd3c-4e00-9d61-4ac9e07898b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:38.832577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cad5c3-fd3c-4e00-9d61-4ac9e07898b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:38.844431 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cad5c3-fd3c-4e00-9d61-4ac9e07898b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:38.846369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cad5c3-fd3c-4e00-9d61-4ac9e07898b7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:38.864070 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-47cad5c3-fd3c-4e00-9d61-4ac9e07898b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:38.865603 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 440/877] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:38.871362 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fc3ab-88e3-4579-8433-ca34ee9cf958 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:38.884261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fc3ab-88e3-4579-8433-ca34ee9cf958 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:38.889057 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e67027-e8c3-4fe9-952c-ac14508a68e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:38.890038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e67027-e8c3-4fe9-952c-ac14508a68e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:38.890521 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e67027-e8c3-4fe9-952c-ac14508a68e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:38.891219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e67027-e8c3-4fe9-952c-ac14508a68e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:38.892157 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e67027-e8c3-4fe9-952c-ac14508a68e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:38.892708 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e67027-e8c3-4fe9-952c-ac14508a68e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:38.894519 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e67027-e8c3-4fe9-952c-ac14508a68e4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:38.907531 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 438/878] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:38.913763 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cad5c3-fd3c-4e00-9d61-4ac9e07898b7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:38.924566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cad5c3-fd3c-4e00-9d61-4ac9e07898b7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:38.929238 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d734eba-75d4-4877-ab7c-e57b2d3ad2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:38.930278 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d734eba-75d4-4877-ab7c-e57b2d3ad2ed admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:38.930756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d734eba-75d4-4877-ab7c-e57b2d3ad2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:38.931250 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d734eba-75d4-4877-ab7c-e57b2d3ad2ed admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:38.940166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d734eba-75d4-4877-ab7c-e57b2d3ad2ed admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:38.942422 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d734eba-75d4-4877-ab7c-e57b2d3ad2ed admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:38.956851 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-9d734eba-75d4-4877-ab7c-e57b2d3ad2ed admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 13:19:38.958583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 441/879] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Dec 15 13:19:38 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:38.964891 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e67027-e8c3-4fe9-952c-ac14508a68e4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:38.976619 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e67027-e8c3-4fe9-952c-ac14508a68e4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:38.983146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a5109-f3b1-4fe8-b873-96d4cbf2656c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:38.984064 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a5109-f3b1-4fe8-b873-96d4cbf2656c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:38.984545 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a5109-f3b1-4fe8-b873-96d4cbf2656c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:38.985524 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a5109-f3b1-4fe8-b873-96d4cbf2656c admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:38.986581 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a5109-f3b1-4fe8-b873-96d4cbf2656c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:38.987150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a5109-f3b1-4fe8-b873-96d4cbf2656c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:38.989290 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a5109-f3b1-4fe8-b873-96d4cbf2656c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:39.011747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 439/880] 10.222.0.60 () {56 vars in 1170 bytes} [Wed Dec 15 13:19:38 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:39.018033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d734eba-75d4-4877-ab7c-e57b2d3ad2ed admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:39.028273 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d734eba-75d4-4877-ab7c-e57b2d3ad2ed admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:39.033548 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75312519-94d0-431a-92ef-51f9314571c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:39.034434 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312519-94d0-431a-92ef-51f9314571c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:39.034945 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312519-94d0-431a-92ef-51f9314571c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:39.035420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312519-94d0-431a-92ef-51f9314571c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:39.043884 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75312519-94d0-431a-92ef-51f9314571c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:39.046163 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75312519-94d0-431a-92ef-51f9314571c2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:39.056240 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 442/881] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:39 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:19:39.062431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a5109-f3b1-4fe8-b873-96d4cbf2656c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:39.072877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a5109-f3b1-4fe8-b873-96d4cbf2656c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:39.077585 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf822de-2814-43d1-a85b-e27a1e852633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:39.078627 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf822de-2814-43d1-a85b-e27a1e852633 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:39.079138 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf822de-2814-43d1-a85b-e27a1e852633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:39.079614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf822de-2814-43d1-a85b-e27a1e852633 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:39.090217 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf822de-2814-43d1-a85b-e27a1e852633 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:39.092298 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf822de-2814-43d1-a85b-e27a1e852633 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:39.110299 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-ecf822de-2814-43d1-a85b-e27a1e852633 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:39.112045 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 440/882] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:39.118116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75312519-94d0-431a-92ef-51f9314571c2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:39.127430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75312519-94d0-431a-92ef-51f9314571c2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:39.132108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a97f79-5fe8-40d4-b402-eb4d842f6330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:39.133003 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a97f79-5fe8-40d4-b402-eb4d842f6330 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:39.133490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a97f79-5fe8-40d4-b402-eb4d842f6330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:39.133978 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a97f79-5fe8-40d4-b402-eb4d842f6330 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:39.134932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a97f79-5fe8-40d4-b402-eb4d842f6330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:39.135463 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a97f79-5fe8-40d4-b402-eb4d842f6330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:39.137249 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a97f79-5fe8-40d4-b402-eb4d842f6330 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:39.149895 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 443/883] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:39.155850 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf822de-2814-43d1-a85b-e27a1e852633 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:39.166291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf822de-2814-43d1-a85b-e27a1e852633 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:39.171230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecd4d5-3271-472d-be6b-94637021cb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:39.172797 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecd4d5-3271-472d-be6b-94637021cb4f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:39.173299 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecd4d5-3271-472d-be6b-94637021cb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:39.173772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecd4d5-3271-472d-be6b-94637021cb4f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:39.180869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecd4d5-3271-472d-be6b-94637021cb4f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:39.183051 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecd4d5-3271-472d-be6b-94637021cb4f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:39.196040 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-b6ecd4d5-3271-472d-be6b-94637021cb4f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:39.197698 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 441/884] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:39.203847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a97f79-5fe8-40d4-b402-eb4d842f6330 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:39.213656 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a97f79-5fe8-40d4-b402-eb4d842f6330 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:39.218266 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb743e3-06f3-4506-9ca1-2c2ceca619b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:39.219706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb743e3-06f3-4506-9ca1-2c2ceca619b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:39.220255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb743e3-06f3-4506-9ca1-2c2ceca619b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:39.220725 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb743e3-06f3-4506-9ca1-2c2ceca619b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:39.221729 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb743e3-06f3-4506-9ca1-2c2ceca619b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:39.222244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb743e3-06f3-4506-9ca1-2c2ceca619b3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:39.224304 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb743e3-06f3-4506-9ca1-2c2ceca619b3 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:39.237141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 444/885] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:39.243432 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecd4d5-3271-472d-be6b-94637021cb4f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:39.254105 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecd4d5-3271-472d-be6b-94637021cb4f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:39.258779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16339b28-f32f-445f-a06c-2f78651ab9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:39.259613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16339b28-f32f-445f-a06c-2f78651ab9ad admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:39.259901 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16339b28-f32f-445f-a06c-2f78651ab9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:39.260178 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16339b28-f32f-445f-a06c-2f78651ab9ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:39.261030 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16339b28-f32f-445f-a06c-2f78651ab9ad admin admin] RBAC: Adding query filter params (role.id=e8150335a9c84b6f85ed54a683b549bb, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=77744968b6b14415b5b85423db1cfd25) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:39.261340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16339b28-f32f-445f-a06c-2f78651ab9ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:39.264989 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16339b28-f32f-445f-a06c-2f78651ab9ad admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:39.269439 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 442/886] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:39 2021] GET /identity/v3/role_assignments?user.id=77744968b6b14415b5b85423db1cfd25&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=e8150335a9c84b6f85ed54a683b549bb => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:39.888146 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce8f46-23a3-4d6c-a9c3-93584f466402 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:39.888648 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce8f46-23a3-4d6c-a9c3-93584f466402 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:39.888756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce8f46-23a3-4d6c-a9c3-93584f466402 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:39.890693 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 445/887] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:39.896715 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0528d-b174-4f64-824f-63282e70fe83 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:39.897098 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0528d-b174-4f64-824f-63282e70fe83 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:39.897273 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0528d-b174-4f64-824f-63282e70fe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:39.915722 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-90c0528d-b174-4f64-824f-63282e70fe83 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:39.916914 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-90c0528d-b174-4f64-824f-63282e70fe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:39.925782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 443/888] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:39 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:19:39.948252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce8f46-23a3-4d6c-a9c3-93584f466402 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:39.960509 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce8f46-23a3-4d6c-a9c3-93584f466402 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:39.964946 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b7ee8-d2fc-40ce-9b24-6cf7cb933f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:39.965744 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b7ee8-d2fc-40ce-9b24-6cf7cb933f8d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:39.966029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b7ee8-d2fc-40ce-9b24-6cf7cb933f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:39.966311 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b7ee8-d2fc-40ce-9b24-6cf7cb933f8d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:39.967039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b7ee8-d2fc-40ce-9b24-6cf7cb933f8d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:39.968609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b7ee8-d2fc-40ce-9b24-6cf7cb933f8d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:39.981827 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-302b7ee8-d2fc-40ce-9b24-6cf7cb933f8d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 13:19:39.983371 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 446/889] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Dec 15 13:19:39 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:39.990457 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0528d-b174-4f64-824f-63282e70fe83 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:39.999591 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0528d-b174-4f64-824f-63282e70fe83 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:40.004206 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5caaff-3bde-4a26-a430-fffe88adb97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:40.004861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5caaff-3bde-4a26-a430-fffe88adb97c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:40.005147 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5caaff-3bde-4a26-a430-fffe88adb97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:40.005426 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5caaff-3bde-4a26-a430-fffe88adb97c admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:40.006154 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5caaff-3bde-4a26-a430-fffe88adb97c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:40.006470 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5caaff-3bde-4a26-a430-fffe88adb97c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:40.008124 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5caaff-3bde-4a26-a430-fffe88adb97c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:40.013191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 444/890] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Dec 15 13:19:39 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:40.019303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b7ee8-d2fc-40ce-9b24-6cf7cb933f8d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:40.029160 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b7ee8-d2fc-40ce-9b24-6cf7cb933f8d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:40.034417 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee165e-f6a3-4033-8a21-bce351df6faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:40.035108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee165e-f6a3-4033-8a21-bce351df6faa admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:40.035395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee165e-f6a3-4033-8a21-bce351df6faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:40.035730 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee165e-f6a3-4033-8a21-bce351df6faa admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:40.036467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee165e-f6a3-4033-8a21-bce351df6faa admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:40.036776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee165e-f6a3-4033-8a21-bce351df6faa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:40.038368 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee165e-f6a3-4033-8a21-bce351df6faa admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:40.043324 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 447/891] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Dec 15 13:19:40 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:40.049081 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10ee3-d154-4cdf-98cc-4fb8e82e144c None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:40.049371 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10ee3-d154-4cdf-98cc-4fb8e82e144c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:40.049660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10ee3-d154-4cdf-98cc-4fb8e82e144c None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:40.051862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 445/892] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:40.057826 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634a2a9-d043-4159-881b-e91fdf3a698d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:40.058108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634a2a9-d043-4159-881b-e91fdf3a698d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:40.058384 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634a2a9-d043-4159-881b-e91fdf3a698d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:40.077878 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-5634a2a9-d043-4159-881b-e91fdf3a698d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:40.079179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5634a2a9-d043-4159-881b-e91fdf3a698d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:40.094993 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 448/893] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:40 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:40.112549 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b10ee3-d154-4cdf-98cc-4fb8e82e144c None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:40.128180 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b10ee3-d154-4cdf-98cc-4fb8e82e144c None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:40.133137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f961ee-7c5b-41e2-b476-7174ab03bbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:40.134101 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f961ee-7c5b-41e2-b476-7174ab03bbb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:40.134565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f961ee-7c5b-41e2-b476-7174ab03bbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:40.135056 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f961ee-7c5b-41e2-b476-7174ab03bbb9 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:40.136012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f961ee-7c5b-41e2-b476-7174ab03bbb9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:40.137869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f961ee-7c5b-41e2-b476-7174ab03bbb9 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:40.159001 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 446/894] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Dec 15 13:19:40 2021] POST /identity/v3/services => generated 251 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:41.077861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b92403-4707-46de-8358-41cc3712c695 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.078598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b92403-4707-46de-8358-41cc3712c695 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.078598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b92403-4707-46de-8358-41cc3712c695 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.080538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 449/895] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:41.086430 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab145364-0b43-4e20-94dc-63f02d789ea1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.086990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab145364-0b43-4e20-94dc-63f02d789ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.087146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab145364-0b43-4e20-94dc-63f02d789ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.104979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ab145364-0b43-4e20-94dc-63f02d789ea1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:41.106159 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ab145364-0b43-4e20-94dc-63f02d789ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:41.130958 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 447/896] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:41 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:41.147982 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b92403-4707-46de-8358-41cc3712c695 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:41.160693 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b92403-4707-46de-8358-41cc3712c695 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:41.165113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687650d1-8fca-4527-b59f-83247514f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:41.165912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687650d1-8fca-4527-b59f-83247514f0ed admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.166194 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687650d1-8fca-4527-b59f-83247514f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.166471 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687650d1-8fca-4527-b59f-83247514f0ed admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.167198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687650d1-8fca-4527-b59f-83247514f0ed admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:41.168796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687650d1-8fca-4527-b59f-83247514f0ed admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:41.181141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-687650d1-8fca-4527-b59f-83247514f0ed admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 13:19:41.182609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 450/897] 10.222.0.60 () {56 vars in 1153 bytes} [Wed Dec 15 13:19:41 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:41.193239 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab145364-0b43-4e20-94dc-63f02d789ea1 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:41.198521 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab145364-0b43-4e20-94dc-63f02d789ea1 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:41.203314 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcb5f4-bf6a-4573-9234-6a0f598a90ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:41.203925 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcb5f4-bf6a-4573-9234-6a0f598a90ef admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.204207 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcb5f4-bf6a-4573-9234-6a0f598a90ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.204483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcb5f4-bf6a-4573-9234-6a0f598a90ef admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.205209 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcb5f4-bf6a-4573-9234-6a0f598a90ef admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:41.205516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcb5f4-bf6a-4573-9234-6a0f598a90ef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:41.207164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcb5f4-bf6a-4573-9234-6a0f598a90ef admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:41.217048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 448/898] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Dec 15 13:19:41 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:41.218982 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687650d1-8fca-4527-b59f-83247514f0ed admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:41.229390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687650d1-8fca-4527-b59f-83247514f0ed admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:41.234143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564482f-3b90-4336-a278-879dca6d181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:41.235375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564482f-3b90-4336-a278-879dca6d181d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.235656 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564482f-3b90-4336-a278-879dca6d181d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.235980 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564482f-3b90-4336-a278-879dca6d181d admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.236713 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564482f-3b90-4336-a278-879dca6d181d admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:41.237020 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564482f-3b90-4336-a278-879dca6d181d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:41.238616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564482f-3b90-4336-a278-879dca6d181d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:41.244118 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 451/899] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Dec 15 13:19:41 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:41.250924 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcb5f4-bf6a-4573-9234-6a0f598a90ef admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:41.260835 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcb5f4-bf6a-4573-9234-6a0f598a90ef admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:41.265311 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5bd3e-ece9-45a4-b746-5fa761b6765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:41.266000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5bd3e-ece9-45a4-b746-5fa761b6765e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.266279 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5bd3e-ece9-45a4-b746-5fa761b6765e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.266556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5bd3e-ece9-45a4-b746-5fa761b6765e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.267411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5bd3e-ece9-45a4-b746-5fa761b6765e admin admin] RBAC: Adding query filter params (interface=public, service_id=322743a8c7834101b09fe2f025a8b096, region_id=RegionOne) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:41.267729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5bd3e-ece9-45a4-b746-5fa761b6765e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:41.269371 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5bd3e-ece9-45a4-b746-5fa761b6765e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:41.277918 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 449/900] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Dec 15 13:19:41 2021] GET /identity/v3/endpoints?service_id=322743a8c7834101b09fe2f025a8b096&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:41.285874 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564482f-3b90-4336-a278-879dca6d181d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:41.296446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564482f-3b90-4336-a278-879dca6d181d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:41.307969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab3441-244c-44d9-b464-66e62bd143a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:41.308660 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab3441-244c-44d9-b464-66e62bd143a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.308992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab3441-244c-44d9-b464-66e62bd143a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.309274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab3441-244c-44d9-b464-66e62bd143a7 admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.310032 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab3441-244c-44d9-b464-66e62bd143a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:41.311739 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab3441-244c-44d9-b464-66e62bd143a7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:41.319668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 452/901] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Dec 15 13:19:41 2021] GET /identity/v3/services => generated 1268 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:19:41.692824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e780721-cf6b-49ae-81cc-250a4aa63881 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.693116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e780721-cf6b-49ae-81cc-250a4aa63881 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.693398 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e780721-cf6b-49ae-81cc-250a4aa63881 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.695462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 450/902] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:41.701298 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573679-b0cf-46ad-800c-651f4879794c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.701591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573679-b0cf-46ad-800c-651f4879794c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.701872 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573679-b0cf-46ad-800c-651f4879794c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.721336 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-9e573679-b0cf-46ad-800c-651f4879794c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:41.722518 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9e573679-b0cf-46ad-800c-651f4879794c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:41.734949 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 453/903] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:41 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:41.753675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e780721-cf6b-49ae-81cc-250a4aa63881 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:41.766405 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e780721-cf6b-49ae-81cc-250a4aa63881 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:41.770722 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde2079-4f34-4cf0-9ee6-209479bb6a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:41.771541 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde2079-4f34-4cf0-9ee6-209479bb6a9c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.771822 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde2079-4f34-4cf0-9ee6-209479bb6a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.772098 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde2079-4f34-4cf0-9ee6-209479bb6a9c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.783359 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde2079-4f34-4cf0-9ee6-209479bb6a9c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:41.790633 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-0bde2079-4f34-4cf0-9ee6-209479bb6a9c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 13:19:41.797336 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 451/904] 10.222.0.60 () {56 vars in 1141 bytes} [Wed Dec 15 13:19:41 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:41.798636 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573679-b0cf-46ad-800c-651f4879794c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:41.807628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573679-b0cf-46ad-800c-651f4879794c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:41.812076 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690384c3-78f5-4bc3-867d-58aa9a568149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:41.812760 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690384c3-78f5-4bc3-867d-58aa9a568149 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.813041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690384c3-78f5-4bc3-867d-58aa9a568149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.813318 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690384c3-78f5-4bc3-867d-58aa9a568149 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.814086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690384c3-78f5-4bc3-867d-58aa9a568149 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:41.814393 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690384c3-78f5-4bc3-867d-58aa9a568149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:41.815996 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690384c3-78f5-4bc3-867d-58aa9a568149 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:41.829541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 454/905] 10.222.0.60 () {56 vars in 1136 bytes} [Wed Dec 15 13:19:41 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:41.830871 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde2079-4f34-4cf0-9ee6-209479bb6a9c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:41.843190 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde2079-4f34-4cf0-9ee6-209479bb6a9c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:41.848295 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a0306-f54e-4235-9241-cba017de00d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:41.849067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0306-f54e-4235-9241-cba017de00d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.849353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0306-f54e-4235-9241-cba017de00d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.849628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0306-f54e-4235-9241-cba017de00d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.860350 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a0306-f54e-4235-9241-cba017de00d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:41.862183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a0306-f54e-4235-9241-cba017de00d9 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:41.879311 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-2a6a0306-f54e-4235-9241-cba017de00d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:41.885548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 452/906] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:41.886905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690384c3-78f5-4bc3-867d-58aa9a568149 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:41.896992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690384c3-78f5-4bc3-867d-58aa9a568149 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:41.901459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf21c4-2e5a-4dfa-8a86-1344e52af1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:41.902107 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf21c4-2e5a-4dfa-8a86-1344e52af1fe admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.902390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf21c4-2e5a-4dfa-8a86-1344e52af1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.902666 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf21c4-2e5a-4dfa-8a86-1344e52af1fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.903579 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf21c4-2e5a-4dfa-8a86-1344e52af1fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:41.903892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf21c4-2e5a-4dfa-8a86-1344e52af1fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:41.905480 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf21c4-2e5a-4dfa-8a86-1344e52af1fe admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:41.918939 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 455/907] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:41.924456 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a0306-f54e-4235-9241-cba017de00d9 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:41.934100 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a0306-f54e-4235-9241-cba017de00d9 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:41.938696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e4e1d-29e3-4436-8475-fd01a92aa6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:41.939510 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e4e1d-29e3-4436-8475-fd01a92aa6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.939793 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e4e1d-29e3-4436-8475-fd01a92aa6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.940074 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e4e1d-29e3-4436-8475-fd01a92aa6d1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.948150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e4e1d-29e3-4436-8475-fd01a92aa6d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:41.950109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e4e1d-29e3-4436-8475-fd01a92aa6d1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:41.964514 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-005e4e1d-29e3-4436-8475-fd01a92aa6d1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 13:19:41.970949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 453/908] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Dec 15 13:19:41 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:41.972718 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf21c4-2e5a-4dfa-8a86-1344e52af1fe admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:41.982930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf21c4-2e5a-4dfa-8a86-1344e52af1fe admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:41.988219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a87222-83ab-4838-97be-1c0f7dd89cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:41.988926 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a87222-83ab-4838-97be-1c0f7dd89cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:41.989207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a87222-83ab-4838-97be-1c0f7dd89cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:41.989533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a87222-83ab-4838-97be-1c0f7dd89cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:41.990396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a87222-83ab-4838-97be-1c0f7dd89cb9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:41.990758 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a87222-83ab-4838-97be-1c0f7dd89cb9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:41.992687 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a87222-83ab-4838-97be-1c0f7dd89cb9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:42.011861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 456/909] 10.222.0.60 () {56 vars in 1170 bytes} [Wed Dec 15 13:19:41 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:42.020319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e4e1d-29e3-4436-8475-fd01a92aa6d1 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:42.030304 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e4e1d-29e3-4436-8475-fd01a92aa6d1 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:42.035498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6413c-dda6-46de-b980-555dbd150b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:42.036369 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6413c-dda6-46de-b980-555dbd150b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.036701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6413c-dda6-46de-b980-555dbd150b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.036984 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6413c-dda6-46de-b980-555dbd150b54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.049521 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6413c-dda6-46de-b980-555dbd150b54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:42.051497 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6413c-dda6-46de-b980-555dbd150b54 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:42.068569 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-b4d6413c-dda6-46de-b980-555dbd150b54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:42.074193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 454/910] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:42.076991 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a87222-83ab-4838-97be-1c0f7dd89cb9 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:42.087528 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a87222-83ab-4838-97be-1c0f7dd89cb9 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:42.092323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec560c-51be-49a5-9063-218680ecc9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:42.093058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec560c-51be-49a5-9063-218680ecc9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.093343 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec560c-51be-49a5-9063-218680ecc9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.094209 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec560c-51be-49a5-9063-218680ecc9b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.095001 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec560c-51be-49a5-9063-218680ecc9b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:42.095369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec560c-51be-49a5-9063-218680ecc9b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:42.097057 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec560c-51be-49a5-9063-218680ecc9b4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:42.114980 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 457/911] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:42.116942 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6413c-dda6-46de-b980-555dbd150b54 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:42.127476 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6413c-dda6-46de-b980-555dbd150b54 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:42.132326 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bde10-0170-44c7-a98e-acc0fa65ff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:42.133159 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bde10-0170-44c7-a98e-acc0fa65ff44 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.133440 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bde10-0170-44c7-a98e-acc0fa65ff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.133720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bde10-0170-44c7-a98e-acc0fa65ff44 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.141246 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bde10-0170-44c7-a98e-acc0fa65ff44 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:42.143304 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bde10-0170-44c7-a98e-acc0fa65ff44 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:42.157809 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-c98bde10-0170-44c7-a98e-acc0fa65ff44 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:42.162966 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 455/912] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:42.165632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec560c-51be-49a5-9063-218680ecc9b4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:42.177225 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec560c-51be-49a5-9063-218680ecc9b4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:42.182173 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9dc1d-9eb1-4902-b3de-3666a8c24c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:42.182880 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9dc1d-9eb1-4902-b3de-3666a8c24c53 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.183215 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9dc1d-9eb1-4902-b3de-3666a8c24c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.183494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9dc1d-9eb1-4902-b3de-3666a8c24c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.184398 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9dc1d-9eb1-4902-b3de-3666a8c24c53 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:42.184708 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9dc1d-9eb1-4902-b3de-3666a8c24c53 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:42.186723 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9dc1d-9eb1-4902-b3de-3666a8c24c53 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:42.207109 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 458/913] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:42.210687 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bde10-0170-44c7-a98e-acc0fa65ff44 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:42.221866 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bde10-0170-44c7-a98e-acc0fa65ff44 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:42.226588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7975522-931c-4e9d-9749-1efb9ec5d92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:42.227562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975522-931c-4e9d-9749-1efb9ec5d92b admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.227891 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975522-931c-4e9d-9749-1efb9ec5d92b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.228171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975522-931c-4e9d-9749-1efb9ec5d92b admin admin] PATH_INFO: `/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/77744968b6b14415b5b85423db1cfd25/roles/e8150335a9c84b6f85ed54a683b549bb` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.230504 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7975522-931c-4e9d-9749-1efb9ec5d92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f200887ca764a72b0640476fe3eb41b, user_id=77744968b6b14415b5b85423db1cfd25, role_id=e8150335a9c84b6f85ed54a683b549bb)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:42.233236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7975522-931c-4e9d-9749-1efb9ec5d92b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:42.255041 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 456/914] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:19:42 2021] PUT /identity/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/77744968b6b14415b5b85423db1cfd25/roles/e8150335a9c84b6f85ed54a683b549bb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:19:42.505409 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0e85c-3d4a-4e9f-8cbf-34a9675ae4ae None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.505782 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0e85c-3d4a-4e9f-8cbf-34a9675ae4ae None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.505979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0e85c-3d4a-4e9f-8cbf-34a9675ae4ae None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.508286 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 459/915] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:42.514172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34468cc-d0be-49ce-8177-c32120625ed8 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.514772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34468cc-d0be-49ce-8177-c32120625ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.515807 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34468cc-d0be-49ce-8177-c32120625ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.535599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-b34468cc-d0be-49ce-8177-c32120625ed8 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:42.537143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b34468cc-d0be-49ce-8177-c32120625ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:42.598600 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e886fbe-113f-4c79-8208-8299aa82a7e9 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.598811 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e886fbe-113f-4c79-8208-8299aa82a7e9 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.598973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 457/916] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:42 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:42.599248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e886fbe-113f-4c79-8208-8299aa82a7e9 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.601727 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 460/917] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:42.610134 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb78d87-67ac-4163-b7dc-2d228c892939 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.610657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb78d87-67ac-4163-b7dc-2d228c892939 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.611137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb78d87-67ac-4163-b7dc-2d228c892939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.626135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e886fbe-113f-4c79-8208-8299aa82a7e9 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:42.630493 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ebb78d87-67ac-4163-b7dc-2d228c892939 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:42.631768 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ebb78d87-67ac-4163-b7dc-2d228c892939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:42.639213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e886fbe-113f-4c79-8208-8299aa82a7e9 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:42.640367 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 458/918] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:42 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:42.645294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d5c28-19e7-40a5-9207-b51b01185596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:42.646308 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d5c28-19e7-40a5-9207-b51b01185596 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.646788 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d5c28-19e7-40a5-9207-b51b01185596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.647313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d5c28-19e7-40a5-9207-b51b01185596 admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.648291 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d5c28-19e7-40a5-9207-b51b01185596 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:42.650113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d5c28-19e7-40a5-9207-b51b01185596 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:42.666411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb78d87-67ac-4163-b7dc-2d228c892939 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:42.671897 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 461/919] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Dec 15 13:19:42 2021] POST /identity/v3/services => generated 241 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:19:42.677475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb78d87-67ac-4163-b7dc-2d228c892939 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:42.693321 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081a19e-2da7-40f7-85a7-4267093e36df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:42.698877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081a19e-2da7-40f7-85a7-4267093e36df admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.698877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081a19e-2da7-40f7-85a7-4267093e36df admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.698877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081a19e-2da7-40f7-85a7-4267093e36df admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.698877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081a19e-2da7-40f7-85a7-4267093e36df admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:42.698877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081a19e-2da7-40f7-85a7-4267093e36df admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:42.709364 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-4081a19e-2da7-40f7-85a7-4267093e36df admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 13:19:42.711046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 459/920] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:19:42 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:42.722408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d5c28-19e7-40a5-9207-b51b01185596 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:42.734072 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d5c28-19e7-40a5-9207-b51b01185596 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:42.739010 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0352e34-9c4b-4a84-be5d-50f4d6a0300e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:42.739804 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0352e34-9c4b-4a84-be5d-50f4d6a0300e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.740085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0352e34-9c4b-4a84-be5d-50f4d6a0300e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.740364 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0352e34-9c4b-4a84-be5d-50f4d6a0300e admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.741219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0352e34-9c4b-4a84-be5d-50f4d6a0300e admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:42.741531 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0352e34-9c4b-4a84-be5d-50f4d6a0300e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:42.743322 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0352e34-9c4b-4a84-be5d-50f4d6a0300e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:42.754510 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 462/921] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:19:42 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:42.756081 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081a19e-2da7-40f7-85a7-4267093e36df admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:42.767433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081a19e-2da7-40f7-85a7-4267093e36df admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:42.772299 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8111bc-1a10-497a-8d19-01048fe8831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:42.773024 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8111bc-1a10-497a-8d19-01048fe8831e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.773359 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8111bc-1a10-497a-8d19-01048fe8831e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.773643 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8111bc-1a10-497a-8d19-01048fe8831e admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.774435 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8111bc-1a10-497a-8d19-01048fe8831e admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:42.774807 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8111bc-1a10-497a-8d19-01048fe8831e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:42.776699 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8111bc-1a10-497a-8d19-01048fe8831e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:42.788615 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 460/922] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:19:42 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:42.790046 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0352e34-9c4b-4a84-be5d-50f4d6a0300e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:42.800981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0352e34-9c4b-4a84-be5d-50f4d6a0300e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:42.805711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403c2ba-7c7f-4dd2-8025-b911663e0537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:42.806443 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403c2ba-7c7f-4dd2-8025-b911663e0537 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.806730 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403c2ba-7c7f-4dd2-8025-b911663e0537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.807115 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403c2ba-7c7f-4dd2-8025-b911663e0537 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.808089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403c2ba-7c7f-4dd2-8025-b911663e0537 admin admin] RBAC: Adding query filter params (interface=public, service_id=626e22cc82f84583b8828d99413d3702, region_id=RegionOne) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:42.808414 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403c2ba-7c7f-4dd2-8025-b911663e0537 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:42.810101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403c2ba-7c7f-4dd2-8025-b911663e0537 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:42.820728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 463/923] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Dec 15 13:19:42 2021] GET /identity/v3/endpoints?service_id=626e22cc82f84583b8828d99413d3702&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:42.823743 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8111bc-1a10-497a-8d19-01048fe8831e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:42.834705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8111bc-1a10-497a-8d19-01048fe8831e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:42.839880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2ab4e-7dbd-4fe5-b34c-9ef9e891513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:42.840613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2ab4e-7dbd-4fe5-b34c-9ef9e891513c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:42.840896 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2ab4e-7dbd-4fe5-b34c-9ef9e891513c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:42.841231 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2ab4e-7dbd-4fe5-b34c-9ef9e891513c admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:42.841949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2ab4e-7dbd-4fe5-b34c-9ef9e891513c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:42.843799 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2ab4e-7dbd-4fe5-b34c-9ef9e891513c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:42.855022 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 461/924] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Dec 15 13:19:42 2021] GET /identity/v3/services => generated 1497 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:19:43.829277 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6bfad-9e1b-4daf-b773-30507c30e9e5 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:43.829277 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6bfad-9e1b-4daf-b773-30507c30e9e5 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:43.829277 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6bfad-9e1b-4daf-b773-30507c30e9e5 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:43.831506 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 464/925] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:43.837442 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19889438-b25f-47a1-b6b4-40898e1182e7 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:43.837866 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19889438-b25f-47a1-b6b4-40898e1182e7 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:43.839304 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19889438-b25f-47a1-b6b4-40898e1182e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:43.865556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-19889438-b25f-47a1-b6b4-40898e1182e7 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:43.866752 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-19889438-b25f-47a1-b6b4-40898e1182e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:43.878305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 462/926] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:43 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:43.902184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6bfad-9e1b-4daf-b773-30507c30e9e5 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:43.933054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6bfad-9e1b-4daf-b773-30507c30e9e5 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:43.942921 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3bcc6-6290-45d5-9975-f9735b730447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:43.943982 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3bcc6-6290-45d5-9975-f9735b730447 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:43.944489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3bcc6-6290-45d5-9975-f9735b730447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:43.944960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3bcc6-6290-45d5-9975-f9735b730447 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:43.945829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3bcc6-6290-45d5-9975-f9735b730447 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:43.947669 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3bcc6-6290-45d5-9975-f9735b730447 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:43.976976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-bce3bcc6-6290-45d5-9975-f9735b730447 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 13:19:43.981499 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 465/927] 10.222.0.60 () {56 vars in 1153 bytes} [Wed Dec 15 13:19:43 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:43.992417 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19889438-b25f-47a1-b6b4-40898e1182e7 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:44.002555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19889438-b25f-47a1-b6b4-40898e1182e7 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:44.016912 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8258bdc-eeb2-404c-86d3-1307966b4ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:44.018021 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8258bdc-eeb2-404c-86d3-1307966b4ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:44.020005 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8258bdc-eeb2-404c-86d3-1307966b4ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:44.020544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8258bdc-eeb2-404c-86d3-1307966b4ec7 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:44.021475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8258bdc-eeb2-404c-86d3-1307966b4ec7 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:44.022156 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8258bdc-eeb2-404c-86d3-1307966b4ec7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:44.024086 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8258bdc-eeb2-404c-86d3-1307966b4ec7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:44.036048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 463/928] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Dec 15 13:19:43 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:44.040689 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3bcc6-6290-45d5-9975-f9735b730447 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:44.052034 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3bcc6-6290-45d5-9975-f9735b730447 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:44.065745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bbca2-7736-4ab5-8d8c-d074931246e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:44.066642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bbca2-7736-4ab5-8d8c-d074931246e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:44.067663 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bbca2-7736-4ab5-8d8c-d074931246e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:44.069814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bbca2-7736-4ab5-8d8c-d074931246e8 admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:44.070731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bbca2-7736-4ab5-8d8c-d074931246e8 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:44.071215 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bbca2-7736-4ab5-8d8c-d074931246e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:44.075133 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bbca2-7736-4ab5-8d8c-d074931246e8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:44.091632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 466/929] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Dec 15 13:19:44 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:44.096131 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8258bdc-eeb2-404c-86d3-1307966b4ec7 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:44.111537 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8258bdc-eeb2-404c-86d3-1307966b4ec7 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:44.116555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47283238-4400-45dc-8032-137de971da87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:44.117490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283238-4400-45dc-8032-137de971da87 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:44.117964 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283238-4400-45dc-8032-137de971da87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:44.118386 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283238-4400-45dc-8032-137de971da87 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:44.119386 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47283238-4400-45dc-8032-137de971da87 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:44.121134 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47283238-4400-45dc-8032-137de971da87 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:44.143614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 464/930] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Dec 15 13:19:44 2021] POST /identity/v3/endpoints => generated 347 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:44.750024 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5a8b0-edf7-410d-9dea-3dcdbd3dab87 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:44.750381 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5a8b0-edf7-410d-9dea-3dcdbd3dab87 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:44.750630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5a8b0-edf7-410d-9dea-3dcdbd3dab87 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:44.752831 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 467/931] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:44.758349 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda28d82-4ec5-449d-9b62-4acdc1cb8a26 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:44.758639 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda28d82-4ec5-449d-9b62-4acdc1cb8a26 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:44.758951 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda28d82-4ec5-449d-9b62-4acdc1cb8a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:44.777250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-dda28d82-4ec5-449d-9b62-4acdc1cb8a26 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:44.778433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-dda28d82-4ec5-449d-9b62-4acdc1cb8a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:44.796601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 465/932] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:44 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:44.820560 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5a8b0-edf7-410d-9dea-3dcdbd3dab87 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:44.833673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5a8b0-edf7-410d-9dea-3dcdbd3dab87 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:44.838270 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd778923-5b66-41b9-9043-3a2b34007dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:44.839133 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd778923-5b66-41b9-9043-3a2b34007dac admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:44.839412 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd778923-5b66-41b9-9043-3a2b34007dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:44.839687 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd778923-5b66-41b9-9043-3a2b34007dac admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:44.853655 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd778923-5b66-41b9-9043-3a2b34007dac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:44.861176 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-dd778923-5b66-41b9-9043-3a2b34007dac admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 13:19:44.862740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 468/933] 10.222.0.60 () {56 vars in 1141 bytes} [Wed Dec 15 13:19:44 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:44.869170 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda28d82-4ec5-449d-9b62-4acdc1cb8a26 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:44.878475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda28d82-4ec5-449d-9b62-4acdc1cb8a26 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:44.883134 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bcd08-75f1-458a-9416-f341f9f9d1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:44.883801 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bcd08-75f1-458a-9416-f341f9f9d1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:44.884138 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bcd08-75f1-458a-9416-f341f9f9d1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:44.884351 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bcd08-75f1-458a-9416-f341f9f9d1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:44.885193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bcd08-75f1-458a-9416-f341f9f9d1d0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:44.885540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bcd08-75f1-458a-9416-f341f9f9d1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:44.887280 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bcd08-75f1-458a-9416-f341f9f9d1d0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:44.897048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 466/934] 10.222.0.60 () {56 vars in 1136 bytes} [Wed Dec 15 13:19:44 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:44.902765 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd778923-5b66-41b9-9043-3a2b34007dac admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:44.913182 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd778923-5b66-41b9-9043-3a2b34007dac admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:44.917687 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d31419-d830-4f2e-81e0-a80a047c5f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:44.918455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31419-d830-4f2e-81e0-a80a047c5f36 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:44.919025 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31419-d830-4f2e-81e0-a80a047c5f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:44.919295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31419-d830-4f2e-81e0-a80a047c5f36 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:44.930030 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d31419-d830-4f2e-81e0-a80a047c5f36 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:44.931891 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d31419-d830-4f2e-81e0-a80a047c5f36 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:44.950115 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-e8d31419-d830-4f2e-81e0-a80a047c5f36 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:44.952031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 469/935] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:44.958962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bcd08-75f1-458a-9416-f341f9f9d1d0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:44.970012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bcd08-75f1-458a-9416-f341f9f9d1d0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:44.974888 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0458d-94a9-43fa-8a5f-60ff1b091d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:44.975612 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0458d-94a9-43fa-8a5f-60ff1b091d7e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:44.975893 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0458d-94a9-43fa-8a5f-60ff1b091d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:44.976167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0458d-94a9-43fa-8a5f-60ff1b091d7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:44.976979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0458d-94a9-43fa-8a5f-60ff1b091d7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:44.977285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0458d-94a9-43fa-8a5f-60ff1b091d7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:44.979067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0458d-94a9-43fa-8a5f-60ff1b091d7e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:44.992461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 467/936] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:44.998381 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d31419-d830-4f2e-81e0-a80a047c5f36 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.008316 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d31419-d830-4f2e-81e0-a80a047c5f36 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.013038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46973f0-cba7-491f-bb63-e213b5e13741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.013829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46973f0-cba7-491f-bb63-e213b5e13741 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.014159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46973f0-cba7-491f-bb63-e213b5e13741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.014434 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46973f0-cba7-491f-bb63-e213b5e13741 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.022645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46973f0-cba7-491f-bb63-e213b5e13741 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.024741 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46973f0-cba7-491f-bb63-e213b5e13741 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.039875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-a46973f0-cba7-491f-bb63-e213b5e13741 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 13:19:45.041378 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 470/937] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Dec 15 13:19:44 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:45.047779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0458d-94a9-43fa-8a5f-60ff1b091d7e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.057756 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0458d-94a9-43fa-8a5f-60ff1b091d7e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.063060 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a324647-c1be-4588-9b59-72fc815765a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.063782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a324647-c1be-4588-9b59-72fc815765a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.064059 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a324647-c1be-4588-9b59-72fc815765a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.064333 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a324647-c1be-4588-9b59-72fc815765a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.065231 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a324647-c1be-4588-9b59-72fc815765a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:45.065532 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a324647-c1be-4588-9b59-72fc815765a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.068045 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a324647-c1be-4588-9b59-72fc815765a9 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.086885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 468/938] 10.222.0.60 () {56 vars in 1170 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:45.093067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46973f0-cba7-491f-bb63-e213b5e13741 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.102930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46973f0-cba7-491f-bb63-e213b5e13741 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.107486 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442a85c-7f95-4f8d-ac2c-6ee0d63228d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.108164 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442a85c-7f95-4f8d-ac2c-6ee0d63228d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.108441 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442a85c-7f95-4f8d-ac2c-6ee0d63228d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.108742 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442a85c-7f95-4f8d-ac2c-6ee0d63228d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.117123 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442a85c-7f95-4f8d-ac2c-6ee0d63228d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.118875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442a85c-7f95-4f8d-ac2c-6ee0d63228d0 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.129231 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 471/939] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:19:45.134876 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a324647-c1be-4588-9b59-72fc815765a9 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.145300 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a324647-c1be-4588-9b59-72fc815765a9 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.150040 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee122b-1ec2-4141-9277-526afc2efe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.150885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee122b-1ec2-4141-9277-526afc2efe46 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.151175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee122b-1ec2-4141-9277-526afc2efe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.151500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee122b-1ec2-4141-9277-526afc2efe46 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.162397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee122b-1ec2-4141-9277-526afc2efe46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.164325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee122b-1ec2-4141-9277-526afc2efe46 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.181234 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-1dee122b-1ec2-4141-9277-526afc2efe46 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:45.182683 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 469/940] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:45.189217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442a85c-7f95-4f8d-ac2c-6ee0d63228d0 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.197994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442a85c-7f95-4f8d-ac2c-6ee0d63228d0 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.203241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d1d03-0ca5-4bc5-86df-dc8db0aed882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.203887 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d1d03-0ca5-4bc5-86df-dc8db0aed882 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.204163 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d1d03-0ca5-4bc5-86df-dc8db0aed882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.204439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d1d03-0ca5-4bc5-86df-dc8db0aed882 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.205265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d1d03-0ca5-4bc5-86df-dc8db0aed882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:45.205576 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d1d03-0ca5-4bc5-86df-dc8db0aed882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.207176 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d1d03-0ca5-4bc5-86df-dc8db0aed882 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.219178 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 472/941] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:45.225179 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee122b-1ec2-4141-9277-526afc2efe46 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.235152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee122b-1ec2-4141-9277-526afc2efe46 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.239798 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50eb192-8f2c-4004-8bdf-8c756e044a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.240618 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eb192-8f2c-4004-8bdf-8c756e044a6e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.240895 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eb192-8f2c-4004-8bdf-8c756e044a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.241165 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eb192-8f2c-4004-8bdf-8c756e044a6e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.248603 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50eb192-8f2c-4004-8bdf-8c756e044a6e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.251253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50eb192-8f2c-4004-8bdf-8c756e044a6e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.264416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-b50eb192-8f2c-4004-8bdf-8c756e044a6e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:45.266510 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 470/942] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:45.272736 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d1d03-0ca5-4bc5-86df-dc8db0aed882 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.283436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fe157-dfa2-4a48-aaf1-63ff01a6c814 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.283436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fe157-dfa2-4a48-aaf1-63ff01a6c814 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.283436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fe157-dfa2-4a48-aaf1-63ff01a6c814 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.283762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d1d03-0ca5-4bc5-86df-dc8db0aed882 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.283861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 471/943] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:45.289952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b757748-0fc8-4fa4-be00-4e0359730e32 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.290525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b757748-0fc8-4fa4-be00-4e0359730e32 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.290525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b757748-0fc8-4fa4-be00-4e0359730e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.298588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f746a7-e739-44da-90c1-2f56c4323946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.298588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f746a7-e739-44da-90c1-2f56c4323946 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.298588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f746a7-e739-44da-90c1-2f56c4323946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.298588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f746a7-e739-44da-90c1-2f56c4323946 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.299337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f746a7-e739-44da-90c1-2f56c4323946 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:45.299337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f746a7-e739-44da-90c1-2f56c4323946 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.299337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f746a7-e739-44da-90c1-2f56c4323946 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.310315 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-7b757748-0fc8-4fa4-be00-4e0359730e32 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:45.311391 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 473/944] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:45.317688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-7b757748-0fc8-4fa4-be00-4e0359730e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:45.318859 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f746a7-e739-44da-90c1-2f56c4323946 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.322494 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 472/945] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:45 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:19:45.329973 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f746a7-e739-44da-90c1-2f56c4323946 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.334984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee94b1a-9046-44c4-8e53-24d964ff1fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.335941 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee94b1a-9046-44c4-8e53-24d964ff1fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.336440 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee94b1a-9046-44c4-8e53-24d964ff1fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.336983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee94b1a-9046-44c4-8e53-24d964ff1fdb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.338066 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee94b1a-9046-44c4-8e53-24d964ff1fdb admin admin] RBAC: Adding query filter params (role.id=e8150335a9c84b6f85ed54a683b549bb, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=77744968b6b14415b5b85423db1cfd25) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:45.338575 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee94b1a-9046-44c4-8e53-24d964ff1fdb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.340715 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee94b1a-9046-44c4-8e53-24d964ff1fdb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.347494 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b757748-0fc8-4fa4-be00-4e0359730e32 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.347918 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 474/946] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/role_assignments?user.id=77744968b6b14415b5b85423db1cfd25&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=e8150335a9c84b6f85ed54a683b549bb => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:45.356842 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b757748-0fc8-4fa4-be00-4e0359730e32 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.361808 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febae46-813f-429c-b7a2-799212f175c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.362657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febae46-813f-429c-b7a2-799212f175c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.362978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febae46-813f-429c-b7a2-799212f175c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.363257 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febae46-813f-429c-b7a2-799212f175c7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.363960 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febae46-813f-429c-b7a2-799212f175c7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.365692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febae46-813f-429c-b7a2-799212f175c7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.378579 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-1febae46-813f-429c-b7a2-799212f175c7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 13:19:45.380210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 473/947] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:45.385020 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2479b-5109-4bc2-a135-500c0a3deed3 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.385618 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2479b-5109-4bc2-a135-500c0a3deed3 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.385995 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2479b-5109-4bc2-a135-500c0a3deed3 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.386936 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febae46-813f-429c-b7a2-799212f175c7 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.388360 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 475/948] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:45.394984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea77ed-a9e3-4efd-83e8-c036391df9fb None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.395269 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea77ed-a9e3-4efd-83e8-c036391df9fb None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.395543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea77ed-a9e3-4efd-83e8-c036391df9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.398921 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febae46-813f-429c-b7a2-799212f175c7 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.403981 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d13cda-ea68-4e4b-9637-1f82617c689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.404644 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d13cda-ea68-4e4b-9637-1f82617c689d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.404925 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d13cda-ea68-4e4b-9637-1f82617c689d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.405202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d13cda-ea68-4e4b-9637-1f82617c689d admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.405980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d13cda-ea68-4e4b-9637-1f82617c689d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:45.406288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d13cda-ea68-4e4b-9637-1f82617c689d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.407923 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d13cda-ea68-4e4b-9637-1f82617c689d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.413723 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 474/949] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:45.420430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-33ea77ed-a9e3-4efd-83e8-c036391df9fb None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:45.422203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d13cda-ea68-4e4b-9637-1f82617c689d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.422321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-33ea77ed-a9e3-4efd-83e8-c036391df9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:45.434895 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 476/950] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:45 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:19:45.437636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d13cda-ea68-4e4b-9637-1f82617c689d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.442473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4495ad-8dc5-41e5-badf-9d3c9bf144e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.443207 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4495ad-8dc5-41e5-badf-9d3c9bf144e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.443487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4495ad-8dc5-41e5-badf-9d3c9bf144e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.443765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4495ad-8dc5-41e5-badf-9d3c9bf144e0 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.444600 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4495ad-8dc5-41e5-badf-9d3c9bf144e0 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:45.444906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4495ad-8dc5-41e5-badf-9d3c9bf144e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.446584 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4495ad-8dc5-41e5-badf-9d3c9bf144e0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.453031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 475/951] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:45.459484 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea77ed-a9e3-4efd-83e8-c036391df9fb None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.459755 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4495ad-8dc5-41e5-badf-9d3c9bf144e0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.469725 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea77ed-a9e3-4efd-83e8-c036391df9fb None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.469926 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4495ad-8dc5-41e5-badf-9d3c9bf144e0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.474564 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c004d8-2fe2-4a7a-b105-74f5d9159983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.475333 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a294bfa-aeca-4b07-afdf-dc1c8a27c13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.475640 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c004d8-2fe2-4a7a-b105-74f5d9159983 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.476076 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c004d8-2fe2-4a7a-b105-74f5d9159983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.476333 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a294bfa-aeca-4b07-afdf-dc1c8a27c13e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.476656 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c004d8-2fe2-4a7a-b105-74f5d9159983 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.476763 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a294bfa-aeca-4b07-afdf-dc1c8a27c13e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.477294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a294bfa-aeca-4b07-afdf-dc1c8a27c13e admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.477849 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c004d8-2fe2-4a7a-b105-74f5d9159983 admin admin] RBAC: Adding query filter params (interface=public, service_id=b7c2e60daa594ec1b4734932d4fd8619, region_id=RegionOne) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:45.478159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a294bfa-aeca-4b07-afdf-dc1c8a27c13e admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.478463 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c004d8-2fe2-4a7a-b105-74f5d9159983 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.480089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a294bfa-aeca-4b07-afdf-dc1c8a27c13e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.480404 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c004d8-2fe2-4a7a-b105-74f5d9159983 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.492725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 476/952] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/endpoints?service_id=b7c2e60daa594ec1b4734932d4fd8619&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:45.494477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c004d8-2fe2-4a7a-b105-74f5d9159983 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.497877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-5a294bfa-aeca-4b07-afdf-dc1c8a27c13e admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 13:19:45.505336 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 477/953] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:45.506321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a294bfa-aeca-4b07-afdf-dc1c8a27c13e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.506579 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c004d8-2fe2-4a7a-b105-74f5d9159983 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.511518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccd9cd-6e29-424d-a863-292f679900c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.512506 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccd9cd-6e29-424d-a863-292f679900c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.513014 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccd9cd-6e29-424d-a863-292f679900c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.513490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccd9cd-6e29-424d-a863-292f679900c8 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.514397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccd9cd-6e29-424d-a863-292f679900c8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.516399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccd9cd-6e29-424d-a863-292f679900c8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.517864 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a294bfa-aeca-4b07-afdf-dc1c8a27c13e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.523074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe69369-4689-4b56-b422-26cc77725a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.523798 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe69369-4689-4b56-b422-26cc77725a52 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.524190 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe69369-4689-4b56-b422-26cc77725a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.524378 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe69369-4689-4b56-b422-26cc77725a52 admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.530875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe69369-4689-4b56-b422-26cc77725a52 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:45.530875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe69369-4689-4b56-b422-26cc77725a52 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.530875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe69369-4689-4b56-b422-26cc77725a52 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.531447 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 477/954] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/services => generated 1497 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:19:45.533411 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 478/955] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:45.539831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccd9cd-6e29-424d-a863-292f679900c8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.551752 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccd9cd-6e29-424d-a863-292f679900c8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.556762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612aa8a-2798-40b7-b81b-bcbed27c807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.557486 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612aa8a-2798-40b7-b81b-bcbed27c807b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.557765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612aa8a-2798-40b7-b81b-bcbed27c807b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.558038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612aa8a-2798-40b7-b81b-bcbed27c807b admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.558833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612aa8a-2798-40b7-b81b-bcbed27c807b admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:45.559165 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612aa8a-2798-40b7-b81b-bcbed27c807b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.560911 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612aa8a-2798-40b7-b81b-bcbed27c807b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.567860 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 478/956] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Dec 15 13:19:45 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:45.574569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe69369-4689-4b56-b422-26cc77725a52 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:45.585677 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe69369-4689-4b56-b422-26cc77725a52 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:45.590545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6b66c-26e2-4e24-80bb-afe4587b61fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:45.591359 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6b66c-26e2-4e24-80bb-afe4587b61fe admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:45.591643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6b66c-26e2-4e24-80bb-afe4587b61fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:45.591928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6b66c-26e2-4e24-80bb-afe4587b61fe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:45.592766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6b66c-26e2-4e24-80bb-afe4587b61fe admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:45.594727 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6b66c-26e2-4e24-80bb-afe4587b61fe admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:45.617995 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 479/957] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Dec 15 13:19:45 2021] POST /identity/v3/endpoints => generated 346 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:46.631756 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834303ed-cfa9-4654-9277-1066f92f4a42 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:46.632269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834303ed-cfa9-4654-9277-1066f92f4a42 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:46.632374 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834303ed-cfa9-4654-9277-1066f92f4a42 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:46.634339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 479/958] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:46.640728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d655-4781-456a-8bc6-25307d7f2727 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:46.641152 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d655-4781-456a-8bc6-25307d7f2727 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:46.641350 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d655-4781-456a-8bc6-25307d7f2727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:46.664521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-3286d655-4781-456a-8bc6-25307d7f2727 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:46.665707 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3286d655-4781-456a-8bc6-25307d7f2727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:46.682716 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 480/959] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:46 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:46.706814 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834303ed-cfa9-4654-9277-1066f92f4a42 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:46.719787 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834303ed-cfa9-4654-9277-1066f92f4a42 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:46.724382 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ea394-efaf-42b6-8ee2-e41e9b05b080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:46.725153 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ea394-efaf-42b6-8ee2-e41e9b05b080 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:46.725436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ea394-efaf-42b6-8ee2-e41e9b05b080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:46.725713 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ea394-efaf-42b6-8ee2-e41e9b05b080 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:46.726387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ea394-efaf-42b6-8ee2-e41e9b05b080 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:46.728007 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ea394-efaf-42b6-8ee2-e41e9b05b080 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:46.739258 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-fd4ea394-efaf-42b6-8ee2-e41e9b05b080 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 13:19:46.740715 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 480/960] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:46 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:46.747301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286d655-4781-456a-8bc6-25307d7f2727 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:46.756854 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286d655-4781-456a-8bc6-25307d7f2727 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:46.761482 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b02d4-ba81-4069-97c9-b599aa04c162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:46.762135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b02d4-ba81-4069-97c9-b599aa04c162 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:46.762412 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b02d4-ba81-4069-97c9-b599aa04c162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:46.762686 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b02d4-ba81-4069-97c9-b599aa04c162 admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:46.763453 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b02d4-ba81-4069-97c9-b599aa04c162 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:46.763759 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b02d4-ba81-4069-97c9-b599aa04c162 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:46.765917 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b02d4-ba81-4069-97c9-b599aa04c162 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:46.775253 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 481/961] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Dec 15 13:19:46 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:46.780988 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ea394-efaf-42b6-8ee2-e41e9b05b080 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:46.791598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ea394-efaf-42b6-8ee2-e41e9b05b080 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:46.796522 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2b1df-6a36-4b75-9d56-f969bcd4a180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:46.797164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2b1df-6a36-4b75-9d56-f969bcd4a180 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:46.797443 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2b1df-6a36-4b75-9d56-f969bcd4a180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:46.797717 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2b1df-6a36-4b75-9d56-f969bcd4a180 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:46.798438 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2b1df-6a36-4b75-9d56-f969bcd4a180 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:46.798741 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2b1df-6a36-4b75-9d56-f969bcd4a180 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:46.800359 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2b1df-6a36-4b75-9d56-f969bcd4a180 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:46.805506 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 481/962] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Dec 15 13:19:46 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:47.832807 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61e469-8920-4a62-b7ab-3ddcdb61193b None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:47.833802 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61e469-8920-4a62-b7ab-3ddcdb61193b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:47.834287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61e469-8920-4a62-b7ab-3ddcdb61193b None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:47.836552 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 482/963] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:47.842589 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0d279-b5a0-4862-a876-24b24dc9d6f1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:47.844023 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0d279-b5a0-4862-a876-24b24dc9d6f1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:47.844500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0d279-b5a0-4862-a876-24b24dc9d6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:47.862044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-3af0d279-b5a0-4862-a876-24b24dc9d6f1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:47.863556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-3af0d279-b5a0-4862-a876-24b24dc9d6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:47.871797 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 482/964] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:47 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:47.895426 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61e469-8920-4a62-b7ab-3ddcdb61193b None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:47.908601 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61e469-8920-4a62-b7ab-3ddcdb61193b None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:47.913310 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe63c91-8566-4d6f-b33e-8f4db4402aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:47.914313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe63c91-8566-4d6f-b33e-8f4db4402aae admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:47.914815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe63c91-8566-4d6f-b33e-8f4db4402aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:47.915314 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe63c91-8566-4d6f-b33e-8f4db4402aae admin admin] PATH_INFO: `/v3/services/image` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:47.916198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe63c91-8566-4d6f-b33e-8f4db4402aae admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:47.917971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe63c91-8566-4d6f-b33e-8f4db4402aae admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:47.924333 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff22c1-5e94-4756-b607-640d3f192bd0 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:47.925009 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff22c1-5e94-4756-b607-640d3f192bd0 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:47.925487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff22c1-5e94-4756-b607-640d3f192bd0 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:47.927740 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 483/965] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:47.938930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-dbe63c91-8566-4d6f-b33e-8f4db4402aae admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 13:19:47.939090 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c793-5052-4fe1-87d9-8c3072517e53 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:47.939090 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c793-5052-4fe1-87d9-8c3072517e53 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:47.939090 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c793-5052-4fe1-87d9-8c3072517e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:47.939285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 483/966] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Dec 15 13:19:47 2021] GET /identity/v3/services/image => generated 86 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:47.941126 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe63c91-8566-4d6f-b33e-8f4db4402aae admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:47.950817 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe63c91-8566-4d6f-b33e-8f4db4402aae admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:47.955314 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-1626c793-5052-4fe1-87d9-8c3072517e53 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:47.956659 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-1626c793-5052-4fe1-87d9-8c3072517e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:47.956969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6dcfa-37fd-4b53-ae5b-47252179e4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:47.957825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6dcfa-37fd-4b53-ae5b-47252179e4ed admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:47.958258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6dcfa-37fd-4b53-ae5b-47252179e4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:47.958697 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6dcfa-37fd-4b53-ae5b-47252179e4ed admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:47.959635 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6dcfa-37fd-4b53-ae5b-47252179e4ed admin admin] RBAC: Adding query filter params (name=image) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:47.960091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6dcfa-37fd-4b53-ae5b-47252179e4ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:47.961858 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6dcfa-37fd-4b53-ae5b-47252179e4ed admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:47.968282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 484/968] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:47 2021] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:47.973342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 484/968] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:47 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:47.974468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6dcfa-37fd-4b53-ae5b-47252179e4ed admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:47.984354 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6dcfa-37fd-4b53-ae5b-47252179e4ed admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:47.989306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43eba62-702a-4835-b04e-123489e9b80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:47.990431 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eba62-702a-4835-b04e-123489e9b80c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:47.990944 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eba62-702a-4835-b04e-123489e9b80c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:47.991233 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626c793-5052-4fe1-87d9-8c3072517e53 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:47.991584 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eba62-702a-4835-b04e-123489e9b80c admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:47.992614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43eba62-702a-4835-b04e-123489e9b80c admin admin] RBAC: Adding query filter params (type=image) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:47.993097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43eba62-702a-4835-b04e-123489e9b80c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:47.994904 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43eba62-702a-4835-b04e-123489e9b80c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:48.000108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 485/969] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:47 2021] GET /identity/v3/services?type=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:48.006875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626c793-5052-4fe1-87d9-8c3072517e53 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:48.006875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee28df-82b1-4532-a528-2a0cee8d1155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:48.006875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee28df-82b1-4532-a528-2a0cee8d1155 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:48.007215 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee28df-82b1-4532-a528-2a0cee8d1155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:48.007722 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee28df-82b1-4532-a528-2a0cee8d1155 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:48.007979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee28df-82b1-4532-a528-2a0cee8d1155 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:48.009806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee28df-82b1-4532-a528-2a0cee8d1155 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:48.022591 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-80ee28df-82b1-4532-a528-2a0cee8d1155 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 13:19:48.029736 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 485/970] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Dec 15 13:19:47 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:48.031789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43eba62-702a-4835-b04e-123489e9b80c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:48.042071 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43eba62-702a-4835-b04e-123489e9b80c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:48.047105 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532ca2a-5914-43b3-8106-2912927e449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:48.047777 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532ca2a-5914-43b3-8106-2912927e449a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:48.048054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532ca2a-5914-43b3-8106-2912927e449a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:48.048330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532ca2a-5914-43b3-8106-2912927e449a admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:48.049062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532ca2a-5914-43b3-8106-2912927e449a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:48.049375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532ca2a-5914-43b3-8106-2912927e449a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:48.051006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532ca2a-5914-43b3-8106-2912927e449a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:48.058935 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 486/971] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Dec 15 13:19:48 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:48.063834 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee28df-82b1-4532-a528-2a0cee8d1155 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:48.074277 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee28df-82b1-4532-a528-2a0cee8d1155 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:48.075192 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97639f07-e492-4c2a-8773-03edc651674a None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:48.075482 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97639f07-e492-4c2a-8773-03edc651674a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:48.075764 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97639f07-e492-4c2a-8773-03edc651674a None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:48.078591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 487/972] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:19:48.085211 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a557-670a-4227-9445-b82407ce3686 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:48.085389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7b32c-54b6-4a45-bf60-1dbcb97cd351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:48.085523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a557-670a-4227-9445-b82407ce3686 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:48.085898 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a557-670a-4227-9445-b82407ce3686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:48.086054 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7b32c-54b6-4a45-bf60-1dbcb97cd351 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:48.086338 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7b32c-54b6-4a45-bf60-1dbcb97cd351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:48.086612 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7b32c-54b6-4a45-bf60-1dbcb97cd351 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:48.087403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7b32c-54b6-4a45-bf60-1dbcb97cd351 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:48.087825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7b32c-54b6-4a45-bf60-1dbcb97cd351 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:48.089822 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7b32c-54b6-4a45-bf60-1dbcb97cd351 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:48.097006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 486/973] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Dec 15 13:19:48 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:48.103492 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7b32c-54b6-4a45-bf60-1dbcb97cd351 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:48.112246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b7b3a557-670a-4227-9445-b82407ce3686 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:48.113838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b7b3a557-670a-4227-9445-b82407ce3686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:48.118204 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7b32c-54b6-4a45-bf60-1dbcb97cd351 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:48.123029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 488/974] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:48 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:48.123548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f480-30b9-47ea-9ad8-7cd6a398de79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:48.125053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f480-30b9-47ea-9ad8-7cd6a398de79 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:48.125411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f480-30b9-47ea-9ad8-7cd6a398de79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:48.125793 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f480-30b9-47ea-9ad8-7cd6a398de79 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:48.126627 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0f480-30b9-47ea-9ad8-7cd6a398de79 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:48.134878 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0f480-30b9-47ea-9ad8-7cd6a398de79 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:48.150081 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3a557-670a-4227-9445-b82407ce3686 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:48.151277 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 487/975] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Dec 15 13:19:48 2021] POST /identity/v3/endpoints => generated 349 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:19:48.163541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3a557-670a-4227-9445-b82407ce3686 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:48.181112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18c139-0ceb-43d5-95ca-160f837ee058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:48.181881 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18c139-0ceb-43d5-95ca-160f837ee058 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:48.182172 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18c139-0ceb-43d5-95ca-160f837ee058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:48.182450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18c139-0ceb-43d5-95ca-160f837ee058 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:48.183329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18c139-0ceb-43d5-95ca-160f837ee058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:48.185468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18c139-0ceb-43d5-95ca-160f837ee058 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:48.187665 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.common [None req-fd18c139-0ceb-43d5-95ca-160f837ee058 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 15 13:19:48.209960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.sql.core [None req-fd18c139-0ceb-43d5-95ca-160f837ee058 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 15 13:19:48.209960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 15 13:19:48.209960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [parameters: {'id': '5f3e9e9891e6416b9b09fdb3efb8bc12', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 15 13:19:48.209960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79064) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 13:19:48.217353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-fd18c139-0ceb-43d5-95ca-160f837ee058 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5f3e9e9891e6416b9b09fdb3efb8bc12.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5f3e9e9891e6416b9b09fdb3efb8bc12. Dec 15 13:19:48.219415 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 489/976] 10.222.0.60 () {60 vars in 1161 bytes} [Wed Dec 15 13:19:48 2021] POST /identity/v3/projects => generated 262 bytes in 70 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:48.226066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f480-30b9-47ea-9ad8-7cd6a398de79 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:48.237310 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f480-30b9-47ea-9ad8-7cd6a398de79 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:48.243597 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9675dd-0f62-4fb4-81c4-87042cd058b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:48.244849 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9675dd-0f62-4fb4-81c4-87042cd058b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:48.245363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9675dd-0f62-4fb4-81c4-87042cd058b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:48.245838 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9675dd-0f62-4fb4-81c4-87042cd058b5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:48.255523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9675dd-0f62-4fb4-81c4-87042cd058b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:48.258018 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9675dd-0f62-4fb4-81c4-87042cd058b5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:48.277814 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-5f9675dd-0f62-4fb4-81c4-87042cd058b5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:48.279915 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 488/977] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:48.287407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18c139-0ceb-43d5-95ca-160f837ee058 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:48.301965 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18c139-0ceb-43d5-95ca-160f837ee058 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:48.307788 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe9331-8a12-4d2d-8f6e-92d8bec3ba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:48.308466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe9331-8a12-4d2d-8f6e-92d8bec3ba33 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:48.308750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe9331-8a12-4d2d-8f6e-92d8bec3ba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:48.309035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe9331-8a12-4d2d-8f6e-92d8bec3ba33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:48.309819 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe9331-8a12-4d2d-8f6e-92d8bec3ba33 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:48.310127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe9331-8a12-4d2d-8f6e-92d8bec3ba33 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:48.312818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe9331-8a12-4d2d-8f6e-92d8bec3ba33 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:48.341267 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 490/978] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Dec 15 13:19:48 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:49.206398 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94216cc8-c21d-4afd-a23b-a037cddf79d3 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:49.206939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94216cc8-c21d-4afd-a23b-a037cddf79d3 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:49.207019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94216cc8-c21d-4afd-a23b-a037cddf79d3 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:49.209039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 489/979] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:49.215081 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4026a-f5ea-45ac-a174-d4ec92446550 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:49.215505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4026a-f5ea-45ac-a174-d4ec92446550 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:49.215678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4026a-f5ea-45ac-a174-d4ec92446550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:49.235718 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-8ad4026a-f5ea-45ac-a174-d4ec92446550 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:49.237820 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8ad4026a-f5ea-45ac-a174-d4ec92446550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:49.246777 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 491/980] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:49 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:49.270680 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94216cc8-c21d-4afd-a23b-a037cddf79d3 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:49.283759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94216cc8-c21d-4afd-a23b-a037cddf79d3 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:49.288183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb4602-7e0a-40a1-93a2-dae88cd7974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:49.288829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb4602-7e0a-40a1-93a2-dae88cd7974f admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:49.289111 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb4602-7e0a-40a1-93a2-dae88cd7974f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:49.289388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb4602-7e0a-40a1-93a2-dae88cd7974f admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:49.290137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb4602-7e0a-40a1-93a2-dae88cd7974f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:49.291764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb4602-7e0a-40a1-93a2-dae88cd7974f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:49.311189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 490/981] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Dec 15 13:19:49 2021] POST /identity/v3/services => generated 242 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:50.491279 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de966-c0b1-4f9c-b6ce-9539c4e717ab None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:50.492301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de966-c0b1-4f9c-b6ce-9539c4e717ab None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:50.492790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de966-c0b1-4f9c-b6ce-9539c4e717ab None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:50.495096 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 492/982] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:50.501200 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dc538-794b-4c06-90f1-2dec0c122665 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:50.502085 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dc538-794b-4c06-90f1-2dec0c122665 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:50.502569 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dc538-794b-4c06-90f1-2dec0c122665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:50.520725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-b83dc538-794b-4c06-90f1-2dec0c122665 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:50.522197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b83dc538-794b-4c06-90f1-2dec0c122665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:50.539765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 491/983] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:50 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:50.546956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f436249-6b85-4156-9f06-ba8e9b6d962f None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:50.547490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f436249-6b85-4156-9f06-ba8e9b6d962f None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:50.547959 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f436249-6b85-4156-9f06-ba8e9b6d962f None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:50.551132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 493/984] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:50.556171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de65e0-5ccf-443f-8ecd-94d37fb1e7cb None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:50.556674 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de65e0-5ccf-443f-8ecd-94d37fb1e7cb None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:50.557147 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de65e0-5ccf-443f-8ecd-94d37fb1e7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:50.564381 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f436249-6b85-4156-9f06-ba8e9b6d962f None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:50.575940 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e6de65e0-5ccf-443f-8ecd-94d37fb1e7cb None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:50.577155 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e6de65e0-5ccf-443f-8ecd-94d37fb1e7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:50.577478 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f436249-6b85-4156-9f06-ba8e9b6d962f None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:50.582329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740e453-5210-4683-9f7a-c94ead8e216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:50.583250 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740e453-5210-4683-9f7a-c94ead8e216e admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:50.583738 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740e453-5210-4683-9f7a-c94ead8e216e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:50.584236 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740e453-5210-4683-9f7a-c94ead8e216e admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:50.585186 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740e453-5210-4683-9f7a-c94ead8e216e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:50.587022 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740e453-5210-4683-9f7a-c94ead8e216e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:50.591145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 492/985] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:50 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:50.602768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 494/986] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Dec 15 13:19:50 2021] POST /identity/v3/services => generated 242 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:19:50.610399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de65e0-5ccf-443f-8ecd-94d37fb1e7cb None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:50.619994 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de65e0-5ccf-443f-8ecd-94d37fb1e7cb None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:50.636679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26dad6-c5c9-4392-9ebf-e4f331daaafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:50.638031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26dad6-c5c9-4392-9ebf-e4f331daaafb admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:50.638528 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26dad6-c5c9-4392-9ebf-e4f331daaafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:50.639012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26dad6-c5c9-4392-9ebf-e4f331daaafb admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:50.640246 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26dad6-c5c9-4392-9ebf-e4f331daaafb admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:50.641905 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26dad6-c5c9-4392-9ebf-e4f331daaafb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:50.655902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-7a26dad6-c5c9-4392-9ebf-e4f331daaafb admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 13:19:50.657973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 493/987] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Dec 15 13:19:50 2021] GET /identity/v3/services/object-store => generated 93 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:50.664767 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740e453-5210-4683-9f7a-c94ead8e216e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:50.677873 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740e453-5210-4683-9f7a-c94ead8e216e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:50.682778 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67148f29-11b1-47d3-bde3-955ddd15e11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:50.683541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67148f29-11b1-47d3-bde3-955ddd15e11e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:50.683825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67148f29-11b1-47d3-bde3-955ddd15e11e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:50.684101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67148f29-11b1-47d3-bde3-955ddd15e11e admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:50.684829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67148f29-11b1-47d3-bde3-955ddd15e11e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:50.685137 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67148f29-11b1-47d3-bde3-955ddd15e11e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:50.688766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67148f29-11b1-47d3-bde3-955ddd15e11e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:50.702906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 495/988] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Dec 15 13:19:50 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:50.704336 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26dad6-c5c9-4392-9ebf-e4f331daaafb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:50.714696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26dad6-c5c9-4392-9ebf-e4f331daaafb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:50.720313 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba405d5-c90c-4911-812a-6b73a354a9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:50.720982 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba405d5-c90c-4911-812a-6b73a354a9ef admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:50.721268 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba405d5-c90c-4911-812a-6b73a354a9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:50.721626 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba405d5-c90c-4911-812a-6b73a354a9ef admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:50.722369 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba405d5-c90c-4911-812a-6b73a354a9ef admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:50.722680 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba405d5-c90c-4911-812a-6b73a354a9ef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:50.724439 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba405d5-c90c-4911-812a-6b73a354a9ef admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:50.730508 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 494/989] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Dec 15 13:19:50 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:50.736942 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67148f29-11b1-47d3-bde3-955ddd15e11e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:50.747446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67148f29-11b1-47d3-bde3-955ddd15e11e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:50.752160 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e5e3a-b1e0-4baf-bb38-4673e5d1e1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:50.752825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5e3a-b1e0-4baf-bb38-4673e5d1e1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:50.753107 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5e3a-b1e0-4baf-bb38-4673e5d1e1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:50.753382 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5e3a-b1e0-4baf-bb38-4673e5d1e1c6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:50.754201 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e5e3a-b1e0-4baf-bb38-4673e5d1e1c6 admin admin] RBAC: Adding query filter params (interface=admin, service_id=b7c2e60daa594ec1b4734932d4fd8619, region_id=RegionOne) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:50.754512 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e5e3a-b1e0-4baf-bb38-4673e5d1e1c6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:50.756185 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e5e3a-b1e0-4baf-bb38-4673e5d1e1c6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:50.766984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 496/990] 10.222.0.60 () {56 vars in 1270 bytes} [Wed Dec 15 13:19:50 2021] GET /identity/v3/endpoints?service_id=b7c2e60daa594ec1b4734932d4fd8619&interface=admin®ion_id=RegionOne => generated 193 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:50.769706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba405d5-c90c-4911-812a-6b73a354a9ef admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:50.780401 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba405d5-c90c-4911-812a-6b73a354a9ef admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:50.785119 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50805eda-8263-4195-b903-5767e4524c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:50.785784 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50805eda-8263-4195-b903-5767e4524c00 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:50.786064 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50805eda-8263-4195-b903-5767e4524c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:50.786338 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50805eda-8263-4195-b903-5767e4524c00 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:50.787078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50805eda-8263-4195-b903-5767e4524c00 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:50.788715 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50805eda-8263-4195-b903-5767e4524c00 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:50.803045 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 495/991] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Dec 15 13:19:50 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:19:50.812091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eb97e-e4eb-44bb-9eb8-0e69103f7233 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:50.812453 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eb97e-e4eb-44bb-9eb8-0e69103f7233 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:50.812653 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eb97e-e4eb-44bb-9eb8-0e69103f7233 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:50.814913 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 497/992] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:50.821500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc4284-1925-426e-97ed-c94146b036ed None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:50.821839 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc4284-1925-426e-97ed-c94146b036ed None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:50.822054 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc4284-1925-426e-97ed-c94146b036ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:50.847851 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-96fc4284-1925-426e-97ed-c94146b036ed None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:50.848650 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-96fc4284-1925-426e-97ed-c94146b036ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:50.857075 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 496/993] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:50 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:50.882683 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566eb97e-e4eb-44bb-9eb8-0e69103f7233 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:50.897460 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566eb97e-e4eb-44bb-9eb8-0e69103f7233 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:50.904656 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb93c29-ed05-40ab-a7b9-7f057d7bb079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:50.905883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb93c29-ed05-40ab-a7b9-7f057d7bb079 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:50.906167 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb93c29-ed05-40ab-a7b9-7f057d7bb079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:50.906448 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb93c29-ed05-40ab-a7b9-7f057d7bb079 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:50.907217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb93c29-ed05-40ab-a7b9-7f057d7bb079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:50.909073 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb93c29-ed05-40ab-a7b9-7f057d7bb079 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:50.925408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.sql.core [None req-eeb93c29-ed05-40ab-a7b9-7f057d7bb079 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 15 13:19:50.925408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 15 13:19:50.925408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [parameters: {'user_id': '39ae832e482846ccbe3e8aa69d949889', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 15 13:19:50.925408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79064) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 13:19:50.931820 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-eeb93c29-ed05-40ab-a7b9-7f057d7bb079 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 15 13:19:50.933593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 498/994] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:19:50 2021] POST /identity/v3/users => generated 160 bytes in 51 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:50.940143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc4284-1925-426e-97ed-c94146b036ed None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:50.949667 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc4284-1925-426e-97ed-c94146b036ed None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:50.955123 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f791189-6a17-4ec2-9aaa-79ca85128ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:50.955935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f791189-6a17-4ec2-9aaa-79ca85128ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:50.956216 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f791189-6a17-4ec2-9aaa-79ca85128ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:50.956488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f791189-6a17-4ec2-9aaa-79ca85128ab3 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:50.965052 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f791189-6a17-4ec2-9aaa-79ca85128ab3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:50.967211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f791189-6a17-4ec2-9aaa-79ca85128ab3 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:50.982997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-2f791189-6a17-4ec2-9aaa-79ca85128ab3 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 13:19:50.984660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 497/995] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:19:50 2021] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:50.991183 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb93c29-ed05-40ab-a7b9-7f057d7bb079 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:51.002797 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb93c29-ed05-40ab-a7b9-7f057d7bb079 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:51.008120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2d76b-8e97-4784-b1cb-6ca3aa16c146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:51.009114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2d76b-8e97-4784-b1cb-6ca3aa16c146 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:51.009623 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2d76b-8e97-4784-b1cb-6ca3aa16c146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:51.010106 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2d76b-8e97-4784-b1cb-6ca3aa16c146 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:51.011169 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2d76b-8e97-4784-b1cb-6ca3aa16c146 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:51.011704 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2d76b-8e97-4784-b1cb-6ca3aa16c146 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:51.018464 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2d76b-8e97-4784-b1cb-6ca3aa16c146 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:51.064464 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 499/996] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Dec 15 13:19:50 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:51.754648 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e67872-b7ba-4028-85c4-bff13d3a3301 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:51.755289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e67872-b7ba-4028-85c4-bff13d3a3301 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:51.755289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e67872-b7ba-4028-85c4-bff13d3a3301 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:51.757136 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 498/997] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:51.762721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11232584-5f4c-4eb1-8b31-105eae1f754d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:51.763219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11232584-5f4c-4eb1-8b31-105eae1f754d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:51.763311 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11232584-5f4c-4eb1-8b31-105eae1f754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:51.781801 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-11232584-5f4c-4eb1-8b31-105eae1f754d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:51.783324 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-11232584-5f4c-4eb1-8b31-105eae1f754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:51.790995 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 500/998] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:51 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:51.814496 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e67872-b7ba-4028-85c4-bff13d3a3301 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:51.826433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e67872-b7ba-4028-85c4-bff13d3a3301 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:51.831082 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832b130-c748-4eb1-8bbd-826488a47ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:51.831885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832b130-c748-4eb1-8bbd-826488a47ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:51.832165 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832b130-c748-4eb1-8bbd-826488a47ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:51.832488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832b130-c748-4eb1-8bbd-826488a47ae3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:51.833209 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832b130-c748-4eb1-8bbd-826488a47ae3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:51.834881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832b130-c748-4eb1-8bbd-826488a47ae3 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:51.847090 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-8832b130-c748-4eb1-8bbd-826488a47ae3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 13:19:51.848453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 499/999] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:51 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:51.855109 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11232584-5f4c-4eb1-8b31-105eae1f754d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:51.864806 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11232584-5f4c-4eb1-8b31-105eae1f754d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:51.869346 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef0b11-1fc1-4a70-bc9f-36253b1cbca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:51.870098 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0b11-1fc1-4a70-bc9f-36253b1cbca6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:51.870452 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0b11-1fc1-4a70-bc9f-36253b1cbca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:51.870800 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0b11-1fc1-4a70-bc9f-36253b1cbca6 admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:51.871658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef0b11-1fc1-4a70-bc9f-36253b1cbca6 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:51.872031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef0b11-1fc1-4a70-bc9f-36253b1cbca6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:51.873809 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef0b11-1fc1-4a70-bc9f-36253b1cbca6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:51.879848 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 501/1000] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Dec 15 13:19:51 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:51.885331 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832b130-c748-4eb1-8bbd-826488a47ae3 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:51.894959 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832b130-c748-4eb1-8bbd-826488a47ae3 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:51.899394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214f395-c90e-4b80-a368-2cddaa16a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:51.900034 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f395-c90e-4b80-a368-2cddaa16a5bb admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:51.900317 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f395-c90e-4b80-a368-2cddaa16a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:51.900594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f395-c90e-4b80-a368-2cddaa16a5bb admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:51.901312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214f395-c90e-4b80-a368-2cddaa16a5bb admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:51.901616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214f395-c90e-4b80-a368-2cddaa16a5bb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:51.903253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214f395-c90e-4b80-a368-2cddaa16a5bb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:51.908871 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 500/1001] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Dec 15 13:19:51 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:51.915308 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef0b11-1fc1-4a70-bc9f-36253b1cbca6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:51.925969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef0b11-1fc1-4a70-bc9f-36253b1cbca6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:51.930377 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1b45e-9ce5-48b9-8a98-3c98be635332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:51.931053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1b45e-9ce5-48b9-8a98-3c98be635332 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:51.931339 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1b45e-9ce5-48b9-8a98-3c98be635332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:51.931615 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1b45e-9ce5-48b9-8a98-3c98be635332 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:51.932411 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1b45e-9ce5-48b9-8a98-3c98be635332 admin admin] RBAC: Adding query filter params (interface=public, service_id=b7acc113bce840e0af7eeed536e45993, region_id=RegionOne) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:51.932723 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1b45e-9ce5-48b9-8a98-3c98be635332 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:51.934311 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1b45e-9ce5-48b9-8a98-3c98be635332 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:51.939668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 502/1002] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Dec 15 13:19:51 2021] GET /identity/v3/endpoints?service_id=b7acc113bce840e0af7eeed536e45993&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:51.945749 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214f395-c90e-4b80-a368-2cddaa16a5bb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:51.955255 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214f395-c90e-4b80-a368-2cddaa16a5bb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:51.959883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff8093-4c8d-4143-a838-1b62d7139585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:51.960588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff8093-4c8d-4143-a838-1b62d7139585 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:51.960873 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff8093-4c8d-4143-a838-1b62d7139585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:51.961149 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff8093-4c8d-4143-a838-1b62d7139585 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:51.961892 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff8093-4c8d-4143-a838-1b62d7139585 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:51.963627 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff8093-4c8d-4143-a838-1b62d7139585 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:51.971380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 501/1003] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Dec 15 13:19:51 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:19:53.075006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af097a3-c69d-49e5-b0c2-eb87f626bbf5 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:53.075523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af097a3-c69d-49e5-b0c2-eb87f626bbf5 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:53.075629 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af097a3-c69d-49e5-b0c2-eb87f626bbf5 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:53.077534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 503/1004] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:53.083079 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ab576-4cc7-453a-9135-fe366582bfa2 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:53.083456 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ab576-4cc7-453a-9135-fe366582bfa2 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:53.083649 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ab576-4cc7-453a-9135-fe366582bfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:53.101930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-463ab576-4cc7-453a-9135-fe366582bfa2 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:53.103190 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-463ab576-4cc7-453a-9135-fe366582bfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:53.111760 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 502/1005] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:53 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:53.135735 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af097a3-c69d-49e5-b0c2-eb87f626bbf5 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:53.147724 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af097a3-c69d-49e5-b0c2-eb87f626bbf5 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:53.151976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa26a21-d930-4864-bbc7-eff2cd952480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:53.152746 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa26a21-d930-4864-bbc7-eff2cd952480 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:53.153030 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa26a21-d930-4864-bbc7-eff2cd952480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:53.153307 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa26a21-d930-4864-bbc7-eff2cd952480 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:53.153971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa26a21-d930-4864-bbc7-eff2cd952480 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:53.155614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa26a21-d930-4864-bbc7-eff2cd952480 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:53.166113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-8aa26a21-d930-4864-bbc7-eff2cd952480 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 13:19:53.167444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 504/1006] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Dec 15 13:19:53 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:53.174355 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ab576-4cc7-453a-9135-fe366582bfa2 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:53.183314 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ab576-4cc7-453a-9135-fe366582bfa2 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:53.188416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cf454-65c8-47cd-9e79-a03e5956fc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:53.189072 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cf454-65c8-47cd-9e79-a03e5956fc01 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:53.189357 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cf454-65c8-47cd-9e79-a03e5956fc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:53.189637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cf454-65c8-47cd-9e79-a03e5956fc01 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:53.190361 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7cf454-65c8-47cd-9e79-a03e5956fc01 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:53.190672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7cf454-65c8-47cd-9e79-a03e5956fc01 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:53.192302 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7cf454-65c8-47cd-9e79-a03e5956fc01 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:53.197429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 503/1007] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:53 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:53.200694 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb2d09-b3fd-4938-a64c-052389def675 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:53.200988 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb2d09-b3fd-4938-a64c-052389def675 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:53.201302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb2d09-b3fd-4938-a64c-052389def675 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:53.203279 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cf454-65c8-47cd-9e79-a03e5956fc01 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:53.203654 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 505/1008] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:53.209141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efea27-2348-4914-9ede-57ee7168225e None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:53.209427 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efea27-2348-4914-9ede-57ee7168225e None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:53.209707 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efea27-2348-4914-9ede-57ee7168225e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:53.213693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cf454-65c8-47cd-9e79-a03e5956fc01 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:53.220053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6f057-e9e3-4359-bb3e-17253a86ddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:53.220686 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6f057-e9e3-4359-bb3e-17253a86ddce admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:53.220970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6f057-e9e3-4359-bb3e-17253a86ddce admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:53.221245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6f057-e9e3-4359-bb3e-17253a86ddce admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:53.221956 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6f057-e9e3-4359-bb3e-17253a86ddce admin admin] RBAC: Adding query filter params (type=image) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:53.222501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6f057-e9e3-4359-bb3e-17253a86ddce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:53.223886 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6f057-e9e3-4359-bb3e-17253a86ddce admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:53.227434 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-77efea27-2348-4914-9ede-57ee7168225e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:53.228831 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-77efea27-2348-4914-9ede-57ee7168225e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:53.228935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 504/1009] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:53 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:53.235489 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6f057-e9e3-4359-bb3e-17253a86ddce admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:53.237218 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 506/1010] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:53 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:19:53.244763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6f057-e9e3-4359-bb3e-17253a86ddce admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:53.249819 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643abe5-ee16-407a-85f8-225be8fee9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:53.250452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643abe5-ee16-407a-85f8-225be8fee9bc admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:53.250735 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643abe5-ee16-407a-85f8-225be8fee9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:53.251037 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643abe5-ee16-407a-85f8-225be8fee9bc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:53.251840 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643abe5-ee16-407a-85f8-225be8fee9bc admin admin] RBAC: Adding query filter params (interface=public, service_id=311ca561e73b43ebbf243e1faba47d5b, region_id=RegionOne) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:53.252154 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643abe5-ee16-407a-85f8-225be8fee9bc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:53.253729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643abe5-ee16-407a-85f8-225be8fee9bc admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:53.258897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 505/1011] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Dec 15 13:19:53 2021] GET /identity/v3/endpoints?service_id=311ca561e73b43ebbf243e1faba47d5b&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:53.261577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efea27-2348-4914-9ede-57ee7168225e None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:53.264864 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643abe5-ee16-407a-85f8-225be8fee9bc admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:53.270415 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efea27-2348-4914-9ede-57ee7168225e None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:53.274174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643abe5-ee16-407a-85f8-225be8fee9bc admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:53.275022 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d250c-bbeb-4b0d-a3ed-baff99e64867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:53.275813 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d250c-bbeb-4b0d-a3ed-baff99e64867 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:53.276096 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d250c-bbeb-4b0d-a3ed-baff99e64867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:53.276376 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d250c-bbeb-4b0d-a3ed-baff99e64867 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:53.277039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d250c-bbeb-4b0d-a3ed-baff99e64867 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:53.278617 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d250c-bbeb-4b0d-a3ed-baff99e64867 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:53.278837 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f2ed4-989b-4d53-8878-b480d14c4eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:53.279997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2ed4-989b-4d53-8878-b480d14c4eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:53.280276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2ed4-989b-4d53-8878-b480d14c4eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:53.280549 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2ed4-989b-4d53-8878-b480d14c4eb4 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:53.281230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f2ed4-989b-4d53-8878-b480d14c4eb4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:53.282924 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f2ed4-989b-4d53-8878-b480d14c4eb4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:53.289561 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 506/1012] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Dec 15 13:19:53 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:19:53.290383 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-756d250c-bbeb-4b0d-a3ed-baff99e64867 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 13:19:53.292606 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 507/1013] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Dec 15 13:19:53 2021] GET /identity/v3/services/object-store => generated 93 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:53.299135 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f2ed4-989b-4d53-8878-b480d14c4eb4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:53.309329 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f2ed4-989b-4d53-8878-b480d14c4eb4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:53.314116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639e0f3-da9b-446e-b920-14a889648e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:53.314794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639e0f3-da9b-446e-b920-14a889648e9b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:53.315111 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639e0f3-da9b-446e-b920-14a889648e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:53.315391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639e0f3-da9b-446e-b920-14a889648e9b admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:53.316142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639e0f3-da9b-446e-b920-14a889648e9b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:53.316462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639e0f3-da9b-446e-b920-14a889648e9b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:53.318168 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639e0f3-da9b-446e-b920-14a889648e9b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:53.324135 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 507/1014] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Dec 15 13:19:53 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:53.330523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d250c-bbeb-4b0d-a3ed-baff99e64867 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:53.340409 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d250c-bbeb-4b0d-a3ed-baff99e64867 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:53.345633 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f675d8-8a82-4164-8fd7-cc60d0116edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:53.346403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f675d8-8a82-4164-8fd7-cc60d0116edd admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:53.346875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f675d8-8a82-4164-8fd7-cc60d0116edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:53.347219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f675d8-8a82-4164-8fd7-cc60d0116edd admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:53.348053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f675d8-8a82-4164-8fd7-cc60d0116edd admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:53.348435 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f675d8-8a82-4164-8fd7-cc60d0116edd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:53.350160 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f675d8-8a82-4164-8fd7-cc60d0116edd admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:53.356055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 508/1015] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Dec 15 13:19:53 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:53.363328 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639e0f3-da9b-446e-b920-14a889648e9b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:53.373449 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639e0f3-da9b-446e-b920-14a889648e9b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:53.378144 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8f640-ebf5-4b82-a001-16768fd588c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:53.378815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8f640-ebf5-4b82-a001-16768fd588c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:53.379132 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8f640-ebf5-4b82-a001-16768fd588c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:53.379414 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8f640-ebf5-4b82-a001-16768fd588c5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:53.380187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8f640-ebf5-4b82-a001-16768fd588c5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:53.381816 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8f640-ebf5-4b82-a001-16768fd588c5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:53.398472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 508/1016] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Dec 15 13:19:53 2021] POST /identity/v3/endpoints => generated 325 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:54.328741 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e78b40-945b-4f98-bf64-8c2d7a85c267 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:54.329293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e78b40-945b-4f98-bf64-8c2d7a85c267 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:54.329293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e78b40-945b-4f98-bf64-8c2d7a85c267 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:54.331138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 509/1017] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:54.336735 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d2e15-2494-44fc-9db3-2a6d0490be85 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:54.337139 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d2e15-2494-44fc-9db3-2a6d0490be85 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:54.337346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d2e15-2494-44fc-9db3-2a6d0490be85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:54.355161 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-258d2e15-2494-44fc-9db3-2a6d0490be85 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:54.356326 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-258d2e15-2494-44fc-9db3-2a6d0490be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:54.377542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 509/1018] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:54 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:54.405446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e78b40-945b-4f98-bf64-8c2d7a85c267 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:54.424808 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e78b40-945b-4f98-bf64-8c2d7a85c267 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:54.429159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e4f07-e8c3-41af-a34a-dea55a30212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:54.429963 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e4f07-e8c3-41af-a34a-dea55a30212a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:54.430244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e4f07-e8c3-41af-a34a-dea55a30212a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:54.430518 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e4f07-e8c3-41af-a34a-dea55a30212a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:54.431210 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e4f07-e8c3-41af-a34a-dea55a30212a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:54.432798 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e4f07-e8c3-41af-a34a-dea55a30212a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:54.443852 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-1a7e4f07-e8c3-41af-a34a-dea55a30212a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 13:19:54.448125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 510/1019] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:54 2021] GET /identity/v3/services/compute => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:54.452192 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d2e15-2494-44fc-9db3-2a6d0490be85 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:54.461031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d2e15-2494-44fc-9db3-2a6d0490be85 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:54.465623 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1377cb-8d8c-4133-b6c8-72c1b86bf0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:54.466295 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1377cb-8d8c-4133-b6c8-72c1b86bf0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:54.466575 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1377cb-8d8c-4133-b6c8-72c1b86bf0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:54.467622 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1377cb-8d8c-4133-b6c8-72c1b86bf0d7 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:54.468296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1377cb-8d8c-4133-b6c8-72c1b86bf0d7 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:54.468603 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1377cb-8d8c-4133-b6c8-72c1b86bf0d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:54.470254 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1377cb-8d8c-4133-b6c8-72c1b86bf0d7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:54.476446 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 510/1020] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Dec 15 13:19:54 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:54.482417 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e4f07-e8c3-41af-a34a-dea55a30212a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:54.492614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e4f07-e8c3-41af-a34a-dea55a30212a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:54.497002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd33373-7264-4996-a133-2978136a441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:54.497639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd33373-7264-4996-a133-2978136a441c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:54.497935 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd33373-7264-4996-a133-2978136a441c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:54.498218 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd33373-7264-4996-a133-2978136a441c admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:54.498960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd33373-7264-4996-a133-2978136a441c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:54.499268 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd33373-7264-4996-a133-2978136a441c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:54.500832 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd33373-7264-4996-a133-2978136a441c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:54.505867 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 511/1021] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Dec 15 13:19:54 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:54.511829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1377cb-8d8c-4133-b6c8-72c1b86bf0d7 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:54.522157 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1377cb-8d8c-4133-b6c8-72c1b86bf0d7 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:54.526712 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c8285-f209-475e-a244-fd3fa2ea29e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:54.527452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c8285-f209-475e-a244-fd3fa2ea29e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:54.527740 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c8285-f209-475e-a244-fd3fa2ea29e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:54.528017 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c8285-f209-475e-a244-fd3fa2ea29e1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:54.528782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c8285-f209-475e-a244-fd3fa2ea29e1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:54.530948 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c8285-f209-475e-a244-fd3fa2ea29e1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:54.552379 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 511/1022] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Dec 15 13:19:54 2021] POST /identity/v3/endpoints => generated 334 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:19:55.705720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63162677-29d8-4177-b1bf-df93f7823f96 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:55.706388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63162677-29d8-4177-b1bf-df93f7823f96 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:55.706388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63162677-29d8-4177-b1bf-df93f7823f96 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:55.708234 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 512/1023] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:19:55.713784 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e2860-e6be-4ad5-91c5-5af94cfc09e1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:55.714201 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e2860-e6be-4ad5-91c5-5af94cfc09e1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:55.714402 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e2860-e6be-4ad5-91c5-5af94cfc09e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:55.733416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a56e2860-e6be-4ad5-91c5-5af94cfc09e1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:55.734620 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a56e2860-e6be-4ad5-91c5-5af94cfc09e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:55.751366 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 512/1024] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:55 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:55.773009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d436edf-7ed5-4733-92cc-73846f47c435 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:55.773293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d436edf-7ed5-4733-92cc-73846f47c435 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:55.773569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d436edf-7ed5-4733-92cc-73846f47c435 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:55.775011 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e2860-e6be-4ad5-91c5-5af94cfc09e1 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:55.775494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 513/1025] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:55.781179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f35dd6-6935-4d08-affc-c3ffd5c577bb None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:55.781463 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f35dd6-6935-4d08-affc-c3ffd5c577bb None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:55.781743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f35dd6-6935-4d08-affc-c3ffd5c577bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:55.784830 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e2860-e6be-4ad5-91c5-5af94cfc09e1 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:55.789274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a697f-e2eb-4808-b52c-190cd6f4e807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:55.790050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a697f-e2eb-4808-b52c-190cd6f4e807 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:55.790327 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a697f-e2eb-4808-b52c-190cd6f4e807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:55.790594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a697f-e2eb-4808-b52c-190cd6f4e807 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:55.791330 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a697f-e2eb-4808-b52c-190cd6f4e807 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:55.793256 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a697f-e2eb-4808-b52c-190cd6f4e807 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:55.801270 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-53f35dd6-6935-4d08-affc-c3ffd5c577bb None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:55.802492 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-53f35dd6-6935-4d08-affc-c3ffd5c577bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:55.805198 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-770a697f-e2eb-4808-b52c-190cd6f4e807 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 13:19:55.806890 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 513/1026] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Dec 15 13:19:55 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:55.810598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 514/1027] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:55 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:19:55.817259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a697f-e2eb-4808-b52c-190cd6f4e807 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:55.827024 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a697f-e2eb-4808-b52c-190cd6f4e807 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:55.831402 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5a514-3c81-48b1-8789-6ec5882e020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:55.832029 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5a514-3c81-48b1-8789-6ec5882e020d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:55.832308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5a514-3c81-48b1-8789-6ec5882e020d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:55.832580 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5a514-3c81-48b1-8789-6ec5882e020d admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:55.833296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5a514-3c81-48b1-8789-6ec5882e020d admin admin] RBAC: Adding query filter params (name=image) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:55.833599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5a514-3c81-48b1-8789-6ec5882e020d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:55.834035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f35dd6-6935-4d08-affc-c3ffd5c577bb None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:55.835223 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5a514-3c81-48b1-8789-6ec5882e020d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:55.843000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 514/1028] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:55 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:55.843366 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f35dd6-6935-4d08-affc-c3ffd5c577bb None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:55.846447 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5a514-3c81-48b1-8789-6ec5882e020d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:55.848041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba809f38-76a1-4c57-b7b9-72503a6d949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:55.848814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba809f38-76a1-4c57-b7b9-72503a6d949a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:55.849097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba809f38-76a1-4c57-b7b9-72503a6d949a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:55.849373 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba809f38-76a1-4c57-b7b9-72503a6d949a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:55.850705 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba809f38-76a1-4c57-b7b9-72503a6d949a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:55.852586 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba809f38-76a1-4c57-b7b9-72503a6d949a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:55.854110 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 515/1029] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:55.855761 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5a514-3c81-48b1-8789-6ec5882e020d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:55.860760 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba809f38-76a1-4c57-b7b9-72503a6d949a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:55.860893 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23462893-ee70-4b41-bb5e-286ef007d37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:55.861486 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23462893-ee70-4b41-bb5e-286ef007d37a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:55.861773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23462893-ee70-4b41-bb5e-286ef007d37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:55.862051 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23462893-ee70-4b41-bb5e-286ef007d37a admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:55.862759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23462893-ee70-4b41-bb5e-286ef007d37a admin admin] RBAC: Adding query filter params (type=image) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:55.863101 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23462893-ee70-4b41-bb5e-286ef007d37a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:55.864660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23462893-ee70-4b41-bb5e-286ef007d37a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:55.869926 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 515/1030] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:55 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:55.870335 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba809f38-76a1-4c57-b7b9-72503a6d949a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:55.875051 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fc897-f0e5-4666-bb55-d2d35a2e71ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:55.875694 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc897-f0e5-4666-bb55-d2d35a2e71ad admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:55.875811 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23462893-ee70-4b41-bb5e-286ef007d37a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:55.875987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc897-f0e5-4666-bb55-d2d35a2e71ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:55.876253 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc897-f0e5-4666-bb55-d2d35a2e71ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:55.876964 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fc897-f0e5-4666-bb55-d2d35a2e71ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:55.878817 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fc897-f0e5-4666-bb55-d2d35a2e71ad admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:55.885296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23462893-ee70-4b41-bb5e-286ef007d37a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:55.890994 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d583f0-eb3b-409f-b840-28e4c115c35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:55.891617 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d583f0-eb3b-409f-b840-28e4c115c35a admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:55.891898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d583f0-eb3b-409f-b840-28e4c115c35a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:55.892174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d583f0-eb3b-409f-b840-28e4c115c35a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:55.892914 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d583f0-eb3b-409f-b840-28e4c115c35a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:55.894567 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d583f0-eb3b-409f-b840-28e4c115c35a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:55.915064 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 516/1031] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Dec 15 13:19:55 2021] POST /identity/v3/endpoints => generated 327 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:55.919032 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 516/1032] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Dec 15 13:19:55 2021] POST /identity/v3/projects => generated 311 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:19:57.018332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efb8c1-d897-4465-8eaa-60508a13bf7d None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:57.018867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efb8c1-d897-4465-8eaa-60508a13bf7d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:57.018951 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efb8c1-d897-4465-8eaa-60508a13bf7d None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:57.020711 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 517/1033] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:57.026375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685d56c-7d13-4570-97b1-30dbd5847034 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:57.026807 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685d56c-7d13-4570-97b1-30dbd5847034 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:57.027040 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685d56c-7d13-4570-97b1-30dbd5847034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:57.045566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-a685d56c-7d13-4570-97b1-30dbd5847034 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:57.046775 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a685d56c-7d13-4570-97b1-30dbd5847034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:57.115040 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 517/1034] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:57 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:57.139948 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efb8c1-d897-4465-8eaa-60508a13bf7d None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:57.151778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efb8c1-d897-4465-8eaa-60508a13bf7d None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:57.156048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f30ca-083b-48ff-9526-25bbde65cf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:57.156826 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f30ca-083b-48ff-9526-25bbde65cf9d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:57.157102 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f30ca-083b-48ff-9526-25bbde65cf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:57.157376 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f30ca-083b-48ff-9526-25bbde65cf9d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:57.168094 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f30ca-083b-48ff-9526-25bbde65cf9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:19:57.175323 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-370f30ca-083b-48ff-9526-25bbde65cf9d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 13:19:57.176622 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 518/1035] 10.222.0.60 () {56 vars in 1141 bytes} [Wed Dec 15 13:19:57 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:57.182922 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685d56c-7d13-4570-97b1-30dbd5847034 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:57.192393 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685d56c-7d13-4570-97b1-30dbd5847034 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:57.196966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc8abb-04e9-4d5b-be49-f4bf869236cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:57.197720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc8abb-04e9-4d5b-be49-f4bf869236cf admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:57.198075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc8abb-04e9-4d5b-be49-f4bf869236cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:57.198424 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc8abb-04e9-4d5b-be49-f4bf869236cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:57.199291 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc8abb-04e9-4d5b-be49-f4bf869236cf admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:57.199668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc8abb-04e9-4d5b-be49-f4bf869236cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:57.201949 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc8abb-04e9-4d5b-be49-f4bf869236cf admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:57.211501 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 518/1036] 10.222.0.60 () {56 vars in 1136 bytes} [Wed Dec 15 13:19:57 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:57.217224 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f30ca-083b-48ff-9526-25bbde65cf9d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:57.227066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f30ca-083b-48ff-9526-25bbde65cf9d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:57.231538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5e24e-38c8-4389-80c4-356c72966768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:57.232351 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5e24e-38c8-4389-80c4-356c72966768 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:57.232633 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5e24e-38c8-4389-80c4-356c72966768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:57.232910 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5e24e-38c8-4389-80c4-356c72966768 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:57.243082 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5e24e-38c8-4389-80c4-356c72966768 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:57.244940 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5e24e-38c8-4389-80c4-356c72966768 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:57.263195 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-beb5e24e-38c8-4389-80c4-356c72966768 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:57.270103 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 519/1037] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:57.271574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc8abb-04e9-4d5b-be49-f4bf869236cf admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:57.281146 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc8abb-04e9-4d5b-be49-f4bf869236cf admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:57.285583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75e84-a56b-4898-953a-30d135b35082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:57.286232 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75e84-a56b-4898-953a-30d135b35082 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:57.286517 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75e84-a56b-4898-953a-30d135b35082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:57.286795 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75e84-a56b-4898-953a-30d135b35082 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:57.287569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c75e84-a56b-4898-953a-30d135b35082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:57.287875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c75e84-a56b-4898-953a-30d135b35082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:57.289467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c75e84-a56b-4898-953a-30d135b35082 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:57.301686 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 519/1038] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:57.307769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5e24e-38c8-4389-80c4-356c72966768 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:57.318381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5e24e-38c8-4389-80c4-356c72966768 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:57.323071 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e4053-5a14-4b67-b9a1-e38d1fd9f6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:57.323849 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e4053-5a14-4b67-b9a1-e38d1fd9f6ae admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:57.324128 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e4053-5a14-4b67-b9a1-e38d1fd9f6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:57.324402 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e4053-5a14-4b67-b9a1-e38d1fd9f6ae admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:57.332564 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e4053-5a14-4b67-b9a1-e38d1fd9f6ae admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:57.334573 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e4053-5a14-4b67-b9a1-e38d1fd9f6ae admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:57.348078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-3c7e4053-5a14-4b67-b9a1-e38d1fd9f6ae admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:19:57.349429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 520/1039] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Dec 15 13:19:57 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:19:57.355502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75e84-a56b-4898-953a-30d135b35082 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:57.365050 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75e84-a56b-4898-953a-30d135b35082 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:57.369541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a6b02-41ab-4d0f-a0c5-eb48835c2e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:57.370262 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a6b02-41ab-4d0f-a0c5-eb48835c2e8c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:57.370611 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a6b02-41ab-4d0f-a0c5-eb48835c2e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:57.370982 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a6b02-41ab-4d0f-a0c5-eb48835c2e8c admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:57.371890 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a6b02-41ab-4d0f-a0c5-eb48835c2e8c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:57.372283 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a6b02-41ab-4d0f-a0c5-eb48835c2e8c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:57.374715 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a6b02-41ab-4d0f-a0c5-eb48835c2e8c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:57.392075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 520/1040] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Dec 15 13:19:57 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:57.398246 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e4053-5a14-4b67-b9a1-e38d1fd9f6ae admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:57.407802 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e4053-5a14-4b67-b9a1-e38d1fd9f6ae admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:57.412219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d3ba3-0683-49ad-a09b-8b3213c7423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:57.412846 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3ba3-0683-49ad-a09b-8b3213c7423e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:57.413125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3ba3-0683-49ad-a09b-8b3213c7423e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:57.413401 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3ba3-0683-49ad-a09b-8b3213c7423e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:57.421707 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d3ba3-0683-49ad-a09b-8b3213c7423e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:57.423487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d3ba3-0683-49ad-a09b-8b3213c7423e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:57.437640 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 521/1041] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:57 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:19:57.439138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a6b02-41ab-4d0f-a0c5-eb48835c2e8c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:57.448541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a6b02-41ab-4d0f-a0c5-eb48835c2e8c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:57.453155 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa91cfb-c028-4949-b2aa-677b2c8be08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:57.453997 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa91cfb-c028-4949-b2aa-677b2c8be08d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:57.454343 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa91cfb-c028-4949-b2aa-677b2c8be08d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:57.454709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa91cfb-c028-4949-b2aa-677b2c8be08d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:57.464800 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa91cfb-c028-4949-b2aa-677b2c8be08d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:57.466619 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa91cfb-c028-4949-b2aa-677b2c8be08d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:57.483107 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-5fa91cfb-c028-4949-b2aa-677b2c8be08d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:19:57.484341 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 521/1042] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:57.490305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d3ba3-0683-49ad-a09b-8b3213c7423e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:57.499557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d3ba3-0683-49ad-a09b-8b3213c7423e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:57.504102 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434390c9-e8b1-4c17-881e-c05131941f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:57.504827 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434390c9-e8b1-4c17-881e-c05131941f97 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:57.505180 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434390c9-e8b1-4c17-881e-c05131941f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:57.505527 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434390c9-e8b1-4c17-881e-c05131941f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:57.506325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434390c9-e8b1-4c17-881e-c05131941f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:57.506696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434390c9-e8b1-4c17-881e-c05131941f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:57.508366 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434390c9-e8b1-4c17-881e-c05131941f97 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:57.520380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 522/1043] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:19:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:57.524988 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa91cfb-c028-4949-b2aa-677b2c8be08d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:57.534191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa91cfb-c028-4949-b2aa-677b2c8be08d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:57.538544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf9f37-3af2-4db1-9540-cde1284b5f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:57.539332 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf9f37-3af2-4db1-9540-cde1284b5f8c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:57.539613 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf9f37-3af2-4db1-9540-cde1284b5f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:57.539883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf9f37-3af2-4db1-9540-cde1284b5f8c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:57.547266 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf9f37-3af2-4db1-9540-cde1284b5f8c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:57.549202 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf9f37-3af2-4db1-9540-cde1284b5f8c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:57.562323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-2ddf9f37-3af2-4db1-9540-cde1284b5f8c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:19:57.563605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 522/1044] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:19:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:19:57.569660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434390c9-e8b1-4c17-881e-c05131941f97 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:57.579115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434390c9-e8b1-4c17-881e-c05131941f97 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:57.583747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dd31e-74c0-4d78-86f8-773cf98919bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:57.584452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd31e-74c0-4d78-86f8-773cf98919bd admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:57.584803 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd31e-74c0-4d78-86f8-773cf98919bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:57.585146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd31e-74c0-4d78-86f8-773cf98919bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:57.586004 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dd31e-74c0-4d78-86f8-773cf98919bd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:57.586387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dd31e-74c0-4d78-86f8-773cf98919bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:57.588471 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dd31e-74c0-4d78-86f8-773cf98919bd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:57.605842 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 523/1045] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:19:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:57.607864 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf9f37-3af2-4db1-9540-cde1284b5f8c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:57.618041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf9f37-3af2-4db1-9540-cde1284b5f8c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:57.622581 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c733c-06ad-4b54-be8d-60916a204744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:57.623856 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c733c-06ad-4b54-be8d-60916a204744 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:57.624134 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c733c-06ad-4b54-be8d-60916a204744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:57.624406 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c733c-06ad-4b54-be8d-60916a204744 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:57.625233 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c733c-06ad-4b54-be8d-60916a204744 admin admin] RBAC: Adding query filter params (role.id=e8150335a9c84b6f85ed54a683b549bb, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=d61a8e4d64664e68a5710fdf766e4685) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:19:57.625565 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c733c-06ad-4b54-be8d-60916a204744 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:57.627380 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c733c-06ad-4b54-be8d-60916a204744 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:57.632771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 523/1046] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:19:57 2021] GET /identity/v3/role_assignments?user.id=d61a8e4d64664e68a5710fdf766e4685&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=e8150335a9c84b6f85ed54a683b549bb => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:19:58.322014 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beedb7-3a11-4f44-a04a-a5e2a50ee125 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:58.322535 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beedb7-3a11-4f44-a04a-a5e2a50ee125 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:58.322613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beedb7-3a11-4f44-a04a-a5e2a50ee125 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:58.324542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 524/1047] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:58.328685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adc474-dc61-4702-8b67-66042808e733 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:58.329166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adc474-dc61-4702-8b67-66042808e733 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:58.329269 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adc474-dc61-4702-8b67-66042808e733 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:58.330785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8105a5d-bc47-466f-ad84-ed8c2ccc65b6 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:58.331097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8105a5d-bc47-466f-ad84-ed8c2ccc65b6 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:58.331266 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 524/1048] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:58.331422 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8105a5d-bc47-466f-ad84-ed8c2ccc65b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:58.336570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8502d8-8c5e-4de3-bb6a-22901684499b None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:58.336860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8502d8-8c5e-4de3-bb6a-22901684499b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:58.337138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8502d8-8c5e-4de3-bb6a-22901684499b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:58.349456 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-d8105a5d-bc47-466f-ad84-ed8c2ccc65b6 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:58.350940 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-d8105a5d-bc47-466f-ad84-ed8c2ccc65b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:58.355832 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-cd8502d8-8c5e-4de3-bb6a-22901684499b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:19:58.357162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-cd8502d8-8c5e-4de3-bb6a-22901684499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:19:58.358618 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 525/1049] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:19:58.370885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 525/1050] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:19:58.382157 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8105a5d-bc47-466f-ad84-ed8c2ccc65b6 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:58.390811 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8502d8-8c5e-4de3-bb6a-22901684499b None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:58.391931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8105a5d-bc47-466f-ad84-ed8c2ccc65b6 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:58.396480 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687e251-8fe0-458d-937c-950bcafe8337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:58.397108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e251-8fe0-458d-937c-950bcafe8337 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:58.397462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e251-8fe0-458d-937c-950bcafe8337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:58.397716 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e251-8fe0-458d-937c-950bcafe8337 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:58.399693 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8502d8-8c5e-4de3-bb6a-22901684499b None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:58.404750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28827c-d212-42e9-ae95-277df091ae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:58.405527 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28827c-d212-42e9-ae95-277df091ae41 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:58.405810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28827c-d212-42e9-ae95-277df091ae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:58.406068 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687e251-8fe0-458d-937c-950bcafe8337 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:58.406163 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28827c-d212-42e9-ae95-277df091ae41 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:58.407283 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28827c-d212-42e9-ae95-277df091ae41 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:58.407854 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687e251-8fe0-458d-937c-950bcafe8337 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:58.408954 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28827c-d212-42e9-ae95-277df091ae41 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:58.410692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 526/1051] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:58.416933 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28827c-d212-42e9-ae95-277df091ae41 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:58.424326 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 526/1052] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:19:58 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:19:58.427341 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28827c-d212-42e9-ae95-277df091ae41 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:58.432198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757683bd-a4b6-4571-b638-ba3e3770a9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:58.432551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687e251-8fe0-458d-937c-950bcafe8337 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:19:58.432994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757683bd-a4b6-4571-b638-ba3e3770a9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:58.433350 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757683bd-a4b6-4571-b638-ba3e3770a9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:58.433721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757683bd-a4b6-4571-b638-ba3e3770a9c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:58.434513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757683bd-a4b6-4571-b638-ba3e3770a9c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:58.437202 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757683bd-a4b6-4571-b638-ba3e3770a9c8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:58.446159 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687e251-8fe0-458d-937c-950bcafe8337 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:19:58.452059 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908760b9-b5e7-414f-a880-afea3ae5fd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:19:58.452843 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908760b9-b5e7-414f-a880-afea3ae5fd23 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:58.453119 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908760b9-b5e7-414f-a880-afea3ae5fd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:58.453391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908760b9-b5e7-414f-a880-afea3ae5fd23 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:58.454579 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908760b9-b5e7-414f-a880-afea3ae5fd23 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:19:58.456298 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908760b9-b5e7-414f-a880-afea3ae5fd23 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:19:58.457885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 527/1053] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:19:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:19:58.460295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 527/1054] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:19:58 2021] POST /identity/v3/users => generated 285 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:19:59.980932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2c31c-5c14-4bc5-a762-605dcef2cc64 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:59.981544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2c31c-5c14-4bc5-a762-605dcef2cc64 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:59.981544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2c31c-5c14-4bc5-a762-605dcef2cc64 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:19:59.983378 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 528/1055] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:19:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:19:59.989209 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca60d4-6083-44f6-9c20-6599618673b1 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:19:59.989643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca60d4-6083-44f6-9c20-6599618673b1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:19:59.989909 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca60d4-6083-44f6-9c20-6599618673b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:00.015223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-41ca60d4-6083-44f6-9c20-6599618673b1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:00.016391 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-41ca60d4-6083-44f6-9c20-6599618673b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:00.024065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 528/1056] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:19:59 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:00.047773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2c31c-5c14-4bc5-a762-605dcef2cc64 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:00.060388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2c31c-5c14-4bc5-a762-605dcef2cc64 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:00.064720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9e9dc-64a0-4d31-ae5f-572684070c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:00.065616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9e9dc-64a0-4d31-ae5f-572684070c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:00.065899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9e9dc-64a0-4d31-ae5f-572684070c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:00.066177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9e9dc-64a0-4d31-ae5f-572684070c30 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:00.076769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9e9dc-64a0-4d31-ae5f-572684070c30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:20:00.084052 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-13f9e9dc-64a0-4d31-ae5f-572684070c30 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 13:20:00.085179 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 529/1057] 10.222.0.60 () {56 vars in 1141 bytes} [Wed Dec 15 13:20:00 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:00.091299 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca60d4-6083-44f6-9c20-6599618673b1 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:00.100073 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca60d4-6083-44f6-9c20-6599618673b1 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:00.104582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8105bc-f0b8-43fa-947f-c5d4ff363072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:00.105314 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8105bc-f0b8-43fa-947f-c5d4ff363072 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:00.105662 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8105bc-f0b8-43fa-947f-c5d4ff363072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:00.106004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8105bc-f0b8-43fa-947f-c5d4ff363072 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:00.106763 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8105bc-f0b8-43fa-947f-c5d4ff363072 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:00.107118 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8105bc-f0b8-43fa-947f-c5d4ff363072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:00.108693 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8105bc-f0b8-43fa-947f-c5d4ff363072 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:00.116685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 529/1058] 10.222.0.60 () {56 vars in 1136 bytes} [Wed Dec 15 13:20:00 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:20:00.122073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9e9dc-64a0-4d31-ae5f-572684070c30 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:00.132410 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9e9dc-64a0-4d31-ae5f-572684070c30 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:00.136871 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1be75-8757-49a7-8179-93e8ff00bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:00.137601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1be75-8757-49a7-8179-93e8ff00bebb admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:00.137883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1be75-8757-49a7-8179-93e8ff00bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:00.138704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1be75-8757-49a7-8179-93e8ff00bebb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:00.150156 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1be75-8757-49a7-8179-93e8ff00bebb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:00.152002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1be75-8757-49a7-8179-93e8ff00bebb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:00.168645 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-12f1be75-8757-49a7-8179-93e8ff00bebb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:20:00.169787 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 530/1059] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:20:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:00.175650 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8105bc-f0b8-43fa-947f-c5d4ff363072 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:00.185635 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8105bc-f0b8-43fa-947f-c5d4ff363072 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:00.190171 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230b0bb-d7e9-45fb-82e8-34c7f30d0ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:00.190812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230b0bb-d7e9-45fb-82e8-34c7f30d0ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:00.191126 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230b0bb-d7e9-45fb-82e8-34c7f30d0ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:00.191405 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230b0bb-d7e9-45fb-82e8-34c7f30d0ed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:00.192136 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230b0bb-d7e9-45fb-82e8-34c7f30d0ed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:00.192445 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230b0bb-d7e9-45fb-82e8-34c7f30d0ed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:00.194027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230b0bb-d7e9-45fb-82e8-34c7f30d0ed4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:00.206105 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 530/1060] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:20:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:20:00.211843 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1be75-8757-49a7-8179-93e8ff00bebb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:00.221909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1be75-8757-49a7-8179-93e8ff00bebb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:00.226438 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7795fa4-e0eb-47ec-9b7a-282eb0b6e2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:00.227229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7795fa4-e0eb-47ec-9b7a-282eb0b6e2ce admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:00.227515 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7795fa4-e0eb-47ec-9b7a-282eb0b6e2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:00.227796 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7795fa4-e0eb-47ec-9b7a-282eb0b6e2ce admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:00.235519 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7795fa4-e0eb-47ec-9b7a-282eb0b6e2ce admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:00.237464 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7795fa4-e0eb-47ec-9b7a-282eb0b6e2ce admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:00.250774 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-e7795fa4-e0eb-47ec-9b7a-282eb0b6e2ce admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:20:00.252056 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 531/1061] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Dec 15 13:20:00 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:00.257811 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230b0bb-d7e9-45fb-82e8-34c7f30d0ed4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:00.267380 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230b0bb-d7e9-45fb-82e8-34c7f30d0ed4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:00.271871 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d109b5-f94e-4a7d-bdf1-e9d73e25bde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:00.272588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d109b5-f94e-4a7d-bdf1-e9d73e25bde9 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:00.272938 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d109b5-f94e-4a7d-bdf1-e9d73e25bde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:00.273285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d109b5-f94e-4a7d-bdf1-e9d73e25bde9 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:00.274138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d109b5-f94e-4a7d-bdf1-e9d73e25bde9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:00.274477 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d109b5-f94e-4a7d-bdf1-e9d73e25bde9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:00.276298 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d109b5-f94e-4a7d-bdf1-e9d73e25bde9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:00.293719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 531/1062] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Dec 15 13:20:00 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:00.300188 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7795fa4-e0eb-47ec-9b7a-282eb0b6e2ce admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:00.309693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7795fa4-e0eb-47ec-9b7a-282eb0b6e2ce admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:00.314188 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371be3d1-d837-4351-8b5e-50d1b30b66c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:00.314978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371be3d1-d837-4351-8b5e-50d1b30b66c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:00.315266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371be3d1-d837-4351-8b5e-50d1b30b66c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:00.315542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371be3d1-d837-4351-8b5e-50d1b30b66c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:00.326184 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371be3d1-d837-4351-8b5e-50d1b30b66c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:00.328072 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371be3d1-d837-4351-8b5e-50d1b30b66c4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:00.345032 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-371be3d1-d837-4351-8b5e-50d1b30b66c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:20:00.346186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 532/1063] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:20:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:00.352333 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d109b5-f94e-4a7d-bdf1-e9d73e25bde9 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:00.362481 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d109b5-f94e-4a7d-bdf1-e9d73e25bde9 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:00.367115 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc02cc4-e968-45b6-8441-b0936d4905d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:00.367833 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc02cc4-e968-45b6-8441-b0936d4905d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:00.368294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc02cc4-e968-45b6-8441-b0936d4905d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:00.368661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc02cc4-e968-45b6-8441-b0936d4905d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:00.369463 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc02cc4-e968-45b6-8441-b0936d4905d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:00.369841 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc02cc4-e968-45b6-8441-b0936d4905d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:00.371546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc02cc4-e968-45b6-8441-b0936d4905d8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:00.382745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 532/1064] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:20:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:00.389107 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371be3d1-d837-4351-8b5e-50d1b30b66c4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:00.398549 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371be3d1-d837-4351-8b5e-50d1b30b66c4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:00.403042 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cdde5-3e59-4d8a-b18a-4da6645a2457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:00.404429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cdde5-3e59-4d8a-b18a-4da6645a2457 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:00.404711 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cdde5-3e59-4d8a-b18a-4da6645a2457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:00.404986 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cdde5-3e59-4d8a-b18a-4da6645a2457 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:00.411683 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cdde5-3e59-4d8a-b18a-4da6645a2457 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:00.413615 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cdde5-3e59-4d8a-b18a-4da6645a2457 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:00.426551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-f08cdde5-3e59-4d8a-b18a-4da6645a2457 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:20:00.428423 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 533/1065] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:20:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:00.434703 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc02cc4-e968-45b6-8441-b0936d4905d8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:00.444389 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc02cc4-e968-45b6-8441-b0936d4905d8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:00.448892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394e3b0-a44c-4875-89ef-a067420b34f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:00.449541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394e3b0-a44c-4875-89ef-a067420b34f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:00.449825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394e3b0-a44c-4875-89ef-a067420b34f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:00.450105 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394e3b0-a44c-4875-89ef-a067420b34f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:00.451624 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394e3b0-a44c-4875-89ef-a067420b34f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:00.451939 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394e3b0-a44c-4875-89ef-a067420b34f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:00.453801 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394e3b0-a44c-4875-89ef-a067420b34f8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:00.478804 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 533/1066] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:20:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:00.479988 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cdde5-3e59-4d8a-b18a-4da6645a2457 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:00.490347 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cdde5-3e59-4d8a-b18a-4da6645a2457 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:00.494911 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fe63d-ae33-4aac-aad3-bfbf8163704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:00.495809 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fe63d-ae33-4aac-aad3-bfbf8163704d admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:00.496091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fe63d-ae33-4aac-aad3-bfbf8163704d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:00.496369 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fe63d-ae33-4aac-aad3-bfbf8163704d admin admin] PATH_INFO: `/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/d61a8e4d64664e68a5710fdf766e4685/roles/e8150335a9c84b6f85ed54a683b549bb` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:00.498674 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fe63d-ae33-4aac-aad3-bfbf8163704d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f200887ca764a72b0640476fe3eb41b, user_id=d61a8e4d64664e68a5710fdf766e4685, role_id=e8150335a9c84b6f85ed54a683b549bb)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:00.501405 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fe63d-ae33-4aac-aad3-bfbf8163704d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:00.516099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 534/1067] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:20:00 2021] PUT /identity/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/d61a8e4d64664e68a5710fdf766e4685/roles/e8150335a9c84b6f85ed54a683b549bb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:20:00.906964 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdb2cb-4265-480e-8f89-337940e9528f None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:00.907250 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdb2cb-4265-480e-8f89-337940e9528f None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:00.907439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdb2cb-4265-480e-8f89-337940e9528f None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:00.909201 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 534/1068] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:00.914967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba64a3f-3653-4741-a9a4-cc2fa8b552ff None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:00.915256 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba64a3f-3653-4741-a9a4-cc2fa8b552ff None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:00.915533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba64a3f-3653-4741-a9a4-cc2fa8b552ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:00.932576 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-8ba64a3f-3653-4741-a9a4-cc2fa8b552ff None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:00.933737 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-8ba64a3f-3653-4741-a9a4-cc2fa8b552ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:00.988215 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 535/1069] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:01.012857 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdb2cb-4265-480e-8f89-337940e9528f None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:01.025614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdb2cb-4265-480e-8f89-337940e9528f None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:01.029983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310940-c238-4928-8465-10252cacc082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:01.030824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310940-c238-4928-8465-10252cacc082 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:01.031145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310940-c238-4928-8465-10252cacc082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:01.031420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310940-c238-4928-8465-10252cacc082 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:01.041309 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5310940-c238-4928-8465-10252cacc082 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:20:01.048266 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-c5310940-c238-4928-8465-10252cacc082 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:20:01.049395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 535/1070] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:20:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:01.055712 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba64a3f-3653-4741-a9a4-cc2fa8b552ff None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:01.064980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba64a3f-3653-4741-a9a4-cc2fa8b552ff None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:01.069478 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d653a2-4dfb-41be-8143-5ccb393056cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:01.070115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d653a2-4dfb-41be-8143-5ccb393056cb admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:01.070395 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d653a2-4dfb-41be-8143-5ccb393056cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:01.070668 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d653a2-4dfb-41be-8143-5ccb393056cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:01.071459 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d653a2-4dfb-41be-8143-5ccb393056cb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:01.071765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d653a2-4dfb-41be-8143-5ccb393056cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:01.073368 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d653a2-4dfb-41be-8143-5ccb393056cb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:01.082036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 536/1071] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:20:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:01.088147 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310940-c238-4928-8465-10252cacc082 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:01.098083 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310940-c238-4928-8465-10252cacc082 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:01.102488 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dc895-8f3b-41cc-ba76-decbe95d2710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:01.103347 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dc895-8f3b-41cc-ba76-decbe95d2710 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:01.103632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dc895-8f3b-41cc-ba76-decbe95d2710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:01.103906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dc895-8f3b-41cc-ba76-decbe95d2710 admin admin] PATH_INFO: `/v3/users/eca5686bd21543d49840a72e7ea9a3f9` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:01.121762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492dc895-8f3b-41cc-ba76-decbe95d2710 admin admin] RBAC: Authorizing `identity:get_user(user_id=eca5686bd21543d49840a72e7ea9a3f9)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:01.124419 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492dc895-8f3b-41cc-ba76-decbe95d2710 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:01.126201 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 536/1072] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:01 2021] GET /identity/v3/users/eca5686bd21543d49840a72e7ea9a3f9 => generated 285 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:20:01.132197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d653a2-4dfb-41be-8143-5ccb393056cb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:01.142167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d653a2-4dfb-41be-8143-5ccb393056cb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:01.146538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e799db5-3a1d-41c9-a9fa-898905a7c462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:01.147193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799db5-3a1d-41c9-a9fa-898905a7c462 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:01.147474 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799db5-3a1d-41c9-a9fa-898905a7c462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:01.147751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799db5-3a1d-41c9-a9fa-898905a7c462 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:01.155186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e799db5-3a1d-41c9-a9fa-898905a7c462 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:01.156912 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e799db5-3a1d-41c9-a9fa-898905a7c462 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:01.165421 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 537/1073] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:20:01 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:20:01.172004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dc895-8f3b-41cc-ba76-decbe95d2710 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:01.181498 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dc895-8f3b-41cc-ba76-decbe95d2710 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:01.186632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc1bac-a1cb-453f-aa85-bdb928b87284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:01.187495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc1bac-a1cb-453f-aa85-bdb928b87284 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:01.187781 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc1bac-a1cb-453f-aa85-bdb928b87284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:01.188059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc1bac-a1cb-453f-aa85-bdb928b87284 admin admin] PATH_INFO: `/v3/projects/c6c4381af3ea4571821f6884d57171ed` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:01.189237 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc1bac-a1cb-453f-aa85-bdb928b87284 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6c4381af3ea4571821f6884d57171ed)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:01.191279 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc1bac-a1cb-453f-aa85-bdb928b87284 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:01.193046 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 537/1074] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:20:01 2021] GET /identity/v3/projects/c6c4381af3ea4571821f6884d57171ed => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:01.199245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e799db5-3a1d-41c9-a9fa-898905a7c462 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:01.207983 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e799db5-3a1d-41c9-a9fa-898905a7c462 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:01.212506 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200e7d3-9ad9-4d3c-8f9b-9a8a420debb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:01.213114 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e7d3-9ad9-4d3c-8f9b-9a8a420debb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:01.213393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e7d3-9ad9-4d3c-8f9b-9a8a420debb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:01.213668 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e7d3-9ad9-4d3c-8f9b-9a8a420debb0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:01.214494 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200e7d3-9ad9-4d3c-8f9b-9a8a420debb0 admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=c6c4381af3ea4571821f6884d57171ed, user.id=eca5686bd21543d49840a72e7ea9a3f9) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:01.214804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200e7d3-9ad9-4d3c-8f9b-9a8a420debb0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:01.216688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200e7d3-9ad9-4d3c-8f9b-9a8a420debb0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:01.221980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 538/1075] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:20:01 2021] GET /identity/v3/role_assignments?user.id=eca5686bd21543d49840a72e7ea9a3f9&scope.project.id=c6c4381af3ea4571821f6884d57171ed&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:02.838645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4367bff-abb2-48d4-b0d0-778c83f314f4 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:02.839204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4367bff-abb2-48d4-b0d0-778c83f314f4 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:02.839204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4367bff-abb2-48d4-b0d0-778c83f314f4 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:02.841044 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 538/1076] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:02.846627 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0fcb0-e007-4f40-bd41-0736794656c0 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:02.847086 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0fcb0-e007-4f40-bd41-0736794656c0 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:02.847186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0fcb0-e007-4f40-bd41-0736794656c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:02.865051 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-d6a0fcb0-e007-4f40-bd41-0736794656c0 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:02.866212 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-d6a0fcb0-e007-4f40-bd41-0736794656c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:02.874285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 539/1077] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:02 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:02.898560 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4367bff-abb2-48d4-b0d0-778c83f314f4 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:02.910413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4367bff-abb2-48d4-b0d0-778c83f314f4 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:02.914641 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fc7a4-7bbe-4537-9054-9736637830fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:02.915449 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fc7a4-7bbe-4537-9054-9736637830fd admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:02.915730 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fc7a4-7bbe-4537-9054-9736637830fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:02.916001 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fc7a4-7bbe-4537-9054-9736637830fd admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:02.926725 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fc7a4-7bbe-4537-9054-9736637830fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:20:02.933912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-582fc7a4-7bbe-4537-9054-9736637830fd admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 13:20:02.935780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 539/1078] 10.222.0.60 () {56 vars in 1141 bytes} [Wed Dec 15 13:20:02 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:02.941881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0fcb0-e007-4f40-bd41-0736794656c0 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:02.950720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0fcb0-e007-4f40-bd41-0736794656c0 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:02.955278 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ff32e-c7fd-4335-80e9-2ecd46949fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:02.956008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ff32e-c7fd-4335-80e9-2ecd46949fec admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:02.956363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ff32e-c7fd-4335-80e9-2ecd46949fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:02.956636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ff32e-c7fd-4335-80e9-2ecd46949fec admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:02.957394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ff32e-c7fd-4335-80e9-2ecd46949fec admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:02.957699 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ff32e-c7fd-4335-80e9-2ecd46949fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:02.959307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ff32e-c7fd-4335-80e9-2ecd46949fec admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:02.967230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 540/1079] 10.222.0.60 () {56 vars in 1136 bytes} [Wed Dec 15 13:20:02 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:02.973294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fc7a4-7bbe-4537-9054-9736637830fd admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:02.983771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fc7a4-7bbe-4537-9054-9736637830fd admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:02.988132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47656c49-570c-4500-a20b-00c06131ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:02.988888 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47656c49-570c-4500-a20b-00c06131ee0d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:02.989168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47656c49-570c-4500-a20b-00c06131ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:02.989443 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47656c49-570c-4500-a20b-00c06131ee0d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:02.999878 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47656c49-570c-4500-a20b-00c06131ee0d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:03.001671 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47656c49-570c-4500-a20b-00c06131ee0d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:03.017673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-47656c49-570c-4500-a20b-00c06131ee0d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:20:03.018792 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 540/1080] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:20:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:20:03.024866 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ff32e-c7fd-4335-80e9-2ecd46949fec admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:03.034986 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ff32e-c7fd-4335-80e9-2ecd46949fec admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:03.039421 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33656b75-80c7-499b-9753-fdcb2ea71465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:03.040055 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33656b75-80c7-499b-9753-fdcb2ea71465 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.040333 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33656b75-80c7-499b-9753-fdcb2ea71465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.040607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33656b75-80c7-499b-9753-fdcb2ea71465 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.041337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33656b75-80c7-499b-9753-fdcb2ea71465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:03.041643 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33656b75-80c7-499b-9753-fdcb2ea71465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:03.043507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33656b75-80c7-499b-9753-fdcb2ea71465 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:03.055466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 541/1081] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:20:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:03.061686 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47656c49-570c-4500-a20b-00c06131ee0d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:03.071145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47656c49-570c-4500-a20b-00c06131ee0d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:03.075627 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdc765-aceb-4f52-ada7-b742a102ce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:03.076408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdc765-aceb-4f52-ada7-b742a102ce31 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.076669 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdc765-aceb-4f52-ada7-b742a102ce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.076944 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdc765-aceb-4f52-ada7-b742a102ce31 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.084145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdc765-aceb-4f52-ada7-b742a102ce31 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:03.086125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdc765-aceb-4f52-ada7-b742a102ce31 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:03.099965 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-4dbdc765-aceb-4f52-ada7-b742a102ce31 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:20:03.101087 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 541/1082] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Dec 15 13:20:03 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:03.107781 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33656b75-80c7-499b-9753-fdcb2ea71465 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:03.117438 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33656b75-80c7-499b-9753-fdcb2ea71465 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:03.122082 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09363ffa-adbd-4d89-b919-be1a50a8fa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:03.122813 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09363ffa-adbd-4d89-b919-be1a50a8fa0d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.123194 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09363ffa-adbd-4d89-b919-be1a50a8fa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.123483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09363ffa-adbd-4d89-b919-be1a50a8fa0d admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.124358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09363ffa-adbd-4d89-b919-be1a50a8fa0d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:03.124672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09363ffa-adbd-4d89-b919-be1a50a8fa0d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:03.126565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09363ffa-adbd-4d89-b919-be1a50a8fa0d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:03.147087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 542/1083] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Dec 15 13:20:03 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:03.153961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdc765-aceb-4f52-ada7-b742a102ce31 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:03.163709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdc765-aceb-4f52-ada7-b742a102ce31 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:03.168678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b611a8d-be18-48f8-9ef9-cdd9fc55d735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:03.169975 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611a8d-be18-48f8-9ef9-cdd9fc55d735 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.170260 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611a8d-be18-48f8-9ef9-cdd9fc55d735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.170542 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611a8d-be18-48f8-9ef9-cdd9fc55d735 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.178776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b611a8d-be18-48f8-9ef9-cdd9fc55d735 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:03.180549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b611a8d-be18-48f8-9ef9-cdd9fc55d735 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:03.189282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 542/1084] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:20:03 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:20:03.195739 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09363ffa-adbd-4d89-b919-be1a50a8fa0d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:03.205010 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09363ffa-adbd-4d89-b919-be1a50a8fa0d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:03.209431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05514d9d-6dcc-485c-921b-8fff1f74e6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:03.210193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05514d9d-6dcc-485c-921b-8fff1f74e6ec admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.210470 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05514d9d-6dcc-485c-921b-8fff1f74e6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.210743 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05514d9d-6dcc-485c-921b-8fff1f74e6ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.221152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05514d9d-6dcc-485c-921b-8fff1f74e6ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:03.222990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05514d9d-6dcc-485c-921b-8fff1f74e6ec admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:03.239639 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-05514d9d-6dcc-485c-921b-8fff1f74e6ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:20:03.240787 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 543/1085] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:20:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:03.246894 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b611a8d-be18-48f8-9ef9-cdd9fc55d735 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:03.255764 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b611a8d-be18-48f8-9ef9-cdd9fc55d735 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:03.260396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea4963-507a-4de0-ac31-a1ee35474a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:03.261123 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea4963-507a-4de0-ac31-a1ee35474a34 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.261470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea4963-507a-4de0-ac31-a1ee35474a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.261813 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea4963-507a-4de0-ac31-a1ee35474a34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.262612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea4963-507a-4de0-ac31-a1ee35474a34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:03.263032 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea4963-507a-4de0-ac31-a1ee35474a34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:03.264666 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea4963-507a-4de0-ac31-a1ee35474a34 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:03.275790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 543/1086] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:20:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:20:03.282175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05514d9d-6dcc-485c-921b-8fff1f74e6ec admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:03.291527 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05514d9d-6dcc-485c-921b-8fff1f74e6ec admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:03.296733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe851f2-e3a8-4d45-8def-82d88e17fb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:03.297485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe851f2-e3a8-4d45-8def-82d88e17fb5c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.297762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe851f2-e3a8-4d45-8def-82d88e17fb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.298031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe851f2-e3a8-4d45-8def-82d88e17fb5c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.304689 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe851f2-e3a8-4d45-8def-82d88e17fb5c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:03.306618 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe851f2-e3a8-4d45-8def-82d88e17fb5c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:03.319337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-cfe851f2-e3a8-4d45-8def-82d88e17fb5c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:20:03.320484 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 544/1087] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:20:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:03.327117 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea4963-507a-4de0-ac31-a1ee35474a34 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:03.336594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea4963-507a-4de0-ac31-a1ee35474a34 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:03.341503 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1ee8f-ea8b-41f1-a219-d2002a65fbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:03.342146 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1ee8f-ea8b-41f1-a219-d2002a65fbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.342428 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1ee8f-ea8b-41f1-a219-d2002a65fbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.342705 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1ee8f-ea8b-41f1-a219-d2002a65fbe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.343556 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1ee8f-ea8b-41f1-a219-d2002a65fbe9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:03.343854 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1ee8f-ea8b-41f1-a219-d2002a65fbe9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:03.345678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1ee8f-ea8b-41f1-a219-d2002a65fbe9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:03.358083 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 544/1088] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:20:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:03.364466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe851f2-e3a8-4d45-8def-82d88e17fb5c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:03.375031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe851f2-e3a8-4d45-8def-82d88e17fb5c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:03.380372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f037a76-a426-40a1-af2c-dddc33646e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:03.381006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f037a76-a426-40a1-af2c-dddc33646e2f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.381291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f037a76-a426-40a1-af2c-dddc33646e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.381569 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f037a76-a426-40a1-af2c-dddc33646e2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.382420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f037a76-a426-40a1-af2c-dddc33646e2f admin admin] RBAC: Adding query filter params (role.id=e8150335a9c84b6f85ed54a683b549bb, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=d61a8e4d64664e68a5710fdf766e4685) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:03.382735 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f037a76-a426-40a1-af2c-dddc33646e2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:03.384617 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f037a76-a426-40a1-af2c-dddc33646e2f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:03.391299 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 545/1089] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:20:03 2021] GET /identity/v3/role_assignments?user.id=d61a8e4d64664e68a5710fdf766e4685&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=e8150335a9c84b6f85ed54a683b549bb => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:03.539409 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f0da-29fc-4116-8f8f-9eb46415b406 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.539708 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f0da-29fc-4116-8f8f-9eb46415b406 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.539991 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f0da-29fc-4116-8f8f-9eb46415b406 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.541864 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 545/1090] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:03.549192 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e8509-7494-4925-b299-d189345277df None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.549485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e8509-7494-4925-b299-d189345277df None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.549766 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e8509-7494-4925-b299-d189345277df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.568377 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ec6e8509-7494-4925-b299-d189345277df None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:03.569605 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ec6e8509-7494-4925-b299-d189345277df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:03.577532 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 546/1091] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:03.601076 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584f0da-29fc-4116-8f8f-9eb46415b406 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:03.614164 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584f0da-29fc-4116-8f8f-9eb46415b406 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:03.618516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb2223-1f20-4caa-b030-e7d1b3b3186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:03.619356 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb2223-1f20-4caa-b030-e7d1b3b3186f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.619633 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb2223-1f20-4caa-b030-e7d1b3b3186f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.619903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb2223-1f20-4caa-b030-e7d1b3b3186f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.630987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb2223-1f20-4caa-b030-e7d1b3b3186f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:20:03.637639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-27eb2223-1f20-4caa-b030-e7d1b3b3186f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:20:03.638790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 546/1092] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:20:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:03.645506 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e8509-7494-4925-b299-d189345277df None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:03.655906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e8509-7494-4925-b299-d189345277df None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:03.660543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602fa35-bdd8-48e8-adff-3656d90e9401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:03.661197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602fa35-bdd8-48e8-adff-3656d90e9401 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.661475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602fa35-bdd8-48e8-adff-3656d90e9401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.661749 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602fa35-bdd8-48e8-adff-3656d90e9401 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.662508 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602fa35-bdd8-48e8-adff-3656d90e9401 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:03.662813 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602fa35-bdd8-48e8-adff-3656d90e9401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:03.664456 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602fa35-bdd8-48e8-adff-3656d90e9401 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:03.673721 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 547/1093] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:20:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:03.680103 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb2223-1f20-4caa-b030-e7d1b3b3186f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:03.691233 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb2223-1f20-4caa-b030-e7d1b3b3186f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:03.695892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b1bb6-ec2f-4fb6-b04c-cce68f6ada89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:03.696741 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b1bb6-ec2f-4fb6-b04c-cce68f6ada89 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.697023 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b1bb6-ec2f-4fb6-b04c-cce68f6ada89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.697325 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b1bb6-ec2f-4fb6-b04c-cce68f6ada89 admin admin] PATH_INFO: `/v3/users/eca5686bd21543d49840a72e7ea9a3f9` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.698560 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b1bb6-ec2f-4fb6-b04c-cce68f6ada89 admin admin] RBAC: Authorizing `identity:get_user(user_id=eca5686bd21543d49840a72e7ea9a3f9)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:03.700961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b1bb6-ec2f-4fb6-b04c-cce68f6ada89 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:03.702648 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 547/1094] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:03 2021] GET /identity/v3/users/eca5686bd21543d49840a72e7ea9a3f9 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:03.708978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602fa35-bdd8-48e8-adff-3656d90e9401 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:03.718655 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602fa35-bdd8-48e8-adff-3656d90e9401 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:03.723217 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275949c5-d060-4672-8506-74f92e6111d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:03.724052 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275949c5-d060-4672-8506-74f92e6111d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.724335 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275949c5-d060-4672-8506-74f92e6111d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.724607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275949c5-d060-4672-8506-74f92e6111d4 admin admin] PATH_INFO: `/v3/projects/c6c4381af3ea4571821f6884d57171ed` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.725795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275949c5-d060-4672-8506-74f92e6111d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6c4381af3ea4571821f6884d57171ed)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:03.727875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275949c5-d060-4672-8506-74f92e6111d4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:03.729526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 548/1095] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:20:03 2021] GET /identity/v3/projects/c6c4381af3ea4571821f6884d57171ed => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:03.736898 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b1bb6-ec2f-4fb6-b04c-cce68f6ada89 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:03.746783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b1bb6-ec2f-4fb6-b04c-cce68f6ada89 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:03.751969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19590be-1912-45c4-bf64-994b07e10e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:03.752845 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19590be-1912-45c4-bf64-994b07e10e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:03.753125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19590be-1912-45c4-bf64-994b07e10e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:03.753402 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19590be-1912-45c4-bf64-994b07e10e2f admin admin] PATH_INFO: `/v3/projects/c6c4381af3ea4571821f6884d57171ed/users/eca5686bd21543d49840a72e7ea9a3f9/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:03.755990 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19590be-1912-45c4-bf64-994b07e10e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c4381af3ea4571821f6884d57171ed, user_id=eca5686bd21543d49840a72e7ea9a3f9, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:03.758630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19590be-1912-45c4-bf64-994b07e10e2f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:03.772203 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 548/1096] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:20:03 2021] PUT /identity/v3/projects/c6c4381af3ea4571821f6884d57171ed/users/eca5686bd21543d49840a72e7ea9a3f9/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:20:06.116602 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d401bce-c7f7-4002-b2e5-648f2b0e8c69 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:06.117127 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d401bce-c7f7-4002-b2e5-648f2b0e8c69 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:06.117127 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d401bce-c7f7-4002-b2e5-648f2b0e8c69 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:06.118954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 549/1097] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:06.125397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbc5d3-55ca-49c1-b2ab-4cd82a0ba0f9 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:06.125838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbc5d3-55ca-49c1-b2ab-4cd82a0ba0f9 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:06.125958 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbc5d3-55ca-49c1-b2ab-4cd82a0ba0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:06.143896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-65dbc5d3-55ca-49c1-b2ab-4cd82a0ba0f9 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:06.145067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-65dbc5d3-55ca-49c1-b2ab-4cd82a0ba0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:06.202143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 549/1098] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:06.225697 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d401bce-c7f7-4002-b2e5-648f2b0e8c69 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:06.237525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d401bce-c7f7-4002-b2e5-648f2b0e8c69 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:06.241783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd26abf-9a9b-4a59-a877-9a39727648bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:06.242534 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd26abf-9a9b-4a59-a877-9a39727648bb admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:06.242812 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd26abf-9a9b-4a59-a877-9a39727648bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:06.243116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd26abf-9a9b-4a59-a877-9a39727648bb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:06.253890 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd26abf-9a9b-4a59-a877-9a39727648bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:20:06.260606 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-efd26abf-9a9b-4a59-a877-9a39727648bb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:20:06.261712 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 550/1099] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:20:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:06.268255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbc5d3-55ca-49c1-b2ab-4cd82a0ba0f9 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:06.276707 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbc5d3-55ca-49c1-b2ab-4cd82a0ba0f9 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:06.281370 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a7cc3-5633-41ec-b230-eddcb8f5e7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:06.282003 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a7cc3-5633-41ec-b230-eddcb8f5e7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:06.282279 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a7cc3-5633-41ec-b230-eddcb8f5e7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:06.282552 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a7cc3-5633-41ec-b230-eddcb8f5e7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:06.283339 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a7cc3-5633-41ec-b230-eddcb8f5e7c8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:06.283645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a7cc3-5633-41ec-b230-eddcb8f5e7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:06.285234 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a7cc3-5633-41ec-b230-eddcb8f5e7c8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:06.293411 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 550/1100] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:20:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:20:06.299721 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd26abf-9a9b-4a59-a877-9a39727648bb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:06.308884 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd26abf-9a9b-4a59-a877-9a39727648bb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:06.313812 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb8ffe-84b6-4880-8b70-2dda09d91d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:06.314627 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb8ffe-84b6-4880-8b70-2dda09d91d68 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:06.314936 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb8ffe-84b6-4880-8b70-2dda09d91d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:06.315211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb8ffe-84b6-4880-8b70-2dda09d91d68 admin admin] PATH_INFO: `/v3/users/eca5686bd21543d49840a72e7ea9a3f9` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:06.316398 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb8ffe-84b6-4880-8b70-2dda09d91d68 admin admin] RBAC: Authorizing `identity:get_user(user_id=eca5686bd21543d49840a72e7ea9a3f9)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:06.318941 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb8ffe-84b6-4880-8b70-2dda09d91d68 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:06.320826 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 551/1101] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:06 2021] GET /identity/v3/users/eca5686bd21543d49840a72e7ea9a3f9 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:06.327442 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a7cc3-5633-41ec-b230-eddcb8f5e7c8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:06.336835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a7cc3-5633-41ec-b230-eddcb8f5e7c8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:06.341334 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1077f4f-9932-4149-b970-8a2e8b0eb6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:06.341955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1077f4f-9932-4149-b970-8a2e8b0eb6aa admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:06.342242 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1077f4f-9932-4149-b970-8a2e8b0eb6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:06.342521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1077f4f-9932-4149-b970-8a2e8b0eb6aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:06.350047 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1077f4f-9932-4149-b970-8a2e8b0eb6aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:06.351812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1077f4f-9932-4149-b970-8a2e8b0eb6aa admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:06.360716 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 551/1102] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:20:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:20:06.366502 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb8ffe-84b6-4880-8b70-2dda09d91d68 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:06.376255 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb8ffe-84b6-4880-8b70-2dda09d91d68 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:06.380589 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3c2f1-cd61-48f6-8de5-5ed84e8ec842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:06.381388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3c2f1-cd61-48f6-8de5-5ed84e8ec842 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:06.381666 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3c2f1-cd61-48f6-8de5-5ed84e8ec842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:06.381939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3c2f1-cd61-48f6-8de5-5ed84e8ec842 admin admin] PATH_INFO: `/v3/projects/c6c4381af3ea4571821f6884d57171ed` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:06.383124 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3c2f1-cd61-48f6-8de5-5ed84e8ec842 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6c4381af3ea4571821f6884d57171ed)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:06.385104 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3c2f1-cd61-48f6-8de5-5ed84e8ec842 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:06.386687 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 552/1103] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:20:06 2021] GET /identity/v3/projects/c6c4381af3ea4571821f6884d57171ed => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:06.393133 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1077f4f-9932-4149-b970-8a2e8b0eb6aa admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:06.401498 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1077f4f-9932-4149-b970-8a2e8b0eb6aa admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:06.406005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a04c9-1618-49b2-8b53-ff70bd2340eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:06.406610 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a04c9-1618-49b2-8b53-ff70bd2340eb admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:06.406930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a04c9-1618-49b2-8b53-ff70bd2340eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:06.407211 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a04c9-1618-49b2-8b53-ff70bd2340eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:06.408033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a04c9-1618-49b2-8b53-ff70bd2340eb admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=c6c4381af3ea4571821f6884d57171ed, user.id=eca5686bd21543d49840a72e7ea9a3f9) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:06.408345 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a04c9-1618-49b2-8b53-ff70bd2340eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:06.410112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a04c9-1618-49b2-8b53-ff70bd2340eb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:06.415832 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 552/1104] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:20:06 2021] GET /identity/v3/role_assignments?user.id=eca5686bd21543d49840a72e7ea9a3f9&scope.project.id=c6c4381af3ea4571821f6884d57171ed&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:08.753895 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa30db-340c-468c-9f1b-c6f4ee7f3be6 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:08.754358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa30db-340c-468c-9f1b-c6f4ee7f3be6 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:08.754451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa30db-340c-468c-9f1b-c6f4ee7f3be6 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:08.756210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 553/1105] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:08.761789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bd4f6-03f1-41fd-8a00-60b5ea68071c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:08.762206 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bd4f6-03f1-41fd-8a00-60b5ea68071c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:08.762353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bd4f6-03f1-41fd-8a00-60b5ea68071c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:08.779601 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-0a6bd4f6-03f1-41fd-8a00-60b5ea68071c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:08.780781 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-0a6bd4f6-03f1-41fd-8a00-60b5ea68071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:08.788262 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 553/1106] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:08.813907 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa30db-340c-468c-9f1b-c6f4ee7f3be6 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:08.825581 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa30db-340c-468c-9f1b-c6f4ee7f3be6 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:08.829812 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd31e2c-b5b6-4c13-bfd0-1426058b7e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:08.830559 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd31e2c-b5b6-4c13-bfd0-1426058b7e4e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:08.830836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd31e2c-b5b6-4c13-bfd0-1426058b7e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:08.831139 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd31e2c-b5b6-4c13-bfd0-1426058b7e4e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:08.832318 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd31e2c-b5b6-4c13-bfd0-1426058b7e4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:08.833978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd31e2c-b5b6-4c13-bfd0-1426058b7e4e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:08.835544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 554/1107] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:20:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:08.841243 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bd4f6-03f1-41fd-8a00-60b5ea68071c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:08.849783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bd4f6-03f1-41fd-8a00-60b5ea68071c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:08.854194 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04297517-8c6b-41d0-a039-7177b60d530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:08.854830 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297517-8c6b-41d0-a039-7177b60d530c admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:08.855141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297517-8c6b-41d0-a039-7177b60d530c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:08.855418 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297517-8c6b-41d0-a039-7177b60d530c admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:08.856624 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04297517-8c6b-41d0-a039-7177b60d530c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:08.858495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04297517-8c6b-41d0-a039-7177b60d530c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:08.877675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 554/1108] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:20:08 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:20:11.414065 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825f2c-c18a-40ae-93c7-8ee645e91ef0 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:11.414620 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825f2c-c18a-40ae-93c7-8ee645e91ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:11.414620 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825f2c-c18a-40ae-93c7-8ee645e91ef0 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:11.416396 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 555/1109] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:11.422794 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547a800-7550-47f3-93d3-5433a62e8792 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:11.423259 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547a800-7550-47f3-93d3-5433a62e8792 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:11.423388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547a800-7550-47f3-93d3-5433a62e8792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:11.440693 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-3547a800-7550-47f3-93d3-5433a62e8792 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:11.441871 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3547a800-7550-47f3-93d3-5433a62e8792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:11.449664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 555/1110] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:11.474087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5825f2c-c18a-40ae-93c7-8ee645e91ef0 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:11.486409 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5825f2c-c18a-40ae-93c7-8ee645e91ef0 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:11.490677 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ec3fa-580a-474b-a780-32ad8065c37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:11.491524 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ec3fa-580a-474b-a780-32ad8065c37e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:11.491803 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ec3fa-580a-474b-a780-32ad8065c37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:11.492073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ec3fa-580a-474b-a780-32ad8065c37e admin admin] PATH_INFO: `/v3/roles/f4edd7aabe7e416f95ab6833aa478f07` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:11.493533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ec3fa-580a-474b-a780-32ad8065c37e admin admin] RBAC: Authorizing `identity:get_role(role_id=f4edd7aabe7e416f95ab6833aa478f07)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:11.494693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-6f1ec3fa-580a-474b-a780-32ad8065c37e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:20:11.494693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:20:11.494693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:20:11.495591 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ec3fa-580a-474b-a780-32ad8065c37e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:11.496916 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 556/1111] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:11 2021] GET /identity/v3/roles/f4edd7aabe7e416f95ab6833aa478f07 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:11.507085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547a800-7550-47f3-93d3-5433a62e8792 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:11.516173 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547a800-7550-47f3-93d3-5433a62e8792 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:11.520581 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615c12c-1325-4ac8-9659-a9eef2528c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:11.521451 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615c12c-1325-4ac8-9659-a9eef2528c12 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:11.521728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615c12c-1325-4ac8-9659-a9eef2528c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:11.522002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615c12c-1325-4ac8-9659-a9eef2528c12 admin admin] PATH_INFO: `/v3/users/9b13618e22a343db8f307f01e0ebed56` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:11.535569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615c12c-1325-4ac8-9659-a9eef2528c12 admin admin] RBAC: Authorizing `identity:get_user(user_id=9b13618e22a343db8f307f01e0ebed56)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:11.537661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615c12c-1325-4ac8-9659-a9eef2528c12 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:11.539293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 556/1112] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:11 2021] GET /identity/v3/users/9b13618e22a343db8f307f01e0ebed56 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:20:11.546202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ec3fa-580a-474b-a780-32ad8065c37e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:11.555576 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ec3fa-580a-474b-a780-32ad8065c37e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:11.560284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205084a3-6970-46a7-bbd1-54d1ef2b6632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:11.560907 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205084a3-6970-46a7-bbd1-54d1ef2b6632 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:11.561191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205084a3-6970-46a7-bbd1-54d1ef2b6632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:11.561469 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205084a3-6970-46a7-bbd1-54d1ef2b6632 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:11.568961 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205084a3-6970-46a7-bbd1-54d1ef2b6632 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:11.570683 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205084a3-6970-46a7-bbd1-54d1ef2b6632 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:11.579386 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 557/1113] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:20:11 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:20:11.585198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615c12c-1325-4ac8-9659-a9eef2528c12 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:11.594980 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615c12c-1325-4ac8-9659-a9eef2528c12 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:11.599349 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1a627-18f2-4ac3-b829-9c4170c6dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:11.600166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1a627-18f2-4ac3-b829-9c4170c6dced admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:11.600446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1a627-18f2-4ac3-b829-9c4170c6dced admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:11.600722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1a627-18f2-4ac3-b829-9c4170c6dced admin admin] PATH_INFO: `/v3/projects/c6c4381af3ea4571821f6884d57171ed` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:11.601875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1a627-18f2-4ac3-b829-9c4170c6dced admin admin] RBAC: Authorizing `identity:get_project(project_id=c6c4381af3ea4571821f6884d57171ed)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:11.603904 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1a627-18f2-4ac3-b829-9c4170c6dced admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:11.605504 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 557/1114] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:20:11 2021] GET /identity/v3/projects/c6c4381af3ea4571821f6884d57171ed => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:11.612315 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205084a3-6970-46a7-bbd1-54d1ef2b6632 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:11.620745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205084a3-6970-46a7-bbd1-54d1ef2b6632 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:11.625245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec595ea-6024-4d2d-b377-e5b0a772b7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:11.625860 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec595ea-6024-4d2d-b377-e5b0a772b7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:11.626144 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec595ea-6024-4d2d-b377-e5b0a772b7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:11.626423 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec595ea-6024-4d2d-b377-e5b0a772b7b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:11.627289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec595ea-6024-4d2d-b377-e5b0a772b7b7 admin admin] RBAC: Adding query filter params (role.id=f4edd7aabe7e416f95ab6833aa478f07, scope.project.id=c6c4381af3ea4571821f6884d57171ed, user.id=9b13618e22a343db8f307f01e0ebed56) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:11.627600 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec595ea-6024-4d2d-b377-e5b0a772b7b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:11.629420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec595ea-6024-4d2d-b377-e5b0a772b7b7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:11.634543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 558/1115] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:20:11 2021] GET /identity/v3/role_assignments?user.id=9b13618e22a343db8f307f01e0ebed56&scope.project.id=c6c4381af3ea4571821f6884d57171ed&role.id=f4edd7aabe7e416f95ab6833aa478f07 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:13.942278 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1f97d-1986-4e41-93cd-c5298274a493 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:13.942775 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1f97d-1986-4e41-93cd-c5298274a493 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:13.942775 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1f97d-1986-4e41-93cd-c5298274a493 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:13.944546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 558/1116] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:13.950332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d40196-593e-4f6e-bb4d-70c76e9e6ac7 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:13.950728 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d40196-593e-4f6e-bb4d-70c76e9e6ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:13.950907 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d40196-593e-4f6e-bb4d-70c76e9e6ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:13.968574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-c3d40196-593e-4f6e-bb4d-70c76e9e6ac7 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:13.969754 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c3d40196-593e-4f6e-bb4d-70c76e9e6ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:13.977765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 559/1117] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:14.001849 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1f97d-1986-4e41-93cd-c5298274a493 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:14.013777 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1f97d-1986-4e41-93cd-c5298274a493 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:14.018006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bbb38-27a9-4d25-ab6b-99011f440487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:14.018818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bbb38-27a9-4d25-ab6b-99011f440487 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:14.019134 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bbb38-27a9-4d25-ab6b-99011f440487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:14.019406 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bbb38-27a9-4d25-ab6b-99011f440487 admin admin] PATH_INFO: `/v3/roles/f4edd7aabe7e416f95ab6833aa478f07` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:14.020847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bbb38-27a9-4d25-ab6b-99011f440487 admin admin] RBAC: Authorizing `identity:get_role(role_id=f4edd7aabe7e416f95ab6833aa478f07)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:14.021847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-203bbb38-27a9-4d25-ab6b-99011f440487 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:20:14.021847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:20:14.021847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:20:14.022700 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bbb38-27a9-4d25-ab6b-99011f440487 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:14.024035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 559/1118] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:14 2021] GET /identity/v3/roles/f4edd7aabe7e416f95ab6833aa478f07 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:14.030052 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d40196-593e-4f6e-bb4d-70c76e9e6ac7 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:14.038729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d40196-593e-4f6e-bb4d-70c76e9e6ac7 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:14.044094 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759363c8-7650-4590-8dff-178dcc09c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:14.044932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759363c8-7650-4590-8dff-178dcc09c8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:14.045213 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759363c8-7650-4590-8dff-178dcc09c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:14.045492 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759363c8-7650-4590-8dff-178dcc09c8b9 admin admin] PATH_INFO: `/v3/users/9b13618e22a343db8f307f01e0ebed56` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:14.046693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759363c8-7650-4590-8dff-178dcc09c8b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=9b13618e22a343db8f307f01e0ebed56)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:14.048836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759363c8-7650-4590-8dff-178dcc09c8b9 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:14.050383 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 560/1119] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:14 2021] GET /identity/v3/users/9b13618e22a343db8f307f01e0ebed56 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:14.056009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bbb38-27a9-4d25-ab6b-99011f440487 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:14.065688 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bbb38-27a9-4d25-ab6b-99011f440487 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:14.070070 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e413e-c0e1-4381-a2c9-1861119e43de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:14.070887 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e413e-c0e1-4381-a2c9-1861119e43de admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:14.071172 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e413e-c0e1-4381-a2c9-1861119e43de admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:14.071443 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e413e-c0e1-4381-a2c9-1861119e43de admin admin] PATH_INFO: `/v3/projects/c6c4381af3ea4571821f6884d57171ed` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:14.072599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e413e-c0e1-4381-a2c9-1861119e43de admin admin] RBAC: Authorizing `identity:get_project(project_id=c6c4381af3ea4571821f6884d57171ed)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:14.074592 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e413e-c0e1-4381-a2c9-1861119e43de admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:14.076223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 560/1120] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:20:14 2021] GET /identity/v3/projects/c6c4381af3ea4571821f6884d57171ed => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:14.082265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759363c8-7650-4590-8dff-178dcc09c8b9 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:14.091636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759363c8-7650-4590-8dff-178dcc09c8b9 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:14.096126 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163dd724-4bb5-4bad-b302-b840d69d073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:14.096950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dd724-4bb5-4bad-b302-b840d69d073d admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:14.097232 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dd724-4bb5-4bad-b302-b840d69d073d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:14.097507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dd724-4bb5-4bad-b302-b840d69d073d admin admin] PATH_INFO: `/v3/projects/c6c4381af3ea4571821f6884d57171ed/users/9b13618e22a343db8f307f01e0ebed56/roles/f4edd7aabe7e416f95ab6833aa478f07` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:14.099744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163dd724-4bb5-4bad-b302-b840d69d073d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c4381af3ea4571821f6884d57171ed, user_id=9b13618e22a343db8f307f01e0ebed56, role_id=f4edd7aabe7e416f95ab6833aa478f07)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:14.102316 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163dd724-4bb5-4bad-b302-b840d69d073d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:14.114805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 561/1121] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:20:14 2021] PUT /identity/v3/projects/c6c4381af3ea4571821f6884d57171ed/users/9b13618e22a343db8f307f01e0ebed56/roles/f4edd7aabe7e416f95ab6833aa478f07 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:20:16.476248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582c28d-7af8-4f10-9260-7187cbf3d14b None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:16.476775 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582c28d-7af8-4f10-9260-7187cbf3d14b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:16.476775 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582c28d-7af8-4f10-9260-7187cbf3d14b None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:16.478542 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 561/1122] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:16.484642 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78854c8-e5e5-491e-a4c7-88de33488305 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:16.485008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78854c8-e5e5-491e-a4c7-88de33488305 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:16.485202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78854c8-e5e5-491e-a4c7-88de33488305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:16.503272 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a78854c8-e5e5-491e-a4c7-88de33488305 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:16.504461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a78854c8-e5e5-491e-a4c7-88de33488305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:16.560439 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 562/1123] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:16.584591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582c28d-7af8-4f10-9260-7187cbf3d14b None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:16.597004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582c28d-7af8-4f10-9260-7187cbf3d14b None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:16.601405 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f39cb-454d-4220-b655-369fbc215f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:16.602236 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f39cb-454d-4220-b655-369fbc215f3a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:16.602516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f39cb-454d-4220-b655-369fbc215f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:16.602788 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f39cb-454d-4220-b655-369fbc215f3a admin admin] PATH_INFO: `/v3/roles/f4edd7aabe7e416f95ab6833aa478f07` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:16.604287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f39cb-454d-4220-b655-369fbc215f3a admin admin] RBAC: Authorizing `identity:get_role(role_id=f4edd7aabe7e416f95ab6833aa478f07)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:16.606468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f39cb-454d-4220-b655-369fbc215f3a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:16.607820 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 562/1124] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:16 2021] GET /identity/v3/roles/f4edd7aabe7e416f95ab6833aa478f07 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:16.613853 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78854c8-e5e5-491e-a4c7-88de33488305 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:16.622562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78854c8-e5e5-491e-a4c7-88de33488305 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:16.627355 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaafb89-8ea2-4224-b0ba-8f9a20a3dafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:16.628760 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaafb89-8ea2-4224-b0ba-8f9a20a3dafe admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:16.629044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaafb89-8ea2-4224-b0ba-8f9a20a3dafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:16.629325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaafb89-8ea2-4224-b0ba-8f9a20a3dafe admin admin] PATH_INFO: `/v3/users/9b13618e22a343db8f307f01e0ebed56` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:16.630565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaafb89-8ea2-4224-b0ba-8f9a20a3dafe admin admin] RBAC: Authorizing `identity:get_user(user_id=9b13618e22a343db8f307f01e0ebed56)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:16.632747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaafb89-8ea2-4224-b0ba-8f9a20a3dafe admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:16.634367 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 563/1125] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:16 2021] GET /identity/v3/users/9b13618e22a343db8f307f01e0ebed56 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:16.641251 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f39cb-454d-4220-b655-369fbc215f3a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:16.650734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f39cb-454d-4220-b655-369fbc215f3a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:16.655790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d45ff-f038-426a-8e3b-a20cd493150d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:16.656454 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d45ff-f038-426a-8e3b-a20cd493150d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:16.656734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d45ff-f038-426a-8e3b-a20cd493150d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:16.657009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d45ff-f038-426a-8e3b-a20cd493150d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:16.664739 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d45ff-f038-426a-8e3b-a20cd493150d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:16.666451 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d45ff-f038-426a-8e3b-a20cd493150d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:16.675820 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 563/1126] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:20:16 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:20:16.682044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaafb89-8ea2-4224-b0ba-8f9a20a3dafe admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:16.691605 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaafb89-8ea2-4224-b0ba-8f9a20a3dafe admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:16.695996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064802d9-4c69-42d0-aaef-8f83454d3895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:16.696814 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064802d9-4c69-42d0-aaef-8f83454d3895 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:16.697119 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064802d9-4c69-42d0-aaef-8f83454d3895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:16.697389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064802d9-4c69-42d0-aaef-8f83454d3895 admin admin] PATH_INFO: `/v3/projects/c6c4381af3ea4571821f6884d57171ed` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:16.698546 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064802d9-4c69-42d0-aaef-8f83454d3895 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6c4381af3ea4571821f6884d57171ed)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:16.700605 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064802d9-4c69-42d0-aaef-8f83454d3895 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:16.702222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 564/1127] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:20:16 2021] GET /identity/v3/projects/c6c4381af3ea4571821f6884d57171ed => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:16.708739 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d45ff-f038-426a-8e3b-a20cd493150d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:16.717994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d45ff-f038-426a-8e3b-a20cd493150d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:16.722468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2171e6-eec0-4283-b2ab-193a6109def2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:16.723131 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2171e6-eec0-4283-b2ab-193a6109def2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:16.723414 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2171e6-eec0-4283-b2ab-193a6109def2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:16.726962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2171e6-eec0-4283-b2ab-193a6109def2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:16.726962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2171e6-eec0-4283-b2ab-193a6109def2 admin admin] RBAC: Adding query filter params (role.id=f4edd7aabe7e416f95ab6833aa478f07, scope.project.id=c6c4381af3ea4571821f6884d57171ed, user.id=9b13618e22a343db8f307f01e0ebed56) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:16.726962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2171e6-eec0-4283-b2ab-193a6109def2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:16.726962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2171e6-eec0-4283-b2ab-193a6109def2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:16.733510 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 564/1128] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:20:16 2021] GET /identity/v3/role_assignments?user.id=9b13618e22a343db8f307f01e0ebed56&scope.project.id=c6c4381af3ea4571821f6884d57171ed&role.id=f4edd7aabe7e416f95ab6833aa478f07 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:19.060267 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461bdc1-3d20-4058-a32c-f3bfa12fc6ad None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:19.060809 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461bdc1-3d20-4058-a32c-f3bfa12fc6ad None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:19.060809 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461bdc1-3d20-4058-a32c-f3bfa12fc6ad None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:19.062600 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 565/1129] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:19.068452 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dabde-c773-4cd9-9f74-27799d6ed4c5 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:19.068863 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dabde-c773-4cd9-9f74-27799d6ed4c5 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:19.069000 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dabde-c773-4cd9-9f74-27799d6ed4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:19.086059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-8a7dabde-c773-4cd9-9f74-27799d6ed4c5 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:19.087267 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8a7dabde-c773-4cd9-9f74-27799d6ed4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:19.095323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 565/1130] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:19.119113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461bdc1-3d20-4058-a32c-f3bfa12fc6ad None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:19.130916 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461bdc1-3d20-4058-a32c-f3bfa12fc6ad None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:19.135245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816617b-fb9b-40de-b6cb-f17d511e282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:19.135998 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816617b-fb9b-40de-b6cb-f17d511e282f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:19.136281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816617b-fb9b-40de-b6cb-f17d511e282f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:19.136556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816617b-fb9b-40de-b6cb-f17d511e282f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:19.138224 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816617b-fb9b-40de-b6cb-f17d511e282f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:19.139925 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816617b-fb9b-40de-b6cb-f17d511e282f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:19.141462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 566/1131] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:20:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:19.147137 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7dabde-c773-4cd9-9f74-27799d6ed4c5 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:19.156119 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7dabde-c773-4cd9-9f74-27799d6ed4c5 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:19.160569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66228d59-d9c4-4c34-a63c-dbff10fdca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:19.161197 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66228d59-d9c4-4c34-a63c-dbff10fdca60 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:19.161474 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66228d59-d9c4-4c34-a63c-dbff10fdca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:19.161747 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66228d59-d9c4-4c34-a63c-dbff10fdca60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:19.162455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66228d59-d9c4-4c34-a63c-dbff10fdca60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:19.164332 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66228d59-d9c4-4c34-a63c-dbff10fdca60 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:19.189481 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 566/1132] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Dec 15 13:20:19 2021] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:20:21.533149 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba26bf-c402-4cd4-8532-a4675d4f9a4c None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:21.533697 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba26bf-c402-4cd4-8532-a4675d4f9a4c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:21.533697 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba26bf-c402-4cd4-8532-a4675d4f9a4c None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:21.535497 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 567/1133] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:21.541246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b8da0-bdaa-43ae-8b7b-b723889159db None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:21.541930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b8da0-bdaa-43ae-8b7b-b723889159db None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:21.542069 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b8da0-bdaa-43ae-8b7b-b723889159db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:21.560510 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-733b8da0-bdaa-43ae-8b7b-b723889159db None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:21.561699 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-733b8da0-bdaa-43ae-8b7b-b723889159db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:21.615803 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 567/1134] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:21.641671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba26bf-c402-4cd4-8532-a4675d4f9a4c None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:21.654051 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba26bf-c402-4cd4-8532-a4675d4f9a4c None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:21.658436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1c6ea-c1e4-4757-9dfe-0ed07cbc0e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:21.659224 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1c6ea-c1e4-4757-9dfe-0ed07cbc0e82 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:21.659509 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1c6ea-c1e4-4757-9dfe-0ed07cbc0e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:21.659784 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1c6ea-c1e4-4757-9dfe-0ed07cbc0e82 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:21.660954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1c6ea-c1e4-4757-9dfe-0ed07cbc0e82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:21.662626 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1c6ea-c1e4-4757-9dfe-0ed07cbc0e82 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:21.664210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 568/1135] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:20:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:21.670354 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b8da0-bdaa-43ae-8b7b-b723889159db None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:21.679186 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b8da0-bdaa-43ae-8b7b-b723889159db None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:21.683670 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e94ed7-764e-47fa-a9bf-53874c6f7660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:21.684322 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e94ed7-764e-47fa-a9bf-53874c6f7660 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:21.684604 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e94ed7-764e-47fa-a9bf-53874c6f7660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:21.684883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e94ed7-764e-47fa-a9bf-53874c6f7660 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:21.685716 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e94ed7-764e-47fa-a9bf-53874c6f7660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:21.688578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e94ed7-764e-47fa-a9bf-53874c6f7660 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:21.706726 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 568/1136] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:20:21 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:20:24.085024 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29a18-c1c7-403a-9188-f315c8aa12fe None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:24.085555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29a18-c1c7-403a-9188-f315c8aa12fe None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:24.085555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29a18-c1c7-403a-9188-f315c8aa12fe None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:24.087387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 569/1137] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:24.093816 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640c76f-1814-4269-a920-d4ae296fbc24 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:24.094229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640c76f-1814-4269-a920-d4ae296fbc24 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:24.094384 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640c76f-1814-4269-a920-d4ae296fbc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:24.112464 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-8640c76f-1814-4269-a920-d4ae296fbc24 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:24.113647 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8640c76f-1814-4269-a920-d4ae296fbc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:24.121246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 569/1138] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:24.144652 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d29a18-c1c7-403a-9188-f315c8aa12fe None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:24.156906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d29a18-c1c7-403a-9188-f315c8aa12fe None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:24.161177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16920aa3-2638-4fe6-9493-bbdced47e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:24.161924 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16920aa3-2638-4fe6-9493-bbdced47e5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:24.162205 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16920aa3-2638-4fe6-9493-bbdced47e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:24.162481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16920aa3-2638-4fe6-9493-bbdced47e5b4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:24.173183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16920aa3-2638-4fe6-9493-bbdced47e5b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:20:24.179989 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-16920aa3-2638-4fe6-9493-bbdced47e5b4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:20:24.181100 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 570/1139] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:20:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:24.187113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640c76f-1814-4269-a920-d4ae296fbc24 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:24.195792 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640c76f-1814-4269-a920-d4ae296fbc24 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:24.200256 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4b3b4-2733-49b7-9c32-807739f26c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:24.200897 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4b3b4-2733-49b7-9c32-807739f26c31 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:24.201183 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4b3b4-2733-49b7-9c32-807739f26c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:24.201464 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4b3b4-2733-49b7-9c32-807739f26c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:24.202223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4b3b4-2733-49b7-9c32-807739f26c31 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:24.202534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4b3b4-2733-49b7-9c32-807739f26c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:24.204151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4b3b4-2733-49b7-9c32-807739f26c31 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:24.212333 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 570/1140] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:20:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:24.218604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16920aa3-2638-4fe6-9493-bbdced47e5b4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:24.228214 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16920aa3-2638-4fe6-9493-bbdced47e5b4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:24.233167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e94592-d606-4c88-8f1b-ba54bd9a2e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:24.233965 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e94592-d606-4c88-8f1b-ba54bd9a2e4e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:24.234242 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e94592-d606-4c88-8f1b-ba54bd9a2e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:24.234511 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e94592-d606-4c88-8f1b-ba54bd9a2e4e admin admin] PATH_INFO: `/v3/users/76af536fa2cc47d69e8c87ce600e9e67` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:24.247128 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e94592-d606-4c88-8f1b-ba54bd9a2e4e admin admin] RBAC: Authorizing `identity:get_user(user_id=76af536fa2cc47d69e8c87ce600e9e67)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:24.249229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e94592-d606-4c88-8f1b-ba54bd9a2e4e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:24.250783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 571/1141] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:24 2021] GET /identity/v3/users/76af536fa2cc47d69e8c87ce600e9e67 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:24.256579 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4b3b4-2733-49b7-9c32-807739f26c31 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:24.265799 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4b3b4-2733-49b7-9c32-807739f26c31 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:24.270244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddabc53-25c0-4fa8-b80a-46dd5999ac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:24.270866 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddabc53-25c0-4fa8-b80a-46dd5999ac8b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:24.271183 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddabc53-25c0-4fa8-b80a-46dd5999ac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:24.271463 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddabc53-25c0-4fa8-b80a-46dd5999ac8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:24.279417 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddabc53-25c0-4fa8-b80a-46dd5999ac8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:24.281123 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddabc53-25c0-4fa8-b80a-46dd5999ac8b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:24.289778 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 571/1142] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:20:24 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:20:24.296514 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e94592-d606-4c88-8f1b-ba54bd9a2e4e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:24.305625 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e94592-d606-4c88-8f1b-ba54bd9a2e4e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:24.310129 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd856db-8071-4412-8fb6-abf2c4eca203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:24.311042 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd856db-8071-4412-8fb6-abf2c4eca203 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:24.311256 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd856db-8071-4412-8fb6-abf2c4eca203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:24.311536 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd856db-8071-4412-8fb6-abf2c4eca203 admin admin] PATH_INFO: `/v3/projects/aedc6a081274457e8d72b9da6b881c22` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:24.312695 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd856db-8071-4412-8fb6-abf2c4eca203 admin admin] RBAC: Authorizing `identity:get_project(project_id=aedc6a081274457e8d72b9da6b881c22)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:24.314694 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd856db-8071-4412-8fb6-abf2c4eca203 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:24.316328 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 572/1143] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:20:24 2021] GET /identity/v3/projects/aedc6a081274457e8d72b9da6b881c22 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:24.322612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddabc53-25c0-4fa8-b80a-46dd5999ac8b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:24.331149 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddabc53-25c0-4fa8-b80a-46dd5999ac8b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:24.337509 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608634c-a6c9-4fc5-bdff-064752578b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:24.338075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608634c-a6c9-4fc5-bdff-064752578b96 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:24.338359 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608634c-a6c9-4fc5-bdff-064752578b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:24.338638 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608634c-a6c9-4fc5-bdff-064752578b96 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:24.339522 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608634c-a6c9-4fc5-bdff-064752578b96 admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=aedc6a081274457e8d72b9da6b881c22, user.id=76af536fa2cc47d69e8c87ce600e9e67) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:24.340340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608634c-a6c9-4fc5-bdff-064752578b96 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:24.342122 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608634c-a6c9-4fc5-bdff-064752578b96 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:24.347527 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 572/1144] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:20:24 2021] GET /identity/v3/role_assignments?user.id=76af536fa2cc47d69e8c87ce600e9e67&scope.project.id=aedc6a081274457e8d72b9da6b881c22&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:20:26.658921 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f520681-8f7e-4cf6-b0a3-b918ee92254b None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:26.659466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f520681-8f7e-4cf6-b0a3-b918ee92254b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:26.659466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f520681-8f7e-4cf6-b0a3-b918ee92254b None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:26.661237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 573/1145] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:26.667365 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f47e2-8f6b-45a2-8b60-7e6db506007a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:26.668274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f47e2-8f6b-45a2-8b60-7e6db506007a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:26.668474 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f47e2-8f6b-45a2-8b60-7e6db506007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:26.686301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-837f47e2-8f6b-45a2-8b60-7e6db506007a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:26.687504 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-837f47e2-8f6b-45a2-8b60-7e6db506007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:26.695021 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 573/1146] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:26.718039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f520681-8f7e-4cf6-b0a3-b918ee92254b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:26.734213 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f520681-8f7e-4cf6-b0a3-b918ee92254b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:26.738614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556cf83-cec4-49eb-b4cc-025766cc74a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:26.739415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556cf83-cec4-49eb-b4cc-025766cc74a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:26.739693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556cf83-cec4-49eb-b4cc-025766cc74a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:26.739965 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556cf83-cec4-49eb-b4cc-025766cc74a8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:26.750463 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556cf83-cec4-49eb-b4cc-025766cc74a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:20:26.757138 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-7556cf83-cec4-49eb-b4cc-025766cc74a8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:20:26.758266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 574/1147] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:20:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:26.764660 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f47e2-8f6b-45a2-8b60-7e6db506007a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:26.773524 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f47e2-8f6b-45a2-8b60-7e6db506007a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:26.777955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd66abe-89ef-41ae-b3c4-a4284f9de8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:26.778604 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66abe-89ef-41ae-b3c4-a4284f9de8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:26.778913 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66abe-89ef-41ae-b3c4-a4284f9de8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:26.779190 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66abe-89ef-41ae-b3c4-a4284f9de8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:26.779955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd66abe-89ef-41ae-b3c4-a4284f9de8c3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:26.780262 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd66abe-89ef-41ae-b3c4-a4284f9de8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:26.781838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd66abe-89ef-41ae-b3c4-a4284f9de8c3 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:26.789853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 574/1148] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:20:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:26.796651 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556cf83-cec4-49eb-b4cc-025766cc74a8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:26.806376 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556cf83-cec4-49eb-b4cc-025766cc74a8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:26.811520 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009b542-4432-46ca-9b60-04114e023810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:26.812323 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009b542-4432-46ca-9b60-04114e023810 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:26.812603 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009b542-4432-46ca-9b60-04114e023810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:26.812877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009b542-4432-46ca-9b60-04114e023810 admin admin] PATH_INFO: `/v3/users/76af536fa2cc47d69e8c87ce600e9e67` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:26.814053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009b542-4432-46ca-9b60-04114e023810 admin admin] RBAC: Authorizing `identity:get_user(user_id=76af536fa2cc47d69e8c87ce600e9e67)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:26.816204 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009b542-4432-46ca-9b60-04114e023810 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:26.817731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 575/1149] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:26 2021] GET /identity/v3/users/76af536fa2cc47d69e8c87ce600e9e67 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:20:26.823310 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd66abe-89ef-41ae-b3c4-a4284f9de8c3 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:26.832397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd66abe-89ef-41ae-b3c4-a4284f9de8c3 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:26.836792 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6b37e-3560-4219-b677-234248a41ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:26.837594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6b37e-3560-4219-b677-234248a41ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:26.837874 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6b37e-3560-4219-b677-234248a41ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:26.838148 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6b37e-3560-4219-b677-234248a41ed2 admin admin] PATH_INFO: `/v3/projects/aedc6a081274457e8d72b9da6b881c22` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:26.839360 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6b37e-3560-4219-b677-234248a41ed2 admin admin] RBAC: Authorizing `identity:get_project(project_id=aedc6a081274457e8d72b9da6b881c22)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:26.841342 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6b37e-3560-4219-b677-234248a41ed2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:26.842956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 575/1150] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:20:26 2021] GET /identity/v3/projects/aedc6a081274457e8d72b9da6b881c22 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:20:26.848556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009b542-4432-46ca-9b60-04114e023810 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:26.858036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009b542-4432-46ca-9b60-04114e023810 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:26.862387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa4702-eaac-4dff-a100-af3f997961f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:26.863235 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa4702-eaac-4dff-a100-af3f997961f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:26.863505 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa4702-eaac-4dff-a100-af3f997961f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:26.863773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa4702-eaac-4dff-a100-af3f997961f3 admin admin] PATH_INFO: `/v3/projects/aedc6a081274457e8d72b9da6b881c22/users/76af536fa2cc47d69e8c87ce600e9e67/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:26.865669 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa4702-eaac-4dff-a100-af3f997961f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aedc6a081274457e8d72b9da6b881c22, user_id=76af536fa2cc47d69e8c87ce600e9e67, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:26.868240 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa4702-eaac-4dff-a100-af3f997961f3 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:26.882000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 576/1151] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:20:26 2021] PUT /identity/v3/projects/aedc6a081274457e8d72b9da6b881c22/users/76af536fa2cc47d69e8c87ce600e9e67/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:20:29.179129 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f95549-0e09-4c7a-9b5e-6dac1e2c4e50 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:29.179711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f95549-0e09-4c7a-9b5e-6dac1e2c4e50 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:29.179711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f95549-0e09-4c7a-9b5e-6dac1e2c4e50 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:29.181427 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 576/1152] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:29.187773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcc3ec-d884-411e-a7cb-2ecdb9870c16 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:29.188162 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcc3ec-d884-411e-a7cb-2ecdb9870c16 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:29.188347 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcc3ec-d884-411e-a7cb-2ecdb9870c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:29.205508 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-f5fcc3ec-d884-411e-a7cb-2ecdb9870c16 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:29.206670 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f5fcc3ec-d884-411e-a7cb-2ecdb9870c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:29.260670 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 577/1153] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:29.284515 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f95549-0e09-4c7a-9b5e-6dac1e2c4e50 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:29.297242 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f95549-0e09-4c7a-9b5e-6dac1e2c4e50 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:29.301574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee196203-648f-4a12-9389-c25b2fbc0971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:29.302335 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee196203-648f-4a12-9389-c25b2fbc0971 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:29.302618 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee196203-648f-4a12-9389-c25b2fbc0971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:29.302925 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee196203-648f-4a12-9389-c25b2fbc0971 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:29.313042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee196203-648f-4a12-9389-c25b2fbc0971 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:20:29.319871 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-ee196203-648f-4a12-9389-c25b2fbc0971 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:20:29.321125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 577/1154] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:20:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:29.327190 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcc3ec-d884-411e-a7cb-2ecdb9870c16 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:29.335800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcc3ec-d884-411e-a7cb-2ecdb9870c16 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:29.340763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801811f-9665-498c-8aeb-d849815ad7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:29.341398 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801811f-9665-498c-8aeb-d849815ad7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:29.341675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801811f-9665-498c-8aeb-d849815ad7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:29.341949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801811f-9665-498c-8aeb-d849815ad7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:29.342704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801811f-9665-498c-8aeb-d849815ad7f8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:29.343051 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801811f-9665-498c-8aeb-d849815ad7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:29.344632 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801811f-9665-498c-8aeb-d849815ad7f8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:29.352607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 578/1155] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:20:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:29.359325 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee196203-648f-4a12-9389-c25b2fbc0971 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:29.369143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee196203-648f-4a12-9389-c25b2fbc0971 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:29.373626 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f0386-8922-4922-ac08-d3ca145fd4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:29.374457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f0386-8922-4922-ac08-d3ca145fd4eb admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:29.374740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f0386-8922-4922-ac08-d3ca145fd4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:29.375052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f0386-8922-4922-ac08-d3ca145fd4eb admin admin] PATH_INFO: `/v3/users/76af536fa2cc47d69e8c87ce600e9e67` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:29.376258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f0386-8922-4922-ac08-d3ca145fd4eb admin admin] RBAC: Authorizing `identity:get_user(user_id=76af536fa2cc47d69e8c87ce600e9e67)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:29.378353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f0386-8922-4922-ac08-d3ca145fd4eb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:29.380067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 578/1156] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:29 2021] GET /identity/v3/users/76af536fa2cc47d69e8c87ce600e9e67 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:29.385533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801811f-9665-498c-8aeb-d849815ad7f8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:29.394713 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801811f-9665-498c-8aeb-d849815ad7f8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:29.399180 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78388323-c670-43e0-97b3-1750b5aa5fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:29.399783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78388323-c670-43e0-97b3-1750b5aa5fef admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:29.400067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78388323-c670-43e0-97b3-1750b5aa5fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:29.400344 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78388323-c670-43e0-97b3-1750b5aa5fef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:29.408350 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78388323-c670-43e0-97b3-1750b5aa5fef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:29.410045 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78388323-c670-43e0-97b3-1750b5aa5fef admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:29.419548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 579/1157] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:20:29 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:20:29.425356 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f0386-8922-4922-ac08-d3ca145fd4eb admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:29.434561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f0386-8922-4922-ac08-d3ca145fd4eb admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:29.439067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ce810-4e92-47ef-9eae-d4adea8a7f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:29.439888 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ce810-4e92-47ef-9eae-d4adea8a7f5f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:29.440171 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ce810-4e92-47ef-9eae-d4adea8a7f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:29.440449 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ce810-4e92-47ef-9eae-d4adea8a7f5f admin admin] PATH_INFO: `/v3/projects/aedc6a081274457e8d72b9da6b881c22` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:29.441623 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ce810-4e92-47ef-9eae-d4adea8a7f5f admin admin] RBAC: Authorizing `identity:get_project(project_id=aedc6a081274457e8d72b9da6b881c22)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:29.443684 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ce810-4e92-47ef-9eae-d4adea8a7f5f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:29.445327 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 579/1158] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:20:29 2021] GET /identity/v3/projects/aedc6a081274457e8d72b9da6b881c22 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:29.451517 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78388323-c670-43e0-97b3-1750b5aa5fef admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:29.460087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78388323-c670-43e0-97b3-1750b5aa5fef admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:29.465094 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603f06a-d0f1-4889-9c9d-6e6a85f20042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:29.465706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603f06a-d0f1-4889-9c9d-6e6a85f20042 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:29.465988 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603f06a-d0f1-4889-9c9d-6e6a85f20042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:29.466268 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603f06a-d0f1-4889-9c9d-6e6a85f20042 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:29.467133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603f06a-d0f1-4889-9c9d-6e6a85f20042 admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=aedc6a081274457e8d72b9da6b881c22, user.id=76af536fa2cc47d69e8c87ce600e9e67) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:29.467447 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603f06a-d0f1-4889-9c9d-6e6a85f20042 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:29.469253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603f06a-d0f1-4889-9c9d-6e6a85f20042 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:29.474783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 580/1159] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:20:29 2021] GET /identity/v3/role_assignments?user.id=76af536fa2cc47d69e8c87ce600e9e67&scope.project.id=aedc6a081274457e8d72b9da6b881c22&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:31.819208 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d890c62-7ea3-4621-a8e7-b865a5dfcd7b None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:31.819778 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d890c62-7ea3-4621-a8e7-b865a5dfcd7b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:31.819778 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d890c62-7ea3-4621-a8e7-b865a5dfcd7b None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:31.821512 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 580/1160] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:31.827827 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3d1a5-f171-4fec-a0ee-07cec2baf000 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:31.828259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3d1a5-f171-4fec-a0ee-07cec2baf000 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:31.828392 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3d1a5-f171-4fec-a0ee-07cec2baf000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:31.846030 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-88c3d1a5-f171-4fec-a0ee-07cec2baf000 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:31.847250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-88c3d1a5-f171-4fec-a0ee-07cec2baf000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:31.854831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 581/1161] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:31 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:31.877811 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d890c62-7ea3-4621-a8e7-b865a5dfcd7b None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:31.890270 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d890c62-7ea3-4621-a8e7-b865a5dfcd7b None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:31.894529 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a979b7a-dc8c-4a66-9e58-66a480dd850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:31.895178 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a979b7a-dc8c-4a66-9e58-66a480dd850f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:31.895458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a979b7a-dc8c-4a66-9e58-66a480dd850f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:31.895730 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a979b7a-dc8c-4a66-9e58-66a480dd850f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:31.903709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a979b7a-dc8c-4a66-9e58-66a480dd850f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:31.905418 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a979b7a-dc8c-4a66-9e58-66a480dd850f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:31.913912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 581/1162] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:20:31 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:20:31.920873 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3d1a5-f171-4fec-a0ee-07cec2baf000 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:31.929596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3d1a5-f171-4fec-a0ee-07cec2baf000 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:31.934652 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3082e-3fab-4bd3-bd4e-4d88c52eaf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:31.935463 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3082e-3fab-4bd3-bd4e-4d88c52eaf80 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:31.935745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3082e-3fab-4bd3-bd4e-4d88c52eaf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:31.936020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3082e-3fab-4bd3-bd4e-4d88c52eaf80 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:31.942812 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3082e-3fab-4bd3-bd4e-4d88c52eaf80 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:31.944599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3082e-3fab-4bd3-bd4e-4d88c52eaf80 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:31.959540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-b7c3082e-3fab-4bd3-bd4e-4d88c52eaf80 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 15 13:20:31.960644 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 582/1163] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Dec 15 13:20:31 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:31.966681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a979b7a-dc8c-4a66-9e58-66a480dd850f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:31.975126 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a979b7a-dc8c-4a66-9e58-66a480dd850f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:31.979551 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fd767-7b29-4b85-82cf-74129791da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:31.980672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fd767-7b29-4b85-82cf-74129791da8d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:31.980948 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fd767-7b29-4b85-82cf-74129791da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:31.981220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fd767-7b29-4b85-82cf-74129791da8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:31.981936 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fd767-7b29-4b85-82cf-74129791da8d admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:31.982238 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fd767-7b29-4b85-82cf-74129791da8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:31.983805 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fd767-7b29-4b85-82cf-74129791da8d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:31.990895 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 582/1164] 10.222.0.60 () {56 vars in 1136 bytes} [Wed Dec 15 13:20:31 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:34.304113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aed579-b2a4-4bab-b4d9-d004fe599b4a None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:34.304658 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aed579-b2a4-4bab-b4d9-d004fe599b4a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:34.304658 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aed579-b2a4-4bab-b4d9-d004fe599b4a None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:34.306463 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 583/1165] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:34.312274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b80998-d6ac-4fdc-a32c-c5765200f0fb None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:34.312690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b80998-d6ac-4fdc-a32c-c5765200f0fb None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:34.312832 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b80998-d6ac-4fdc-a32c-c5765200f0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:34.330628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-13b80998-d6ac-4fdc-a32c-c5765200f0fb None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:34.331847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-13b80998-d6ac-4fdc-a32c-c5765200f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:34.339335 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 583/1166] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:34 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:34.362425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aed579-b2a4-4bab-b4d9-d004fe599b4a None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:34.374208 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aed579-b2a4-4bab-b4d9-d004fe599b4a None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:34.378513 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf389f5-c2d6-4a92-b78f-b016991c8187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:34.379164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf389f5-c2d6-4a92-b78f-b016991c8187 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:34.379446 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf389f5-c2d6-4a92-b78f-b016991c8187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:34.379729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf389f5-c2d6-4a92-b78f-b016991c8187 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:34.380487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf389f5-c2d6-4a92-b78f-b016991c8187 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:34.381501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-9bf389f5-c2d6-4a92-b78f-b016991c8187 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:20:34.381501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:20:34.381501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:20:34.382374 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf389f5-c2d6-4a92-b78f-b016991c8187 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:34.396811 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 584/1167] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Dec 15 13:20:34 2021] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:20:36.728867 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84396bab-8c6d-40ca-be6b-f7ae0f0a6b71 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:36.729342 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84396bab-8c6d-40ca-be6b-f7ae0f0a6b71 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:36.729441 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84396bab-8c6d-40ca-be6b-f7ae0f0a6b71 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:36.731260 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 584/1168] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:36.736950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ebdc8-77a1-457d-8b2c-7b548e6b7547 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:36.737342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ebdc8-77a1-457d-8b2c-7b548e6b7547 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:36.737503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ebdc8-77a1-457d-8b2c-7b548e6b7547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:36.754902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-8c2ebdc8-77a1-457d-8b2c-7b548e6b7547 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:36.756080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-8c2ebdc8-77a1-457d-8b2c-7b548e6b7547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:36.811930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 585/1169] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:20:36.836658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84396bab-8c6d-40ca-be6b-f7ae0f0a6b71 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:36.850559 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84396bab-8c6d-40ca-be6b-f7ae0f0a6b71 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:36.857868 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149ef49-af31-4cec-addb-a7facc830ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:36.859398 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ef49-af31-4cec-addb-a7facc830ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:36.859908 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ef49-af31-4cec-addb-a7facc830ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:36.860422 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ef49-af31-4cec-addb-a7facc830ac1 admin admin] PATH_INFO: `/v3/domains/59b07a4fa32e41ed9170eb6a240c053e` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:36.872911 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149ef49-af31-4cec-addb-a7facc830ac1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=59b07a4fa32e41ed9170eb6a240c053e)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:36.874870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149ef49-af31-4cec-addb-a7facc830ac1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:36.876514 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 585/1170] 10.222.0.60 () {56 vars in 1204 bytes} [Wed Dec 15 13:20:36 2021] GET /identity/v3/domains/59b07a4fa32e41ed9170eb6a240c053e => generated 267 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:36.882763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ebdc8-77a1-457d-8b2c-7b548e6b7547 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:36.892061 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ebdc8-77a1-457d-8b2c-7b548e6b7547 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:36.896538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624393cd-2376-4205-857e-6da02c2dd5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:36.897174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624393cd-2376-4205-857e-6da02c2dd5fb admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:36.897455 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624393cd-2376-4205-857e-6da02c2dd5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:36.897731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624393cd-2376-4205-857e-6da02c2dd5fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:36.898458 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624393cd-2376-4205-857e-6da02c2dd5fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:36.900373 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624393cd-2376-4205-857e-6da02c2dd5fb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:36.925414 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 586/1171] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Dec 15 13:20:36 2021] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:20:39.276455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebc8f7-04ea-4065-b195-b4a3dc5a2eba None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:39.277496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebc8f7-04ea-4065-b195-b4a3dc5a2eba None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:39.277496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebc8f7-04ea-4065-b195-b4a3dc5a2eba None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:39.279331 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 586/1172] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:39.285080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196766eb-7c27-45f5-8d3d-e4b7cdaeb5c1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:39.285467 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196766eb-7c27-45f5-8d3d-e4b7cdaeb5c1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:39.285670 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196766eb-7c27-45f5-8d3d-e4b7cdaeb5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:39.303676 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-196766eb-7c27-45f5-8d3d-e4b7cdaeb5c1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:39.304858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-196766eb-7c27-45f5-8d3d-e4b7cdaeb5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:39.358930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 587/1173] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:39.383766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebc8f7-04ea-4065-b195-b4a3dc5a2eba None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:39.396151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebc8f7-04ea-4065-b195-b4a3dc5a2eba None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:39.400469 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74089692-00a6-42f8-b775-289ed31c4a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:39.401303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089692-00a6-42f8-b775-289ed31c4a5e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:39.401585 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089692-00a6-42f8-b775-289ed31c4a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:39.401862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089692-00a6-42f8-b775-289ed31c4a5e admin admin] PATH_INFO: `/v3/domains/59b07a4fa32e41ed9170eb6a240c053e` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:39.403641 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74089692-00a6-42f8-b775-289ed31c4a5e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=59b07a4fa32e41ed9170eb6a240c053e)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:39.405609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74089692-00a6-42f8-b775-289ed31c4a5e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:39.407204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 587/1174] 10.222.0.60 () {56 vars in 1204 bytes} [Wed Dec 15 13:20:39 2021] GET /identity/v3/domains/59b07a4fa32e41ed9170eb6a240c053e => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:39.412778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196766eb-7c27-45f5-8d3d-e4b7cdaeb5c1 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:39.421589 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196766eb-7c27-45f5-8d3d-e4b7cdaeb5c1 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:39.426020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706e9f5-2628-4f7d-8a4f-92755eb69ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:39.426656 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706e9f5-2628-4f7d-8a4f-92755eb69ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:39.426973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706e9f5-2628-4f7d-8a4f-92755eb69ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:39.427253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706e9f5-2628-4f7d-8a4f-92755eb69ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:39.427967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706e9f5-2628-4f7d-8a4f-92755eb69ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:39.429853 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706e9f5-2628-4f7d-8a4f-92755eb69ba9 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:39.449384 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 588/1175] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:20:39 2021] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:20:41.830632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3cf8d-3611-43fd-96bb-ee2ff178723f None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:41.831195 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3cf8d-3611-43fd-96bb-ee2ff178723f None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:41.831195 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3cf8d-3611-43fd-96bb-ee2ff178723f None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:41.833005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 588/1176] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:41.838785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a316a-bd54-40ef-a215-c11063472cd0 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:41.839247 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a316a-bd54-40ef-a215-c11063472cd0 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:41.839391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a316a-bd54-40ef-a215-c11063472cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:41.858763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-432a316a-bd54-40ef-a215-c11063472cd0 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:41.859974 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-432a316a-bd54-40ef-a215-c11063472cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:41.867497 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 589/1177] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:41.891921 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3cf8d-3611-43fd-96bb-ee2ff178723f None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:41.903904 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3cf8d-3611-43fd-96bb-ee2ff178723f None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:41.908221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf4754-abf7-4dfc-844f-9b42f07006c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:41.908988 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf4754-abf7-4dfc-844f-9b42f07006c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:41.909275 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf4754-abf7-4dfc-844f-9b42f07006c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:41.909551 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf4754-abf7-4dfc-844f-9b42f07006c2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:41.920684 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf4754-abf7-4dfc-844f-9b42f07006c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:20:41.927611 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-adbf4754-abf7-4dfc-844f-9b42f07006c2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:20:41.928724 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 589/1178] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:20:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:41.935362 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a316a-bd54-40ef-a215-c11063472cd0 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:41.944117 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a316a-bd54-40ef-a215-c11063472cd0 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:41.948516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd32a4-8263-4444-9ba2-9b05bfa25fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:41.949157 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd32a4-8263-4444-9ba2-9b05bfa25fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:41.949441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd32a4-8263-4444-9ba2-9b05bfa25fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:41.949719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd32a4-8263-4444-9ba2-9b05bfa25fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:41.950479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd32a4-8263-4444-9ba2-9b05bfa25fa5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:41.950787 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd32a4-8263-4444-9ba2-9b05bfa25fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:41.952411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd32a4-8263-4444-9ba2-9b05bfa25fa5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:41.960384 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 590/1179] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:20:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:41.966378 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf4754-abf7-4dfc-844f-9b42f07006c2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:41.975564 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf4754-abf7-4dfc-844f-9b42f07006c2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:41.979965 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12418ec3-e278-43fc-b152-2b6c74ed145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:41.981288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12418ec3-e278-43fc-b152-2b6c74ed145f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:41.981571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12418ec3-e278-43fc-b152-2b6c74ed145f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:41.981842 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12418ec3-e278-43fc-b152-2b6c74ed145f admin admin] PATH_INFO: `/v3/users/57ddd5a2acea486ca6b057d33191e487` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:41.995682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12418ec3-e278-43fc-b152-2b6c74ed145f admin admin] RBAC: Authorizing `identity:get_user(user_id=57ddd5a2acea486ca6b057d33191e487)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:41.998433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12418ec3-e278-43fc-b152-2b6c74ed145f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:42.000045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 590/1180] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:41 2021] GET /identity/v3/users/57ddd5a2acea486ca6b057d33191e487 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:42.005778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd32a4-8263-4444-9ba2-9b05bfa25fa5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:42.014999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd32a4-8263-4444-9ba2-9b05bfa25fa5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:42.019377 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ec527-2de5-46e3-8632-35be8213d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:42.019979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ec527-2de5-46e3-8632-35be8213d9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:42.020282 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ec527-2de5-46e3-8632-35be8213d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:42.020556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ec527-2de5-46e3-8632-35be8213d9f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:42.028518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ec527-2de5-46e3-8632-35be8213d9f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:42.030212 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ec527-2de5-46e3-8632-35be8213d9f1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:42.038729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 591/1181] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:20:42 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:20:42.045355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12418ec3-e278-43fc-b152-2b6c74ed145f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:42.054463 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12418ec3-e278-43fc-b152-2b6c74ed145f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:42.058965 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0c94e-504f-49b3-b78e-416bf253a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:42.059779 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0c94e-504f-49b3-b78e-416bf253a8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:42.060063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0c94e-504f-49b3-b78e-416bf253a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:42.060342 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0c94e-504f-49b3-b78e-416bf253a8a7 admin admin] PATH_INFO: `/v3/projects/7b6132d76d98428ebf6fb4194498ce9f` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:42.061516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0c94e-504f-49b3-b78e-416bf253a8a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=7b6132d76d98428ebf6fb4194498ce9f)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:42.063543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0c94e-504f-49b3-b78e-416bf253a8a7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:42.065148 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 591/1182] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:20:42 2021] GET /identity/v3/projects/7b6132d76d98428ebf6fb4194498ce9f => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:42.070929 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ec527-2de5-46e3-8632-35be8213d9f1 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:42.079053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ec527-2de5-46e3-8632-35be8213d9f1 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:42.083398 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2b213-5dc2-4a30-8143-82d1a85299e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:42.083988 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2b213-5dc2-4a30-8143-82d1a85299e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:42.084266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2b213-5dc2-4a30-8143-82d1a85299e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:42.084540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2b213-5dc2-4a30-8143-82d1a85299e6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:42.085349 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2b213-5dc2-4a30-8143-82d1a85299e6 admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=7b6132d76d98428ebf6fb4194498ce9f, user.id=57ddd5a2acea486ca6b057d33191e487) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:42.085654 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2b213-5dc2-4a30-8143-82d1a85299e6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:42.087459 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2b213-5dc2-4a30-8143-82d1a85299e6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:42.093158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 592/1183] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:20:42 2021] GET /identity/v3/role_assignments?user.id=57ddd5a2acea486ca6b057d33191e487&scope.project.id=7b6132d76d98428ebf6fb4194498ce9f&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:44.377142 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3990bb-8bdd-41a1-9c67-bb06bc0c1719 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:44.377680 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3990bb-8bdd-41a1-9c67-bb06bc0c1719 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:44.377680 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3990bb-8bdd-41a1-9c67-bb06bc0c1719 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:44.379738 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 592/1184] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:44.385486 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186502a-8b91-47fb-864a-70b44f1be00b None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:44.385910 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186502a-8b91-47fb-864a-70b44f1be00b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:44.386052 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186502a-8b91-47fb-864a-70b44f1be00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:44.404087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-9186502a-8b91-47fb-864a-70b44f1be00b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:44.405270 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9186502a-8b91-47fb-864a-70b44f1be00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:44.412817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 593/1185] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:20:44.436799 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3990bb-8bdd-41a1-9c67-bb06bc0c1719 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:44.448833 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3990bb-8bdd-41a1-9c67-bb06bc0c1719 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:44.453658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2567a6-fc2f-4320-a358-5fbc01db98a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:44.454411 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2567a6-fc2f-4320-a358-5fbc01db98a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:44.454686 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2567a6-fc2f-4320-a358-5fbc01db98a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:44.454994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2567a6-fc2f-4320-a358-5fbc01db98a0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:44.464791 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2567a6-fc2f-4320-a358-5fbc01db98a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:20:44.471534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-da2567a6-fc2f-4320-a358-5fbc01db98a0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:20:44.472649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 593/1186] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:20:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:20:44.478657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186502a-8b91-47fb-864a-70b44f1be00b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:44.487333 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186502a-8b91-47fb-864a-70b44f1be00b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:44.491775 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5135c-bc10-48eb-86c9-0ac30d01cdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:44.492413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5135c-bc10-48eb-86c9-0ac30d01cdda admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:44.492694 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5135c-bc10-48eb-86c9-0ac30d01cdda admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:44.492970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5135c-bc10-48eb-86c9-0ac30d01cdda admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:44.493733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5135c-bc10-48eb-86c9-0ac30d01cdda admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:44.494038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5135c-bc10-48eb-86c9-0ac30d01cdda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:44.495672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5135c-bc10-48eb-86c9-0ac30d01cdda admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:44.505182 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 594/1187] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:20:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:44.511168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2567a6-fc2f-4320-a358-5fbc01db98a0 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:44.521061 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2567a6-fc2f-4320-a358-5fbc01db98a0 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:44.525533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d36b17-8167-4595-9cf0-98b4c6e487ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:44.526361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d36b17-8167-4595-9cf0-98b4c6e487ed admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:44.526683 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d36b17-8167-4595-9cf0-98b4c6e487ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:44.526967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d36b17-8167-4595-9cf0-98b4c6e487ed admin admin] PATH_INFO: `/v3/users/57ddd5a2acea486ca6b057d33191e487` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:44.528188 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d36b17-8167-4595-9cf0-98b4c6e487ed admin admin] RBAC: Authorizing `identity:get_user(user_id=57ddd5a2acea486ca6b057d33191e487)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:44.530281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d36b17-8167-4595-9cf0-98b4c6e487ed admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:44.531888 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 594/1188] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:44 2021] GET /identity/v3/users/57ddd5a2acea486ca6b057d33191e487 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:44.537541 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5135c-bc10-48eb-86c9-0ac30d01cdda admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:44.547035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5135c-bc10-48eb-86c9-0ac30d01cdda admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:44.551440 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4ad53-ab81-4ab5-a60b-52926d4a26bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:44.552244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4ad53-ab81-4ab5-a60b-52926d4a26bf admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:44.552527 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4ad53-ab81-4ab5-a60b-52926d4a26bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:44.552806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4ad53-ab81-4ab5-a60b-52926d4a26bf admin admin] PATH_INFO: `/v3/projects/7b6132d76d98428ebf6fb4194498ce9f` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:44.553967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4ad53-ab81-4ab5-a60b-52926d4a26bf admin admin] RBAC: Authorizing `identity:get_project(project_id=7b6132d76d98428ebf6fb4194498ce9f)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:44.556003 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4ad53-ab81-4ab5-a60b-52926d4a26bf admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:44.557599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 595/1189] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:20:44 2021] GET /identity/v3/projects/7b6132d76d98428ebf6fb4194498ce9f => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:44.563877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d36b17-8167-4595-9cf0-98b4c6e487ed admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:44.573499 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d36b17-8167-4595-9cf0-98b4c6e487ed admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:44.578594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7640c5-ef86-40c1-837f-47a77f3574d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:44.579470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7640c5-ef86-40c1-837f-47a77f3574d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:44.579748 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7640c5-ef86-40c1-837f-47a77f3574d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:44.580024 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7640c5-ef86-40c1-837f-47a77f3574d8 admin admin] PATH_INFO: `/v3/projects/7b6132d76d98428ebf6fb4194498ce9f/users/57ddd5a2acea486ca6b057d33191e487/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:44.581949 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7640c5-ef86-40c1-837f-47a77f3574d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6132d76d98428ebf6fb4194498ce9f, user_id=57ddd5a2acea486ca6b057d33191e487, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:44.584555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7640c5-ef86-40c1-837f-47a77f3574d8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:44.597198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 595/1190] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:20:44 2021] PUT /identity/v3/projects/7b6132d76d98428ebf6fb4194498ce9f/users/57ddd5a2acea486ca6b057d33191e487/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:20:46.882328 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703f877-ea20-4cc3-afa3-aeab7ac84d19 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:46.882901 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703f877-ea20-4cc3-afa3-aeab7ac84d19 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:46.882901 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703f877-ea20-4cc3-afa3-aeab7ac84d19 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:46.884672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 596/1191] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:20:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:20:46.890961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c1c05-d84d-4fe3-a63f-86accc73814b None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:46.891379 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c1c05-d84d-4fe3-a63f-86accc73814b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:46.891519 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c1c05-d84d-4fe3-a63f-86accc73814b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:46.908663 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-be4c1c05-d84d-4fe3-a63f-86accc73814b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:20:46.909826 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-be4c1c05-d84d-4fe3-a63f-86accc73814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:20:46.976511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 596/1192] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:20:46 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:20:47.001566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703f877-ea20-4cc3-afa3-aeab7ac84d19 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:47.014235 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703f877-ea20-4cc3-afa3-aeab7ac84d19 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:47.018568 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1fb85-fa03-4775-a341-02c692990440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:47.019363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1fb85-fa03-4775-a341-02c692990440 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:47.019648 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1fb85-fa03-4775-a341-02c692990440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:47.019927 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1fb85-fa03-4775-a341-02c692990440 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:47.029910 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1fb85-fa03-4775-a341-02c692990440 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:20:47.036675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-0de1fb85-fa03-4775-a341-02c692990440 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:20:47.037798 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 597/1193] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:20:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:20:47.044736 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c1c05-d84d-4fe3-a63f-86accc73814b None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:47.053430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c1c05-d84d-4fe3-a63f-86accc73814b None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:47.057846 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f8851-8a81-4b6e-91a6-3d51492497c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:47.059198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f8851-8a81-4b6e-91a6-3d51492497c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:47.059481 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f8851-8a81-4b6e-91a6-3d51492497c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:47.059756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f8851-8a81-4b6e-91a6-3d51492497c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:47.060506 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f8851-8a81-4b6e-91a6-3d51492497c9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:47.060810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f8851-8a81-4b6e-91a6-3d51492497c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:47.062381 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f8851-8a81-4b6e-91a6-3d51492497c9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:47.070345 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 597/1194] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:20:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:47.076294 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1fb85-fa03-4775-a341-02c692990440 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:47.085993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1fb85-fa03-4775-a341-02c692990440 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:47.090461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817387d-d2af-4b37-ba3a-2265dd3fc74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:47.091296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817387d-d2af-4b37-ba3a-2265dd3fc74f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:47.091582 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817387d-d2af-4b37-ba3a-2265dd3fc74f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:47.091859 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817387d-d2af-4b37-ba3a-2265dd3fc74f admin admin] PATH_INFO: `/v3/users/57ddd5a2acea486ca6b057d33191e487` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:47.093031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817387d-d2af-4b37-ba3a-2265dd3fc74f admin admin] RBAC: Authorizing `identity:get_user(user_id=57ddd5a2acea486ca6b057d33191e487)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:47.095154 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817387d-d2af-4b37-ba3a-2265dd3fc74f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:47.096702 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 598/1195] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Dec 15 13:20:47 2021] GET /identity/v3/users/57ddd5a2acea486ca6b057d33191e487 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:47.102196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f8851-8a81-4b6e-91a6-3d51492497c9 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:47.111629 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f8851-8a81-4b6e-91a6-3d51492497c9 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:47.115999 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20e767-da43-4d8a-b8b2-f72b3b762e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:47.116595 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20e767-da43-4d8a-b8b2-f72b3b762e78 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:47.116875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20e767-da43-4d8a-b8b2-f72b3b762e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:47.117174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20e767-da43-4d8a-b8b2-f72b3b762e78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:47.125230 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20e767-da43-4d8a-b8b2-f72b3b762e78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:47.126925 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20e767-da43-4d8a-b8b2-f72b3b762e78 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:47.135371 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 598/1196] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:20:47 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:20:47.141048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817387d-d2af-4b37-ba3a-2265dd3fc74f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:47.150083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817387d-d2af-4b37-ba3a-2265dd3fc74f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:47.154561 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b490a0-345f-4bd7-a3fd-9981369532f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:47.155381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b490a0-345f-4bd7-a3fd-9981369532f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:47.155671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b490a0-345f-4bd7-a3fd-9981369532f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:47.155937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b490a0-345f-4bd7-a3fd-9981369532f5 admin admin] PATH_INFO: `/v3/projects/7b6132d76d98428ebf6fb4194498ce9f` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:47.157114 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b490a0-345f-4bd7-a3fd-9981369532f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=7b6132d76d98428ebf6fb4194498ce9f)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:47.159122 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b490a0-345f-4bd7-a3fd-9981369532f5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:47.160704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 599/1197] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:20:47 2021] GET /identity/v3/projects/7b6132d76d98428ebf6fb4194498ce9f => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:20:47.166677 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20e767-da43-4d8a-b8b2-f72b3b762e78 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:20:47.176910 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20e767-da43-4d8a-b8b2-f72b3b762e78 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:20:47.181401 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be20340-70ae-4dbd-92eb-fd8681a19767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:20:47.182009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be20340-70ae-4dbd-92eb-fd8681a19767 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:20:47.182285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be20340-70ae-4dbd-92eb-fd8681a19767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:20:47.182555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be20340-70ae-4dbd-92eb-fd8681a19767 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:20:47.183993 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be20340-70ae-4dbd-92eb-fd8681a19767 admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=7b6132d76d98428ebf6fb4194498ce9f, user.id=57ddd5a2acea486ca6b057d33191e487) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:20:47.184305 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be20340-70ae-4dbd-92eb-fd8681a19767 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:20:47.186116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be20340-70ae-4dbd-92eb-fd8681a19767 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:20:47.191700 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 599/1198] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:20:47 2021] GET /identity/v3/role_assignments?user.id=57ddd5a2acea486ca6b057d33191e487&scope.project.id=7b6132d76d98428ebf6fb4194498ce9f&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:45.048131 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b77dd-291a-4e42-906d-f3cbac98a9ea None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:45.048999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b77dd-291a-4e42-906d-f3cbac98a9ea None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:45.048999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b77dd-291a-4e42-906d-f3cbac98a9ea None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:45.055418 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 600/1199] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:21:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:21:45.057507 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2614fb7-2548-4cb0-a488-8b47ec91c848 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:45.057995 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2614fb7-2548-4cb0-a488-8b47ec91c848 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:45.058168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2614fb7-2548-4cb0-a488-8b47ec91c848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:45.088443 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-d2614fb7-2548-4cb0-a488-8b47ec91c848 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:21:45.090014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d2614fb7-2548-4cb0-a488-8b47ec91c848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:21:45.105150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 600/1200] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:21:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:21:45.130186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b77dd-291a-4e42-906d-f3cbac98a9ea None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:45.144416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b77dd-291a-4e42-906d-f3cbac98a9ea None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:45.153504 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fef56-d3cd-496d-9f9a-27d2e24e2d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:45.154523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fef56-d3cd-496d-9f9a-27d2e24e2d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:45.154806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fef56-d3cd-496d-9f9a-27d2e24e2d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:45.155145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fef56-d3cd-496d-9f9a-27d2e24e2d47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:45.166730 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fef56-d3cd-496d-9f9a-27d2e24e2d47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:45.168643 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fef56-d3cd-496d-9f9a-27d2e24e2d47 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:45.187960 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-228fef56-d3cd-496d-9f9a-27d2e24e2d47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:21:45.189415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 601/1201] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:21:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:45.196156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2614fb7-2548-4cb0-a488-8b47ec91c848 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:45.208433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2614fb7-2548-4cb0-a488-8b47ec91c848 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:45.215004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4273dd-ab8f-4990-8823-596f4e338013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:45.216068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4273dd-ab8f-4990-8823-596f4e338013 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:45.216437 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4273dd-ab8f-4990-8823-596f4e338013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:45.216878 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4273dd-ab8f-4990-8823-596f4e338013 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:45.217970 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4273dd-ab8f-4990-8823-596f4e338013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:45.218457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4273dd-ab8f-4990-8823-596f4e338013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:45.220590 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4273dd-ab8f-4990-8823-596f4e338013 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:45.240983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 601/1202] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:21:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:45.241194 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fef56-d3cd-496d-9f9a-27d2e24e2d47 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:45.253653 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fef56-d3cd-496d-9f9a-27d2e24e2d47 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:45.259559 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6a61e-9335-41b1-a9da-6bbfb9f4329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:45.260180 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6a61e-9335-41b1-a9da-6bbfb9f4329d admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:45.260532 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6a61e-9335-41b1-a9da-6bbfb9f4329d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:45.260812 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6a61e-9335-41b1-a9da-6bbfb9f4329d admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:45.261873 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6a61e-9335-41b1-a9da-6bbfb9f4329d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:45.263979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6a61e-9335-41b1-a9da-6bbfb9f4329d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:45.290539 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 602/1203] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Dec 15 13:21:45 2021] POST /identity/v3/users => generated 251 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:21:48.051600 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d687d76-cc94-4d09-bb7f-c840faf26834 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:48.052714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d687d76-cc94-4d09-bb7f-c840faf26834 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:48.052714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d687d76-cc94-4d09-bb7f-c840faf26834 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:48.054456 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 602/1204] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:21:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:21:48.060999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5e1a5-0f47-47d5-8378-d4d62d241450 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:48.061501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5e1a5-0f47-47d5-8378-d4d62d241450 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:48.061671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5e1a5-0f47-47d5-8378-d4d62d241450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:48.081457 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e4d5e1a5-0f47-47d5-8378-d4d62d241450 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:21:48.082952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e4d5e1a5-0f47-47d5-8378-d4d62d241450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:21:48.091887 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 603/1205] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:21:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:21:48.120242 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d687d76-cc94-4d09-bb7f-c840faf26834 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:48.136429 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d687d76-cc94-4d09-bb7f-c840faf26834 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:48.142031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcae3a5-7b2b-4066-a53d-f340407e2c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:48.142962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcae3a5-7b2b-4066-a53d-f340407e2c57 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:48.143309 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcae3a5-7b2b-4066-a53d-f340407e2c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:48.143591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcae3a5-7b2b-4066-a53d-f340407e2c57 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:48.156897 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcae3a5-7b2b-4066-a53d-f340407e2c57 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:21:48.164074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-ddcae3a5-7b2b-4066-a53d-f340407e2c57 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:21:48.165450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 603/1206] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:21:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:48.173484 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5e1a5-0f47-47d5-8378-d4d62d241450 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:48.183605 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5e1a5-0f47-47d5-8378-d4d62d241450 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:48.189620 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21456cbd-75c0-41eb-92c7-70f0f4889f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:48.190445 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21456cbd-75c0-41eb-92c7-70f0f4889f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:48.190731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21456cbd-75c0-41eb-92c7-70f0f4889f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:48.191042 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21456cbd-75c0-41eb-92c7-70f0f4889f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:48.191815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21456cbd-75c0-41eb-92c7-70f0f4889f30 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:48.192130 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21456cbd-75c0-41eb-92c7-70f0f4889f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:48.193736 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21456cbd-75c0-41eb-92c7-70f0f4889f30 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:48.204386 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 604/1207] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:21:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:48.210840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcae3a5-7b2b-4066-a53d-f340407e2c57 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:48.222181 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcae3a5-7b2b-4066-a53d-f340407e2c57 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:48.226883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cdae3-b3ff-48a7-8ec9-7ea3f4b5e6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:48.227708 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cdae3-b3ff-48a7-8ec9-7ea3f4b5e6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:48.228005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cdae3-b3ff-48a7-8ec9-7ea3f4b5e6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:48.228277 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cdae3-b3ff-48a7-8ec9-7ea3f4b5e6c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:48.243118 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cdae3-b3ff-48a7-8ec9-7ea3f4b5e6c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:48.243689 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cdae3-b3ff-48a7-8ec9-7ea3f4b5e6c9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:48.262737 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-f47cdae3-b3ff-48a7-8ec9-7ea3f4b5e6c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:21:48.263958 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 604/1208] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:21:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:48.270788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21456cbd-75c0-41eb-92c7-70f0f4889f30 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:48.281792 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21456cbd-75c0-41eb-92c7-70f0f4889f30 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:48.291086 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1b850-e2db-496e-a82e-d046b5b063a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:48.291086 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1b850-e2db-496e-a82e-d046b5b063a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:48.291086 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1b850-e2db-496e-a82e-d046b5b063a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:48.291086 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1b850-e2db-496e-a82e-d046b5b063a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:48.291491 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1b850-e2db-496e-a82e-d046b5b063a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:48.291491 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1b850-e2db-496e-a82e-d046b5b063a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:48.292147 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1b850-e2db-496e-a82e-d046b5b063a2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:48.307065 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 605/1209] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:21:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:21:48.315922 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cdae3-b3ff-48a7-8ec9-7ea3f4b5e6c9 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:48.326331 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cdae3-b3ff-48a7-8ec9-7ea3f4b5e6c9 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:48.334814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d375aa-9cf1-4d41-bd07-23f581cffd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:48.335741 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d375aa-9cf1-4d41-bd07-23f581cffd81 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:48.336047 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d375aa-9cf1-4d41-bd07-23f581cffd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:48.336454 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d375aa-9cf1-4d41-bd07-23f581cffd81 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:48.346532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d375aa-9cf1-4d41-bd07-23f581cffd81 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:48.348853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d375aa-9cf1-4d41-bd07-23f581cffd81 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:48.366290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-e0d375aa-9cf1-4d41-bd07-23f581cffd81 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 13:21:48.367559 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 605/1210] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:21:48 2021] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:48.374249 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1b850-e2db-496e-a82e-d046b5b063a2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:48.385937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1b850-e2db-496e-a82e-d046b5b063a2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:48.391317 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cc270-2cdd-49c4-b252-22b9857fabef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:48.392108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cc270-2cdd-49c4-b252-22b9857fabef admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:48.392474 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cc270-2cdd-49c4-b252-22b9857fabef admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:48.392756 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cc270-2cdd-49c4-b252-22b9857fabef admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:48.395929 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cc270-2cdd-49c4-b252-22b9857fabef admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:48.395929 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cc270-2cdd-49c4-b252-22b9857fabef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:48.396175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cc270-2cdd-49c4-b252-22b9857fabef admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:48.418498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 606/1211] 10.222.0.60 () {56 vars in 1164 bytes} [Wed Dec 15 13:21:48 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:48.425517 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d375aa-9cf1-4d41-bd07-23f581cffd81 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:48.436187 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d375aa-9cf1-4d41-bd07-23f581cffd81 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:48.442074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec44358-04b2-4bde-89ed-5e0ba3f254b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:48.442879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec44358-04b2-4bde-89ed-5e0ba3f254b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:48.443226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec44358-04b2-4bde-89ed-5e0ba3f254b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:48.443607 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec44358-04b2-4bde-89ed-5e0ba3f254b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:48.455111 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec44358-04b2-4bde-89ed-5e0ba3f254b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:48.457119 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec44358-04b2-4bde-89ed-5e0ba3f254b1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:48.469162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 606/1212] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:21:48 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:21:48.479978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cc270-2cdd-49c4-b252-22b9857fabef admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:48.495502 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cc270-2cdd-49c4-b252-22b9857fabef admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:48.501383 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c48eb0-4954-41be-bdde-4cfdeb668bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:48.502254 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48eb0-4954-41be-bdde-4cfdeb668bad admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:48.502537 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48eb0-4954-41be-bdde-4cfdeb668bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:48.502836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48eb0-4954-41be-bdde-4cfdeb668bad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:48.517390 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c48eb0-4954-41be-bdde-4cfdeb668bad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:48.521044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c48eb0-4954-41be-bdde-4cfdeb668bad admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:48.551500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-70c48eb0-4954-41be-bdde-4cfdeb668bad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:21:48.553681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 607/1213] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:21:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:48.559797 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec44358-04b2-4bde-89ed-5e0ba3f254b1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:48.569709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec44358-04b2-4bde-89ed-5e0ba3f254b1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:48.574601 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188321c-ca03-47e5-9fd2-e8d879afb91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:48.575290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188321c-ca03-47e5-9fd2-e8d879afb91e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:48.575609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188321c-ca03-47e5-9fd2-e8d879afb91e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:48.575892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188321c-ca03-47e5-9fd2-e8d879afb91e admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:48.576643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188321c-ca03-47e5-9fd2-e8d879afb91e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:48.577065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188321c-ca03-47e5-9fd2-e8d879afb91e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:48.579246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188321c-ca03-47e5-9fd2-e8d879afb91e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:48.594153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 607/1214] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:21:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:48.599436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c48eb0-4954-41be-bdde-4cfdeb668bad admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:48.610872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c48eb0-4954-41be-bdde-4cfdeb668bad admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:48.616322 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c33023-784b-4925-9473-89593409cb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:48.617654 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c33023-784b-4925-9473-89593409cb77 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:48.617763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c33023-784b-4925-9473-89593409cb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:48.618027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c33023-784b-4925-9473-89593409cb77 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:48.625818 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c33023-784b-4925-9473-89593409cb77 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:48.628188 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c33023-784b-4925-9473-89593409cb77 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:48.643816 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-39c33023-784b-4925-9473-89593409cb77 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:21:48.646882 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 608/1215] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:21:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:48.651509 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188321c-ca03-47e5-9fd2-e8d879afb91e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:48.662577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188321c-ca03-47e5-9fd2-e8d879afb91e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:48.668053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ecfa1-a2c8-432a-8c1d-30fc1764e6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:48.668857 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ecfa1-a2c8-432a-8c1d-30fc1764e6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:48.669141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ecfa1-a2c8-432a-8c1d-30fc1764e6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:48.669421 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ecfa1-a2c8-432a-8c1d-30fc1764e6a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:48.670295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ecfa1-a2c8-432a-8c1d-30fc1764e6a6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:48.670611 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ecfa1-a2c8-432a-8c1d-30fc1764e6a6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:48.672954 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ecfa1-a2c8-432a-8c1d-30fc1764e6a6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:48.690208 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 608/1216] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:21:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:21:48.696817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c33023-784b-4925-9473-89593409cb77 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:48.712030 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c33023-784b-4925-9473-89593409cb77 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:48.717523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475e56a-39b2-44f8-8a0f-33437fc30eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:48.718787 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475e56a-39b2-44f8-8a0f-33437fc30eff admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:48.719099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475e56a-39b2-44f8-8a0f-33437fc30eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:48.719372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475e56a-39b2-44f8-8a0f-33437fc30eff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:48.720253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475e56a-39b2-44f8-8a0f-33437fc30eff admin admin] RBAC: Adding query filter params (role.id=bf8b5076a92449fba2f54db6ae519ba6, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=8e05695f0d91463bae1f2a67a58cb54b) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:48.720636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475e56a-39b2-44f8-8a0f-33437fc30eff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:48.722939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475e56a-39b2-44f8-8a0f-33437fc30eff admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:48.729647 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 609/1217] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:21:48 2021] GET /identity/v3/role_assignments?user.id=8e05695f0d91463bae1f2a67a58cb54b&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=bf8b5076a92449fba2f54db6ae519ba6 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:51.282267 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24eb66-8dc8-407c-967c-4421b2e5e31f None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:51.282936 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24eb66-8dc8-407c-967c-4421b2e5e31f None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:51.282936 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24eb66-8dc8-407c-967c-4421b2e5e31f None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:51.284839 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 609/1218] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:21:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:21:51.290863 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5a744-29b5-4831-95d3-0a8e60df57cc None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:51.291287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5a744-29b5-4831-95d3-0a8e60df57cc None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:51.291444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5a744-29b5-4831-95d3-0a8e60df57cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:51.311550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-3fa5a744-29b5-4831-95d3-0a8e60df57cc None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:21:51.313419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-3fa5a744-29b5-4831-95d3-0a8e60df57cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:21:51.322354 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 610/1219] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:21:51 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:21:51.351327 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24eb66-8dc8-407c-967c-4421b2e5e31f None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:51.366554 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24eb66-8dc8-407c-967c-4421b2e5e31f None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:51.371684 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7367266-2483-459d-99fa-0c450e44c717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:51.372500 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7367266-2483-459d-99fa-0c450e44c717 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:51.372824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7367266-2483-459d-99fa-0c450e44c717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:51.373078 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7367266-2483-459d-99fa-0c450e44c717 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:51.384179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7367266-2483-459d-99fa-0c450e44c717 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:21:51.391878 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-c7367266-2483-459d-99fa-0c450e44c717 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:21:51.393062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 610/1220] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:21:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:51.400181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5a744-29b5-4831-95d3-0a8e60df57cc None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:51.409499 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5a744-29b5-4831-95d3-0a8e60df57cc None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:51.414173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc4b13-732c-44a8-887c-d0522a329ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:51.414823 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc4b13-732c-44a8-887c-d0522a329ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:51.415142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc4b13-732c-44a8-887c-d0522a329ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:51.415458 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc4b13-732c-44a8-887c-d0522a329ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:51.416340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc4b13-732c-44a8-887c-d0522a329ad1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:51.416649 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc4b13-732c-44a8-887c-d0522a329ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:51.418545 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc4b13-732c-44a8-887c-d0522a329ad1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:51.429008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 611/1221] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:21:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:51.436117 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7367266-2483-459d-99fa-0c450e44c717 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:51.448732 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7367266-2483-459d-99fa-0c450e44c717 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:51.454042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5326f9-f1b9-4fa5-ae31-620d040f9c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:51.455154 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5326f9-f1b9-4fa5-ae31-620d040f9c83 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:51.455467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5326f9-f1b9-4fa5-ae31-620d040f9c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:51.455783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5326f9-f1b9-4fa5-ae31-620d040f9c83 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:51.467060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5326f9-f1b9-4fa5-ae31-620d040f9c83 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:51.469553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5326f9-f1b9-4fa5-ae31-620d040f9c83 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:51.488701 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-2a5326f9-f1b9-4fa5-ae31-620d040f9c83 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:21:51.490086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 611/1222] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:21:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:51.496899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc4b13-732c-44a8-887c-d0522a329ad1 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:51.507826 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc4b13-732c-44a8-887c-d0522a329ad1 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:51.512677 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5715a-7282-4c29-b733-8daf1ad4f11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:51.513319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5715a-7282-4c29-b733-8daf1ad4f11e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:51.513605 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5715a-7282-4c29-b733-8daf1ad4f11e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:51.513881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5715a-7282-4c29-b733-8daf1ad4f11e admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:51.515140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5715a-7282-4c29-b733-8daf1ad4f11e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:51.515431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5715a-7282-4c29-b733-8daf1ad4f11e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:51.517269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5715a-7282-4c29-b733-8daf1ad4f11e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:51.530395 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 612/1223] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:21:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:51.537525 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5326f9-f1b9-4fa5-ae31-620d040f9c83 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:51.548898 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5326f9-f1b9-4fa5-ae31-620d040f9c83 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:51.553987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67f1a3-c0f3-4595-a80e-30d6ae1f4d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:51.554776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f1a3-c0f3-4595-a80e-30d6ae1f4d25 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:51.555090 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f1a3-c0f3-4595-a80e-30d6ae1f4d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:51.555369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f1a3-c0f3-4595-a80e-30d6ae1f4d25 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:51.563477 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67f1a3-c0f3-4595-a80e-30d6ae1f4d25 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:51.565472 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67f1a3-c0f3-4595-a80e-30d6ae1f4d25 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:51.580215 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-4c67f1a3-c0f3-4595-a80e-30d6ae1f4d25 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 13:21:51.581602 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 612/1224] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:21:51 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:51.588208 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5715a-7282-4c29-b733-8daf1ad4f11e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:51.603540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5715a-7282-4c29-b733-8daf1ad4f11e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:51.608380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21889fc-b3a0-4fd6-b16f-be2bca300924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:51.609743 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21889fc-b3a0-4fd6-b16f-be2bca300924 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:51.610030 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21889fc-b3a0-4fd6-b16f-be2bca300924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:51.610307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21889fc-b3a0-4fd6-b16f-be2bca300924 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:51.611394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21889fc-b3a0-4fd6-b16f-be2bca300924 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:51.611838 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21889fc-b3a0-4fd6-b16f-be2bca300924 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:51.614633 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21889fc-b3a0-4fd6-b16f-be2bca300924 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:51.638659 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 613/1225] 10.222.0.60 () {56 vars in 1164 bytes} [Wed Dec 15 13:21:51 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:51.648290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67f1a3-c0f3-4595-a80e-30d6ae1f4d25 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:51.660703 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67f1a3-c0f3-4595-a80e-30d6ae1f4d25 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:51.666194 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9b2f4-0c64-44ae-800a-faca52107853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:51.667084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9b2f4-0c64-44ae-800a-faca52107853 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:51.667429 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9b2f4-0c64-44ae-800a-faca52107853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:51.667744 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9b2f4-0c64-44ae-800a-faca52107853 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:51.681969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9b2f4-0c64-44ae-800a-faca52107853 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:51.685200 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9b2f4-0c64-44ae-800a-faca52107853 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:51.720025 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-e2d9b2f4-0c64-44ae-800a-faca52107853 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:21:51.721755 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 613/1226] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:21:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:51.729236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21889fc-b3a0-4fd6-b16f-be2bca300924 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:51.743346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21889fc-b3a0-4fd6-b16f-be2bca300924 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:51.750233 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dffbb-4258-4bc4-ba91-b27f5e34e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:51.751296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dffbb-4258-4bc4-ba91-b27f5e34e1ef admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:51.751783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dffbb-4258-4bc4-ba91-b27f5e34e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:51.752268 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dffbb-4258-4bc4-ba91-b27f5e34e1ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:51.753301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dffbb-4258-4bc4-ba91-b27f5e34e1ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:51.753763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dffbb-4258-4bc4-ba91-b27f5e34e1ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:51.755927 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dffbb-4258-4bc4-ba91-b27f5e34e1ef admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:51.772230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 614/1227] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:21:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:51.778464 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9b2f4-0c64-44ae-800a-faca52107853 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:51.788686 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9b2f4-0c64-44ae-800a-faca52107853 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:51.793664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8094d-8bf3-4b69-addb-1276a2fdf6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:51.794424 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8094d-8bf3-4b69-addb-1276a2fdf6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:51.794699 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8094d-8bf3-4b69-addb-1276a2fdf6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:51.795006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8094d-8bf3-4b69-addb-1276a2fdf6b5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:51.802993 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8094d-8bf3-4b69-addb-1276a2fdf6b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:51.804935 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8094d-8bf3-4b69-addb-1276a2fdf6b5 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:51.819773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-2ba8094d-8bf3-4b69-addb-1276a2fdf6b5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:21:51.821019 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 614/1228] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:21:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:51.827526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dffbb-4258-4bc4-ba91-b27f5e34e1ef admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:51.838001 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dffbb-4258-4bc4-ba91-b27f5e34e1ef admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:51.843239 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428548ff-3cf3-4bdb-a62b-3f268f49c0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:51.844392 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428548ff-3cf3-4bdb-a62b-3f268f49c0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:51.844677 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428548ff-3cf3-4bdb-a62b-3f268f49c0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:51.845011 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428548ff-3cf3-4bdb-a62b-3f268f49c0b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:51.845762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428548ff-3cf3-4bdb-a62b-3f268f49c0b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:51.846075 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428548ff-3cf3-4bdb-a62b-3f268f49c0b6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:51.847981 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428548ff-3cf3-4bdb-a62b-3f268f49c0b6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:51.860892 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 615/1229] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:21:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:21:51.867204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8094d-8bf3-4b69-addb-1276a2fdf6b5 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:51.877344 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8094d-8bf3-4b69-addb-1276a2fdf6b5 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:51.881762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bbe81-b694-464d-8cd2-a815b39ef279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:51.882720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bbe81-b694-464d-8cd2-a815b39ef279 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:51.882971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bbe81-b694-464d-8cd2-a815b39ef279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:51.883292 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bbe81-b694-464d-8cd2-a815b39ef279 admin admin] PATH_INFO: `/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/8e05695f0d91463bae1f2a67a58cb54b/roles/bf8b5076a92449fba2f54db6ae519ba6` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:51.899600 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bbe81-b694-464d-8cd2-a815b39ef279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f200887ca764a72b0640476fe3eb41b, user_id=8e05695f0d91463bae1f2a67a58cb54b, role_id=bf8b5076a92449fba2f54db6ae519ba6)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:51.902685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bbe81-b694-464d-8cd2-a815b39ef279 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:51.917245 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 615/1230] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:21:51 2021] PUT /identity/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/8e05695f0d91463bae1f2a67a58cb54b/roles/bf8b5076a92449fba2f54db6ae519ba6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:21:54.690939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be931-42e2-44f6-8f0c-4d498e8567a5 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:54.690939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be931-42e2-44f6-8f0c-4d498e8567a5 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:54.691651 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be931-42e2-44f6-8f0c-4d498e8567a5 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:54.693361 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 616/1231] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:21:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:21:54.699629 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f44666-f545-4fda-9a1a-659c57b66cb8 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:54.700058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f44666-f545-4fda-9a1a-659c57b66cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:54.700195 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f44666-f545-4fda-9a1a-659c57b66cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:54.720207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-35f44666-f545-4fda-9a1a-659c57b66cb8 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:21:54.721555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-35f44666-f545-4fda-9a1a-659c57b66cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:21:54.784553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 616/1232] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:21:54 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:21:54.811934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51be931-42e2-44f6-8f0c-4d498e8567a5 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:54.824522 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51be931-42e2-44f6-8f0c-4d498e8567a5 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:54.829226 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3d8d4-a3cd-4379-a353-2429bb73628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:54.830105 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3d8d4-a3cd-4379-a353-2429bb73628b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:54.830450 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3d8d4-a3cd-4379-a353-2429bb73628b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:54.830790 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3d8d4-a3cd-4379-a353-2429bb73628b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:54.842759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3d8d4-a3cd-4379-a353-2429bb73628b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:21:54.850104 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-edc3d8d4-a3cd-4379-a353-2429bb73628b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:21:54.851291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 617/1233] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Dec 15 13:21:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:54.858038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f44666-f545-4fda-9a1a-659c57b66cb8 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:54.869088 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f44666-f545-4fda-9a1a-659c57b66cb8 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:54.874247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d3abf-4070-4d6f-b95a-e7fd5cca96ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:54.875095 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d3abf-4070-4d6f-b95a-e7fd5cca96ef admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:54.875446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d3abf-4070-4d6f-b95a-e7fd5cca96ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:54.875708 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d3abf-4070-4d6f-b95a-e7fd5cca96ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:54.876649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d3abf-4070-4d6f-b95a-e7fd5cca96ef admin admin] RBAC: Adding query filter params (name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:54.877029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d3abf-4070-4d6f-b95a-e7fd5cca96ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:54.878728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d3abf-4070-4d6f-b95a-e7fd5cca96ef admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:54.887815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 617/1234] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Dec 15 13:21:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:54.895506 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3d8d4-a3cd-4379-a353-2429bb73628b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:54.906036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3d8d4-a3cd-4379-a353-2429bb73628b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:54.911938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e2527-4df7-47ea-8358-9badd5150489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:54.912713 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2527-4df7-47ea-8358-9badd5150489 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:54.912998 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2527-4df7-47ea-8358-9badd5150489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:54.913275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2527-4df7-47ea-8358-9badd5150489 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:54.925250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e2527-4df7-47ea-8358-9badd5150489 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:54.927577 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e2527-4df7-47ea-8358-9badd5150489 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:54.946424 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-375e2527-4df7-47ea-8358-9badd5150489 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:21:54.947755 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 618/1235] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:21:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:54.958049 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d3abf-4070-4d6f-b95a-e7fd5cca96ef admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:54.967951 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d3abf-4070-4d6f-b95a-e7fd5cca96ef admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:54.973223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347e66e-9d94-4472-9be9-2f1fb207d6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:54.973878 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347e66e-9d94-4472-9be9-2f1fb207d6ba admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:54.974161 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347e66e-9d94-4472-9be9-2f1fb207d6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:54.974443 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347e66e-9d94-4472-9be9-2f1fb207d6ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:54.975219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347e66e-9d94-4472-9be9-2f1fb207d6ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:54.975530 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347e66e-9d94-4472-9be9-2f1fb207d6ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:54.977128 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347e66e-9d94-4472-9be9-2f1fb207d6ba admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:54.989835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 618/1236] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:21:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:54.996283 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e2527-4df7-47ea-8358-9badd5150489 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:55.007729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e2527-4df7-47ea-8358-9badd5150489 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:55.012345 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d1b78-b763-4f22-8100-18c6f62e1638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:55.013301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1b78-b763-4f22-8100-18c6f62e1638 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:55.013583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1b78-b763-4f22-8100-18c6f62e1638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:55.013861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1b78-b763-4f22-8100-18c6f62e1638 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:55.022330 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d1b78-b763-4f22-8100-18c6f62e1638 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:55.024402 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d1b78-b763-4f22-8100-18c6f62e1638 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:55.038898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-9f6d1b78-b763-4f22-8100-18c6f62e1638 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 13:21:55.040050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 619/1237] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:21:54 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:55.046787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347e66e-9d94-4472-9be9-2f1fb207d6ba admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:55.059996 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347e66e-9d94-4472-9be9-2f1fb207d6ba admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:55.065325 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2b290-c001-46fe-81f6-e03e45452a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:55.065989 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b290-c001-46fe-81f6-e03e45452a6a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:55.066272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b290-c001-46fe-81f6-e03e45452a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:55.066546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b290-c001-46fe-81f6-e03e45452a6a admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:55.067436 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2b290-c001-46fe-81f6-e03e45452a6a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:55.067743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2b290-c001-46fe-81f6-e03e45452a6a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:55.069786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2b290-c001-46fe-81f6-e03e45452a6a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:55.089239 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 619/1238] 10.222.0.60 () {56 vars in 1164 bytes} [Wed Dec 15 13:21:55 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:55.095984 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d1b78-b763-4f22-8100-18c6f62e1638 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:55.105723 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d1b78-b763-4f22-8100-18c6f62e1638 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:55.111325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a29229-06ee-43f5-a547-40fdec4af0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:55.112000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a29229-06ee-43f5-a547-40fdec4af0cf admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:55.112289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a29229-06ee-43f5-a547-40fdec4af0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:55.112610 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a29229-06ee-43f5-a547-40fdec4af0cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:55.120885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a29229-06ee-43f5-a547-40fdec4af0cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:55.122758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a29229-06ee-43f5-a547-40fdec4af0cf admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:55.132433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 620/1239] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:21:55 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:21:55.139087 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2b290-c001-46fe-81f6-e03e45452a6a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:55.149803 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2b290-c001-46fe-81f6-e03e45452a6a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:55.154704 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cdb0e-aefa-4112-8109-5dcc301393da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:55.155564 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cdb0e-aefa-4112-8109-5dcc301393da admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:55.155891 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cdb0e-aefa-4112-8109-5dcc301393da admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:55.156228 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cdb0e-aefa-4112-8109-5dcc301393da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:55.167362 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cdb0e-aefa-4112-8109-5dcc301393da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:55.169222 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cdb0e-aefa-4112-8109-5dcc301393da admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:55.185957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-918cdb0e-aefa-4112-8109-5dcc301393da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:21:55.187180 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 620/1240] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:21:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:55.193374 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a29229-06ee-43f5-a547-40fdec4af0cf admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:55.203499 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a29229-06ee-43f5-a547-40fdec4af0cf admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:55.208301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced47bd-845b-4438-b760-02baf66a6afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:55.209032 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced47bd-845b-4438-b760-02baf66a6afc admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:55.209312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced47bd-845b-4438-b760-02baf66a6afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:55.209588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced47bd-845b-4438-b760-02baf66a6afc admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:55.210324 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced47bd-845b-4438-b760-02baf66a6afc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:55.210634 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced47bd-845b-4438-b760-02baf66a6afc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:55.212265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced47bd-845b-4438-b760-02baf66a6afc admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:55.224138 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 621/1241] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:21:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:55.230150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cdb0e-aefa-4112-8109-5dcc301393da admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:55.240692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cdb0e-aefa-4112-8109-5dcc301393da admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:55.245866 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6a058-026a-459a-b762-ab4ced86421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:55.246636 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6a058-026a-459a-b762-ab4ced86421f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:55.246942 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6a058-026a-459a-b762-ab4ced86421f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:55.247213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6a058-026a-459a-b762-ab4ced86421f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:55.256039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6a058-026a-459a-b762-ab4ced86421f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:55.258297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6a058-026a-459a-b762-ab4ced86421f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:55.274292 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-b2e6a058-026a-459a-b762-ab4ced86421f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:21:55.276172 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 621/1242] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:21:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:55.281832 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced47bd-845b-4438-b760-02baf66a6afc admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:55.292099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced47bd-845b-4438-b760-02baf66a6afc admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:55.297731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ee742-daf6-4f66-8994-2bc98d555c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:55.298726 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ee742-daf6-4f66-8994-2bc98d555c27 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:55.298942 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ee742-daf6-4f66-8994-2bc98d555c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:55.299262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ee742-daf6-4f66-8994-2bc98d555c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:55.300108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ee742-daf6-4f66-8994-2bc98d555c27 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:55.300434 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ee742-daf6-4f66-8994-2bc98d555c27 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:55.302378 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ee742-daf6-4f66-8994-2bc98d555c27 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:55.315721 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 622/1243] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:21:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:55.324002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6a058-026a-459a-b762-ab4ced86421f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:55.340240 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6a058-026a-459a-b762-ab4ced86421f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:55.346994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dbc4a-abbe-4023-83c1-cafe75f4faa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:55.347865 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dbc4a-abbe-4023-83c1-cafe75f4faa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:55.348215 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dbc4a-abbe-4023-83c1-cafe75f4faa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:55.348554 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dbc4a-abbe-4023-83c1-cafe75f4faa1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:55.349786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dbc4a-abbe-4023-83c1-cafe75f4faa1 admin admin] RBAC: Adding query filter params (role.id=bf8b5076a92449fba2f54db6ae519ba6, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=8e05695f0d91463bae1f2a67a58cb54b) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:55.350171 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dbc4a-abbe-4023-83c1-cafe75f4faa1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:55.352580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dbc4a-abbe-4023-83c1-cafe75f4faa1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:55.361438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 622/1244] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:21:55 2021] GET /identity/v3/role_assignments?user.id=8e05695f0d91463bae1f2a67a58cb54b&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=bf8b5076a92449fba2f54db6ae519ba6 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:57.860582 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7611012-2046-463f-921a-c19ebf2ff277 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:57.861130 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7611012-2046-463f-921a-c19ebf2ff277 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:57.861130 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7611012-2046-463f-921a-c19ebf2ff277 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:57.862932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 623/1245] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:21:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:21:57.868719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b683be7-fc5a-49fd-99ea-381d3ab7360d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:57.869138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b683be7-fc5a-49fd-99ea-381d3ab7360d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:57.869265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b683be7-fc5a-49fd-99ea-381d3ab7360d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:57.888818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-9b683be7-fc5a-49fd-99ea-381d3ab7360d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:21:57.890010 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9b683be7-fc5a-49fd-99ea-381d3ab7360d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:21:57.898369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 623/1246] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:21:57 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:21:57.924274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7611012-2046-463f-921a-c19ebf2ff277 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:57.938500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7611012-2046-463f-921a-c19ebf2ff277 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:57.943912 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be961cc-ba3d-44ba-94db-bbc2976d5415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:57.944890 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be961cc-ba3d-44ba-94db-bbc2976d5415 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:57.945262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be961cc-ba3d-44ba-94db-bbc2976d5415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:57.945645 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be961cc-ba3d-44ba-94db-bbc2976d5415 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:57.957954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be961cc-ba3d-44ba-94db-bbc2976d5415 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:21:57.966717 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-8be961cc-ba3d-44ba-94db-bbc2976d5415 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:21:57.968079 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 624/1247] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:21:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:57.975361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b683be7-fc5a-49fd-99ea-381d3ab7360d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:57.984332 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b683be7-fc5a-49fd-99ea-381d3ab7360d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:57.990313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b3664-889d-42d0-af2f-50a19a486108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:57.993398 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b3664-889d-42d0-af2f-50a19a486108 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:57.993683 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b3664-889d-42d0-af2f-50a19a486108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:57.993958 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b3664-889d-42d0-af2f-50a19a486108 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:57.995054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b3664-889d-42d0-af2f-50a19a486108 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:57.995369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b3664-889d-42d0-af2f-50a19a486108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:57.996955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b3664-889d-42d0-af2f-50a19a486108 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:58.006081 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 624/1248] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:21:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:58.016391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be961cc-ba3d-44ba-94db-bbc2976d5415 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:58.028623 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be961cc-ba3d-44ba-94db-bbc2976d5415 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:58.034963 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec7163-2615-4106-bdbf-7042ed65493d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:58.035740 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec7163-2615-4106-bdbf-7042ed65493d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:58.036015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec7163-2615-4106-bdbf-7042ed65493d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:58.036288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec7163-2615-4106-bdbf-7042ed65493d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:58.047794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec7163-2615-4106-bdbf-7042ed65493d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:58.049907 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec7163-2615-4106-bdbf-7042ed65493d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:58.068852 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-a8ec7163-2615-4106-bdbf-7042ed65493d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:21:58.070184 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 625/1249] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:21:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:58.076685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b3664-889d-42d0-af2f-50a19a486108 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:58.087848 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b3664-889d-42d0-af2f-50a19a486108 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:58.093305 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b95a5-b7c4-4959-9f7d-c29d7d2e15e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:58.094499 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b95a5-b7c4-4959-9f7d-c29d7d2e15e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:58.094793 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b95a5-b7c4-4959-9f7d-c29d7d2e15e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:58.095103 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b95a5-b7c4-4959-9f7d-c29d7d2e15e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:58.095838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b95a5-b7c4-4959-9f7d-c29d7d2e15e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:58.096149 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b95a5-b7c4-4959-9f7d-c29d7d2e15e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:58.097957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b95a5-b7c4-4959-9f7d-c29d7d2e15e4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:58.112189 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 625/1250] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:21:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:21:58.119053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec7163-2615-4106-bdbf-7042ed65493d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:58.129935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec7163-2615-4106-bdbf-7042ed65493d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:58.135033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5de52-ce1a-48aa-bfe7-4c1ddfdffeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:58.135811 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5de52-ce1a-48aa-bfe7-4c1ddfdffeab admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:58.136093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5de52-ce1a-48aa-bfe7-4c1ddfdffeab admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:58.136371 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5de52-ce1a-48aa-bfe7-4c1ddfdffeab admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:58.144950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5de52-ce1a-48aa-bfe7-4c1ddfdffeab admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:58.147423 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5de52-ce1a-48aa-bfe7-4c1ddfdffeab admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:58.163601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-f2b5de52-ce1a-48aa-bfe7-4c1ddfdffeab admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 13:21:58.164943 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 626/1251] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:21:58 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:58.171159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b95a5-b7c4-4959-9f7d-c29d7d2e15e4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:58.182249 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b95a5-b7c4-4959-9f7d-c29d7d2e15e4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:58.187245 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcfe0f-d613-41e3-9986-ab625f627c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:58.188786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcfe0f-d613-41e3-9986-ab625f627c79 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:58.188786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcfe0f-d613-41e3-9986-ab625f627c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:58.188786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcfe0f-d613-41e3-9986-ab625f627c79 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:58.190028 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcfe0f-d613-41e3-9986-ab625f627c79 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:58.190028 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcfe0f-d613-41e3-9986-ab625f627c79 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:58.191903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcfe0f-d613-41e3-9986-ab625f627c79 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:58.209699 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 626/1252] 10.222.0.60 () {56 vars in 1164 bytes} [Wed Dec 15 13:21:58 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:58.216224 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5de52-ce1a-48aa-bfe7-4c1ddfdffeab admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:58.226438 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5de52-ce1a-48aa-bfe7-4c1ddfdffeab admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:58.231274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e4c35-ac8a-4b3f-a3de-57af7c63527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:58.231895 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e4c35-ac8a-4b3f-a3de-57af7c63527a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:58.232172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e4c35-ac8a-4b3f-a3de-57af7c63527a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:58.232452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e4c35-ac8a-4b3f-a3de-57af7c63527a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:58.240343 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e4c35-ac8a-4b3f-a3de-57af7c63527a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:58.242121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e4c35-ac8a-4b3f-a3de-57af7c63527a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:58.250968 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 627/1253] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:21:58 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:21:58.257469 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcfe0f-d613-41e3-9986-ab625f627c79 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:58.267654 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcfe0f-d613-41e3-9986-ab625f627c79 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:58.272297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670eeaf-c0ef-406c-9574-d6ffd6a383b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:58.273062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670eeaf-c0ef-406c-9574-d6ffd6a383b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:58.273344 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670eeaf-c0ef-406c-9574-d6ffd6a383b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:58.273617 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670eeaf-c0ef-406c-9574-d6ffd6a383b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:58.284620 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670eeaf-c0ef-406c-9574-d6ffd6a383b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:58.286448 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670eeaf-c0ef-406c-9574-d6ffd6a383b6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:58.303569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-b670eeaf-c0ef-406c-9574-d6ffd6a383b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:21:58.305038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 627/1254] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:21:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:58.310870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e4c35-ac8a-4b3f-a3de-57af7c63527a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:58.320567 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e4c35-ac8a-4b3f-a3de-57af7c63527a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:58.326567 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c26e6-4a41-4108-b452-a30460160845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:58.327356 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c26e6-4a41-4108-b452-a30460160845 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:58.327664 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c26e6-4a41-4108-b452-a30460160845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:58.328083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c26e6-4a41-4108-b452-a30460160845 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:58.329338 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c26e6-4a41-4108-b452-a30460160845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:58.329699 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c26e6-4a41-4108-b452-a30460160845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:58.331662 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c26e6-4a41-4108-b452-a30460160845 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:58.348229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 628/1255] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:21:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:58.355812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670eeaf-c0ef-406c-9574-d6ffd6a383b6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:58.369959 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670eeaf-c0ef-406c-9574-d6ffd6a383b6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:58.375447 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26d3dc-c87e-4394-82c0-0715cd5908b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:58.376227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26d3dc-c87e-4394-82c0-0715cd5908b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:58.376575 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26d3dc-c87e-4394-82c0-0715cd5908b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:58.376856 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26d3dc-c87e-4394-82c0-0715cd5908b7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:58.384640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26d3dc-c87e-4394-82c0-0715cd5908b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:58.386980 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26d3dc-c87e-4394-82c0-0715cd5908b7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:58.400957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-4d26d3dc-c87e-4394-82c0-0715cd5908b7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:21:58.402122 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 628/1256] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:21:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:21:58.409336 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c26e6-4a41-4108-b452-a30460160845 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:58.419810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c26e6-4a41-4108-b452-a30460160845 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:58.425083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31856f-146f-4ae4-8075-98d77b0386ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:58.425880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31856f-146f-4ae4-8075-98d77b0386ed admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:58.426165 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31856f-146f-4ae4-8075-98d77b0386ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:58.426440 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31856f-146f-4ae4-8075-98d77b0386ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:58.427294 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31856f-146f-4ae4-8075-98d77b0386ed admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:58.427607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31856f-146f-4ae4-8075-98d77b0386ed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:58.429476 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31856f-146f-4ae4-8075-98d77b0386ed admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:58.445134 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 629/1257] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:21:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:21:58.452110 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26d3dc-c87e-4394-82c0-0715cd5908b7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:21:58.463883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26d3dc-c87e-4394-82c0-0715cd5908b7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:21:58.468365 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8433308-5bcb-41ba-8d03-7eda176269ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:21:58.469060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8433308-5bcb-41ba-8d03-7eda176269ad admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:21:58.469835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8433308-5bcb-41ba-8d03-7eda176269ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:21:58.470108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8433308-5bcb-41ba-8d03-7eda176269ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:21:58.470976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8433308-5bcb-41ba-8d03-7eda176269ad admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=8e05695f0d91463bae1f2a67a58cb54b) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:21:58.471289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8433308-5bcb-41ba-8d03-7eda176269ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:21:58.473123 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8433308-5bcb-41ba-8d03-7eda176269ad admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:21:58.479444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 629/1258] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:21:58 2021] GET /identity/v3/role_assignments?user.id=8e05695f0d91463bae1f2a67a58cb54b&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:22:00.873739 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415feb-f75a-4dda-afb8-2e137ffd2321 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:00.874326 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415feb-f75a-4dda-afb8-2e137ffd2321 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:00.874326 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415feb-f75a-4dda-afb8-2e137ffd2321 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:00.876159 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 630/1259] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:22:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:22:00.882422 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeb66e-39c4-4755-9a61-ffcf37dbd0e9 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:00.882861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeb66e-39c4-4755-9a61-ffcf37dbd0e9 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:00.883044 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeb66e-39c4-4755-9a61-ffcf37dbd0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:00.903256 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-3baeb66e-39c4-4755-9a61-ffcf37dbd0e9 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:22:00.904521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3baeb66e-39c4-4755-9a61-ffcf37dbd0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:22:00.914299 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 630/1260] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:22:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:22:00.938794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89415feb-f75a-4dda-afb8-2e137ffd2321 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:00.950900 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89415feb-f75a-4dda-afb8-2e137ffd2321 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:00.955490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67a3bd-f742-481c-a4f2-046d6b7bce7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:00.956231 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67a3bd-f742-481c-a4f2-046d6b7bce7c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:00.956507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67a3bd-f742-481c-a4f2-046d6b7bce7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:00.956775 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67a3bd-f742-481c-a4f2-046d6b7bce7c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:00.967836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67a3bd-f742-481c-a4f2-046d6b7bce7c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:22:00.975373 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-fa67a3bd-f742-481c-a4f2-046d6b7bce7c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:22:00.976581 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 631/1261] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:22:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:22:00.983218 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baeb66e-39c4-4755-9a61-ffcf37dbd0e9 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:00.992797 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baeb66e-39c4-4755-9a61-ffcf37dbd0e9 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:00.997490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0700d3-d455-4917-a8b1-be118a34f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:00.998145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0700d3-d455-4917-a8b1-be118a34f355 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:00.998427 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0700d3-d455-4917-a8b1-be118a34f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:00.998709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0700d3-d455-4917-a8b1-be118a34f355 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:00.999500 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0700d3-d455-4917-a8b1-be118a34f355 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:00.999810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0700d3-d455-4917-a8b1-be118a34f355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:01.001403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0700d3-d455-4917-a8b1-be118a34f355 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:01.010456 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 631/1262] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:22:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:22:01.016956 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67a3bd-f742-481c-a4f2-046d6b7bce7c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:01.026866 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67a3bd-f742-481c-a4f2-046d6b7bce7c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:01.031512 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e84ee-6f5c-4987-bef7-8fcc4906742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:01.032800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e84ee-6f5c-4987-bef7-8fcc4906742f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:01.033085 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e84ee-6f5c-4987-bef7-8fcc4906742f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:01.033358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e84ee-6f5c-4987-bef7-8fcc4906742f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:01.044471 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e84ee-6f5c-4987-bef7-8fcc4906742f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:01.046289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e84ee-6f5c-4987-bef7-8fcc4906742f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:01.063939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-cf6e84ee-6f5c-4987-bef7-8fcc4906742f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:22:01.065093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 632/1263] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:22:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:22:01.071643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0700d3-d455-4917-a8b1-be118a34f355 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:01.081361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0700d3-d455-4917-a8b1-be118a34f355 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:01.086179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee59236-964f-40b8-8831-0b4dbb51707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:01.086830 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee59236-964f-40b8-8831-0b4dbb51707c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:01.087132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee59236-964f-40b8-8831-0b4dbb51707c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:01.087406 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee59236-964f-40b8-8831-0b4dbb51707c admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:01.088139 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee59236-964f-40b8-8831-0b4dbb51707c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:01.088447 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee59236-964f-40b8-8831-0b4dbb51707c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:01.090020 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee59236-964f-40b8-8831-0b4dbb51707c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:01.103941 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 632/1264] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:22:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:22:01.111098 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e84ee-6f5c-4987-bef7-8fcc4906742f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:01.121176 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e84ee-6f5c-4987-bef7-8fcc4906742f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:01.125934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e871f1-4c1f-4082-813e-30ada594b1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:01.126715 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e871f1-4c1f-4082-813e-30ada594b1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:01.127021 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e871f1-4c1f-4082-813e-30ada594b1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:01.127299 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e871f1-4c1f-4082-813e-30ada594b1f8 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:01.135510 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e871f1-4c1f-4082-813e-30ada594b1f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:01.137565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e871f1-4c1f-4082-813e-30ada594b1f8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:01.151758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-46e871f1-4c1f-4082-813e-30ada594b1f8 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 13:22:01.152923 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 633/1265] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:22:01 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:22:01.159935 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee59236-964f-40b8-8831-0b4dbb51707c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:01.169625 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee59236-964f-40b8-8831-0b4dbb51707c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:01.174581 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcc04a-456a-42f8-83db-728d335d0174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:01.175269 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcc04a-456a-42f8-83db-728d335d0174 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:01.175630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcc04a-456a-42f8-83db-728d335d0174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:01.175938 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcc04a-456a-42f8-83db-728d335d0174 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:01.176877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcc04a-456a-42f8-83db-728d335d0174 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:01.177212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcc04a-456a-42f8-83db-728d335d0174 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:01.179209 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcc04a-456a-42f8-83db-728d335d0174 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:01.197602 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 633/1266] 10.222.0.60 () {56 vars in 1164 bytes} [Wed Dec 15 13:22:01 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:22:01.204686 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e871f1-4c1f-4082-813e-30ada594b1f8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:01.214710 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e871f1-4c1f-4082-813e-30ada594b1f8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:01.220375 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf325e3-e867-4491-8e0a-53588be9bda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:01.221255 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf325e3-e867-4491-8e0a-53588be9bda6 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:01.221537 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf325e3-e867-4491-8e0a-53588be9bda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:01.221812 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf325e3-e867-4491-8e0a-53588be9bda6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:01.233831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf325e3-e867-4491-8e0a-53588be9bda6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:01.236400 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf325e3-e867-4491-8e0a-53588be9bda6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:01.253248 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-2bf325e3-e867-4491-8e0a-53588be9bda6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:22:01.254423 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 634/1267] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:22:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:22:01.260642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcc04a-456a-42f8-83db-728d335d0174 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:01.270814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcc04a-456a-42f8-83db-728d335d0174 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:01.276272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44becd-95ed-49ba-8766-f40f58a37472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:01.276949 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44becd-95ed-49ba-8766-f40f58a37472 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:01.277546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44becd-95ed-49ba-8766-f40f58a37472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:01.277908 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44becd-95ed-49ba-8766-f40f58a37472 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:01.278984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44becd-95ed-49ba-8766-f40f58a37472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:01.279358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44becd-95ed-49ba-8766-f40f58a37472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:01.281522 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44becd-95ed-49ba-8766-f40f58a37472 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:01.294711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 634/1268] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:22:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:22:01.302745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf325e3-e867-4491-8e0a-53588be9bda6 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:01.314414 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf325e3-e867-4491-8e0a-53588be9bda6 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:01.319317 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ba6f9-1849-47d6-a8ba-932e073dc787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:01.320077 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ba6f9-1849-47d6-a8ba-932e073dc787 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:01.320359 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ba6f9-1849-47d6-a8ba-932e073dc787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:01.320631 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ba6f9-1849-47d6-a8ba-932e073dc787 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:01.330005 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ba6f9-1849-47d6-a8ba-932e073dc787 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:01.332678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ba6f9-1849-47d6-a8ba-932e073dc787 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:01.352281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-247ba6f9-1849-47d6-a8ba-932e073dc787 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:22:01.353822 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 635/1269] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:22:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:22:01.362463 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44becd-95ed-49ba-8766-f40f58a37472 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:01.374054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44becd-95ed-49ba-8766-f40f58a37472 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:01.379338 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c10e8-da40-4429-81fe-1df8f5e6e949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:01.380039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c10e8-da40-4429-81fe-1df8f5e6e949 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:01.380433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c10e8-da40-4429-81fe-1df8f5e6e949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:01.380701 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c10e8-da40-4429-81fe-1df8f5e6e949 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:01.381552 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c10e8-da40-4429-81fe-1df8f5e6e949 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:01.381876 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c10e8-da40-4429-81fe-1df8f5e6e949 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:01.384199 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c10e8-da40-4429-81fe-1df8f5e6e949 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:01.399577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 635/1270] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:22:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:22:01.408294 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ba6f9-1849-47d6-a8ba-932e073dc787 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:01.419003 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ba6f9-1849-47d6-a8ba-932e073dc787 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:01.423817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2460dd5-b372-4aba-8dc6-eab8ca8647cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:01.424968 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460dd5-b372-4aba-8dc6-eab8ca8647cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:01.425270 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460dd5-b372-4aba-8dc6-eab8ca8647cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:01.425564 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460dd5-b372-4aba-8dc6-eab8ca8647cb admin admin] PATH_INFO: `/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/8e05695f0d91463bae1f2a67a58cb54b/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:01.427590 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2460dd5-b372-4aba-8dc6-eab8ca8647cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f200887ca764a72b0640476fe3eb41b, user_id=8e05695f0d91463bae1f2a67a58cb54b, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:01.430474 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2460dd5-b372-4aba-8dc6-eab8ca8647cb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:01.443820 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 636/1271] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Dec 15 13:22:01 2021] PUT /identity/v3/projects/9f200887ca764a72b0640476fe3eb41b/users/8e05695f0d91463bae1f2a67a58cb54b/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:22:03.809277 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80109226-f49b-4f39-b812-ecb2c3b4f9c2 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:03.809853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80109226-f49b-4f39-b812-ecb2c3b4f9c2 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:03.809853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80109226-f49b-4f39-b812-ecb2c3b4f9c2 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:03.811631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 636/1272] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:22:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:22:03.817675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3baa0b-174f-4492-b09d-d53e0826f3a7 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:03.818113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3baa0b-174f-4492-b09d-d53e0826f3a7 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:03.818239 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3baa0b-174f-4492-b09d-d53e0826f3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:03.836367 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ae3baa0b-174f-4492-b09d-d53e0826f3a7 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:22:03.837537 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ae3baa0b-174f-4492-b09d-d53e0826f3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:22:03.893940 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 637/1273] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:22:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:22:03.917966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80109226-f49b-4f39-b812-ecb2c3b4f9c2 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:03.930128 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80109226-f49b-4f39-b812-ecb2c3b4f9c2 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:03.934466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b3545-1296-4c80-910b-9f15a3fd8d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:03.935257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b3545-1296-4c80-910b-9f15a3fd8d3e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:03.935539 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b3545-1296-4c80-910b-9f15a3fd8d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:03.935810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b3545-1296-4c80-910b-9f15a3fd8d3e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:03.946184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b3545-1296-4c80-910b-9f15a3fd8d3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:22:03.952888 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-0e1b3545-1296-4c80-910b-9f15a3fd8d3e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:22:03.954607 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 637/1274] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Dec 15 13:22:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:22:03.960615 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3baa0b-174f-4492-b09d-d53e0826f3a7 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:03.969248 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3baa0b-174f-4492-b09d-d53e0826f3a7 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:03.973722 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab104c-034f-400d-9c0a-5816a002bea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:03.974358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab104c-034f-400d-9c0a-5816a002bea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:03.974639 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab104c-034f-400d-9c0a-5816a002bea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:03.974946 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab104c-034f-400d-9c0a-5816a002bea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:03.975701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab104c-034f-400d-9c0a-5816a002bea6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:03.976006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab104c-034f-400d-9c0a-5816a002bea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:03.977591 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab104c-034f-400d-9c0a-5816a002bea6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:03.985617 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 638/1275] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Dec 15 13:22:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:22:03.991462 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b3545-1296-4c80-910b-9f15a3fd8d3e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:04.001776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b3545-1296-4c80-910b-9f15a3fd8d3e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:04.006142 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad3a64-82fd-4d43-8d63-193cd926eb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:04.006901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad3a64-82fd-4d43-8d63-193cd926eb5e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:04.007183 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad3a64-82fd-4d43-8d63-193cd926eb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:04.007455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad3a64-82fd-4d43-8d63-193cd926eb5e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:04.017974 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad3a64-82fd-4d43-8d63-193cd926eb5e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:04.019786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad3a64-82fd-4d43-8d63-193cd926eb5e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:04.035862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-f5ad3a64-82fd-4d43-8d63-193cd926eb5e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:22:04.036941 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 638/1276] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:22:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:22:04.042749 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab104c-034f-400d-9c0a-5816a002bea6 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:04.052399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab104c-034f-400d-9c0a-5816a002bea6 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:04.056920 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a320c40-e586-49f7-89e4-1b0660fdd7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:04.057548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a320c40-e586-49f7-89e4-1b0660fdd7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:04.057833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a320c40-e586-49f7-89e4-1b0660fdd7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:04.058112 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a320c40-e586-49f7-89e4-1b0660fdd7c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:04.058841 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a320c40-e586-49f7-89e4-1b0660fdd7c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:04.059188 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a320c40-e586-49f7-89e4-1b0660fdd7c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:04.060761 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a320c40-e586-49f7-89e4-1b0660fdd7c8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:04.072614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 639/1277] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:22:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:22:04.078048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad3a64-82fd-4d43-8d63-193cd926eb5e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:04.087588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad3a64-82fd-4d43-8d63-193cd926eb5e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:04.091945 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5ad71-a1c1-46b5-ba69-3ded7a12e36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:04.092681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5ad71-a1c1-46b5-ba69-3ded7a12e36d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:04.092957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5ad71-a1c1-46b5-ba69-3ded7a12e36d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:04.093225 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5ad71-a1c1-46b5-ba69-3ded7a12e36d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:04.100208 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5ad71-a1c1-46b5-ba69-3ded7a12e36d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:04.102142 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5ad71-a1c1-46b5-ba69-3ded7a12e36d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:04.115555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-daa5ad71-a1c1-46b5-ba69-3ded7a12e36d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 13:22:04.116647 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 639/1278] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:22:04 2021] GET /identity/v3/users/placement => generated 87 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:22:04.122484 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a320c40-e586-49f7-89e4-1b0660fdd7c8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:04.132303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a320c40-e586-49f7-89e4-1b0660fdd7c8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:04.136833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988d37-250d-445f-b09e-203ef775bfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:04.137468 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988d37-250d-445f-b09e-203ef775bfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:04.137753 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988d37-250d-445f-b09e-203ef775bfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:04.138030 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988d37-250d-445f-b09e-203ef775bfd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:04.138937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0988d37-250d-445f-b09e-203ef775bfd6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:04.139212 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0988d37-250d-445f-b09e-203ef775bfd6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:04.141034 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0988d37-250d-445f-b09e-203ef775bfd6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:04.158211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 640/1279] 10.222.0.60 () {56 vars in 1164 bytes} [Wed Dec 15 13:22:04 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:22:04.163821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5ad71-a1c1-46b5-ba69-3ded7a12e36d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:04.173470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5ad71-a1c1-46b5-ba69-3ded7a12e36d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:04.178128 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadac75-909c-4e55-a10a-3f6585ff08ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:04.178736 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadac75-909c-4e55-a10a-3f6585ff08ef admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:04.179048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadac75-909c-4e55-a10a-3f6585ff08ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:04.179323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadac75-909c-4e55-a10a-3f6585ff08ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:04.186728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadac75-909c-4e55-a10a-3f6585ff08ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:04.189078 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadac75-909c-4e55-a10a-3f6585ff08ef admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:04.197593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 640/1280] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Dec 15 13:22:04 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:22:04.203318 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988d37-250d-445f-b09e-203ef775bfd6 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:04.212440 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988d37-250d-445f-b09e-203ef775bfd6 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:04.216986 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df460b35-7dff-4160-b6e4-d32407744824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:04.217729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df460b35-7dff-4160-b6e4-d32407744824 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:04.218012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df460b35-7dff-4160-b6e4-d32407744824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:04.218288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df460b35-7dff-4160-b6e4-d32407744824 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:04.228260 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df460b35-7dff-4160-b6e4-d32407744824 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:04.230030 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df460b35-7dff-4160-b6e4-d32407744824 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:04.246724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-df460b35-7dff-4160-b6e4-d32407744824 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:22:04.247842 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 641/1281] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Dec 15 13:22:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:22:04.253993 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadac75-909c-4e55-a10a-3f6585ff08ef admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:04.262286 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadac75-909c-4e55-a10a-3f6585ff08ef admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:04.266768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9ffa9-33c6-460d-9b5b-dcf060e89abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:04.267491 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9ffa9-33c6-460d-9b5b-dcf060e89abb admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:04.267773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9ffa9-33c6-460d-9b5b-dcf060e89abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:04.268052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9ffa9-33c6-460d-9b5b-dcf060e89abb admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:04.268768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9ffa9-33c6-460d-9b5b-dcf060e89abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:04.269076 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9ffa9-33c6-460d-9b5b-dcf060e89abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:04.270608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9ffa9-33c6-460d-9b5b-dcf060e89abb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:04.281526 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 641/1282] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Dec 15 13:22:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:22:04.287037 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df460b35-7dff-4160-b6e4-d32407744824 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:04.296135 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df460b35-7dff-4160-b6e4-d32407744824 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:04.301401 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1d4a0-538e-4f6b-b02e-1091cad774d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:04.302128 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1d4a0-538e-4f6b-b02e-1091cad774d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:04.302418 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1d4a0-538e-4f6b-b02e-1091cad774d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:04.302691 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1d4a0-538e-4f6b-b02e-1091cad774d6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:04.309339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1d4a0-538e-4f6b-b02e-1091cad774d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:04.311300 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1d4a0-538e-4f6b-b02e-1091cad774d6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:04.324504 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING keystone.server.flask.application [None req-5cf1d4a0-538e-4f6b-b02e-1091cad774d6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:22:04.325582 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 642/1283] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Dec 15 13:22:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:22:04.332822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9ffa9-33c6-460d-9b5b-dcf060e89abb admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:04.344784 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9ffa9-33c6-460d-9b5b-dcf060e89abb admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:04.350568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd7881-bf7f-4f16-acd4-4c5c57e2384b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:04.351242 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd7881-bf7f-4f16-acd4-4c5c57e2384b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:04.351597 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd7881-bf7f-4f16-acd4-4c5c57e2384b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:04.351954 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd7881-bf7f-4f16-acd4-4c5c57e2384b admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:04.352965 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd7881-bf7f-4f16-acd4-4c5c57e2384b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:04.353424 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd7881-bf7f-4f16-acd4-4c5c57e2384b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:04.355640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd7881-bf7f-4f16-acd4-4c5c57e2384b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:04.369826 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 642/1284] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Dec 15 13:22:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:22:04.377705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1d4a0-538e-4f6b-b02e-1091cad774d6 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:04.390695 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1d4a0-538e-4f6b-b02e-1091cad774d6 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:04.396139 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17fd2b-250b-46ba-aec4-aa00025f7162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:04.396779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17fd2b-250b-46ba-aec4-aa00025f7162 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:04.397071 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17fd2b-250b-46ba-aec4-aa00025f7162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:04.397353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17fd2b-250b-46ba-aec4-aa00025f7162 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:04.398197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17fd2b-250b-46ba-aec4-aa00025f7162 admin admin] RBAC: Adding query filter params (role.id=d832ab37ec7645cb853ef26c969765a0, scope.project.id=9f200887ca764a72b0640476fe3eb41b, user.id=8e05695f0d91463bae1f2a67a58cb54b) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:04.398514 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17fd2b-250b-46ba-aec4-aa00025f7162 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:04.400419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17fd2b-250b-46ba-aec4-aa00025f7162 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:04.406680 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 643/1285] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Dec 15 13:22:04 2021] GET /identity/v3/role_assignments?user.id=8e05695f0d91463bae1f2a67a58cb54b&scope.project.id=9f200887ca764a72b0640476fe3eb41b&role.id=d832ab37ec7645cb853ef26c969765a0 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:22:06.758574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9cdf-1ceb-44af-9542-2dd62a37158d None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:06.759121 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9cdf-1ceb-44af-9542-2dd62a37158d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:06.759221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9cdf-1ceb-44af-9542-2dd62a37158d None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:06.760930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 643/1286] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:22:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:22:06.766805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a524b9-5a32-4fe1-af4e-006f06862ed8 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:06.767201 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a524b9-5a32-4fe1-af4e-006f06862ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:06.767384 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a524b9-5a32-4fe1-af4e-006f06862ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:06.784756 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-54a524b9-5a32-4fe1-af4e-006f06862ed8 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:22:06.785933 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-54a524b9-5a32-4fe1-af4e-006f06862ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:22:06.793472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 644/1287] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:22:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:22:06.816672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b9cdf-1ceb-44af-9542-2dd62a37158d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:06.828608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b9cdf-1ceb-44af-9542-2dd62a37158d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:06.833012 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd382fa-bcb2-494b-a8f2-1b182211bbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:06.833782 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd382fa-bcb2-494b-a8f2-1b182211bbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:06.834066 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd382fa-bcb2-494b-a8f2-1b182211bbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:06.834342 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd382fa-bcb2-494b-a8f2-1b182211bbe6 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:06.835054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd382fa-bcb2-494b-a8f2-1b182211bbe6 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:06.836642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd382fa-bcb2-494b-a8f2-1b182211bbe6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:06.847873 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-ebd382fa-bcb2-494b-a8f2-1b182211bbe6 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 13:22:06.848972 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 644/1288] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Dec 15 13:22:06 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:22:06.854883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a524b9-5a32-4fe1-af4e-006f06862ed8 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:06.864210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a524b9-5a32-4fe1-af4e-006f06862ed8 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:06.868697 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2626c-2825-4b2f-9e4c-3434321285c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:06.869330 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2626c-2825-4b2f-9e4c-3434321285c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:06.869615 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2626c-2825-4b2f-9e4c-3434321285c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:06.869897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2626c-2825-4b2f-9e4c-3434321285c7 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:06.870615 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2626c-2825-4b2f-9e4c-3434321285c7 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:06.870959 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2626c-2825-4b2f-9e4c-3434321285c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:06.872544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2626c-2825-4b2f-9e4c-3434321285c7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:06.877189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 645/1289] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Dec 15 13:22:06 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:22:06.882804 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd382fa-bcb2-494b-a8f2-1b182211bbe6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:06.891956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd382fa-bcb2-494b-a8f2-1b182211bbe6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:06.896309 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ea781-3c21-48a9-86f5-b2debb016be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:06.896919 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ea781-3c21-48a9-86f5-b2debb016be1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:06.897195 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ea781-3c21-48a9-86f5-b2debb016be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:06.897467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ea781-3c21-48a9-86f5-b2debb016be1 admin admin] PATH_INFO: `/v3/services` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:06.898163 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ea781-3c21-48a9-86f5-b2debb016be1 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:06.898464 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ea781-3c21-48a9-86f5-b2debb016be1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:06.900013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ea781-3c21-48a9-86f5-b2debb016be1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:06.904214 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 645/1290] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Dec 15 13:22:06 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:22:09.256795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408c82c-f448-4d4a-898e-f34016aa1aaf None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:09.257343 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408c82c-f448-4d4a-898e-f34016aa1aaf None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:09.257343 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408c82c-f448-4d4a-898e-f34016aa1aaf None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:09.259136 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 646/1291] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:22:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:22:09.264599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004366f-c2da-44e9-b8a2-a3681312a43d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:09.264987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004366f-c2da-44e9-b8a2-a3681312a43d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:09.265158 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004366f-c2da-44e9-b8a2-a3681312a43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:09.282920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b004366f-c2da-44e9-b8a2-a3681312a43d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:22:09.284092 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b004366f-c2da-44e9-b8a2-a3681312a43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:22:09.291546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 646/1292] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:22:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:22:09.314966 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408c82c-f448-4d4a-898e-f34016aa1aaf None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:09.327019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408c82c-f448-4d4a-898e-f34016aa1aaf None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:09.333714 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3af98-30b3-4108-b63d-d0218e61f7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:09.334622 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3af98-30b3-4108-b63d-d0218e61f7df admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:09.334973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3af98-30b3-4108-b63d-d0218e61f7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:09.335418 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3af98-30b3-4108-b63d-d0218e61f7df admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:09.336724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3af98-30b3-4108-b63d-d0218e61f7df admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:09.338984 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3af98-30b3-4108-b63d-d0218e61f7df admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:09.357036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 647/1293] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Dec 15 13:22:09 2021] POST /identity/v3/services => generated 246 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:22:11.693787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873acaa0-1cde-4b52-8f5a-1ab3279c3b44 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:11.694178 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873acaa0-1cde-4b52-8f5a-1ab3279c3b44 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:11.694338 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873acaa0-1cde-4b52-8f5a-1ab3279c3b44 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:11.696156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 647/1294] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:22:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:22:11.701891 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723e16c-4680-494a-9542-ed1bdf3564f1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:11.702312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723e16c-4680-494a-9542-ed1bdf3564f1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:11.702452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723e16c-4680-494a-9542-ed1bdf3564f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:11.719766 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-4723e16c-4680-494a-9542-ed1bdf3564f1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:22:11.720954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4723e16c-4680-494a-9542-ed1bdf3564f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:22:11.737843 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 648/1295] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:22:11 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:22:11.761322 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873acaa0-1cde-4b52-8f5a-1ab3279c3b44 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:11.774266 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873acaa0-1cde-4b52-8f5a-1ab3279c3b44 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:11.781565 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750fcad-3df8-43e0-9d34-f9d714a3c2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:11.782348 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750fcad-3df8-43e0-9d34-f9d714a3c2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:11.782632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750fcad-3df8-43e0-9d34-f9d714a3c2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:11.782941 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750fcad-3df8-43e0-9d34-f9d714a3c2c9 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:11.783640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750fcad-3df8-43e0-9d34-f9d714a3c2c9 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:11.785239 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750fcad-3df8-43e0-9d34-f9d714a3c2c9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:11.796433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-0750fcad-3df8-43e0-9d34-f9d714a3c2c9 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 13:22:11.797571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 648/1296] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Dec 15 13:22:11 2021] GET /identity/v3/services/placement => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:22:11.804799 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723e16c-4680-494a-9542-ed1bdf3564f1 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:11.814631 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723e16c-4680-494a-9542-ed1bdf3564f1 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:11.819196 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a407fa-b6c4-4469-9a2d-168e1f456d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:11.819838 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a407fa-b6c4-4469-9a2d-168e1f456d2b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:11.820146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a407fa-b6c4-4469-9a2d-168e1f456d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:11.820422 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a407fa-b6c4-4469-9a2d-168e1f456d2b admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:11.821142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a407fa-b6c4-4469-9a2d-168e1f456d2b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:11.821450 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a407fa-b6c4-4469-9a2d-168e1f456d2b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:11.823076 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a407fa-b6c4-4469-9a2d-168e1f456d2b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:11.828089 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 649/1297] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Dec 15 13:22:11 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:22:11.834324 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750fcad-3df8-43e0-9d34-f9d714a3c2c9 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:11.843947 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750fcad-3df8-43e0-9d34-f9d714a3c2c9 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:11.849118 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fb399-a4a1-486a-b297-a70ceebc7c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:11.849759 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fb399-a4a1-486a-b297-a70ceebc7c7a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:11.850043 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fb399-a4a1-486a-b297-a70ceebc7c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:11.850321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fb399-a4a1-486a-b297-a70ceebc7c7a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:11.851166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fb399-a4a1-486a-b297-a70ceebc7c7a admin admin] RBAC: Adding query filter params (interface=public, service_id=609f80b38d534f99923ccc119f923a29, region_id=RegionOne) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:11.851483 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fb399-a4a1-486a-b297-a70ceebc7c7a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:11.853119 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fb399-a4a1-486a-b297-a70ceebc7c7a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:11.858062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 649/1298] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Dec 15 13:22:11 2021] GET /identity/v3/endpoints?service_id=609f80b38d534f99923ccc119f923a29&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:22:11.864518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a407fa-b6c4-4469-9a2d-168e1f456d2b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:11.873897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a407fa-b6c4-4469-9a2d-168e1f456d2b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:11.878982 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba11aa-caf4-467b-ab63-2d82692376c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:11.879614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba11aa-caf4-467b-ab63-2d82692376c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:11.879896 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba11aa-caf4-467b-ab63-2d82692376c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:11.880173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba11aa-caf4-467b-ab63-2d82692376c0 admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:11.880862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba11aa-caf4-467b-ab63-2d82692376c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:11.882441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba11aa-caf4-467b-ab63-2d82692376c0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:11.889171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 650/1299] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Dec 15 13:22:11 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:22:14.209606 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464eb9d-b728-44d2-a168-212cb39c1158 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:14.210156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464eb9d-b728-44d2-a168-212cb39c1158 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:14.210156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464eb9d-b728-44d2-a168-212cb39c1158 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:14.211972 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 650/1300] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:22:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:22:14.217634 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c586-b189-4ab4-addc-cdd0808c224c None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:14.218011 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c586-b189-4ab4-addc-cdd0808c224c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:14.218183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c586-b189-4ab4-addc-cdd0808c224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:14.236769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-2c12c586-b189-4ab4-addc-cdd0808c224c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:22:14.237921 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-2c12c586-b189-4ab4-addc-cdd0808c224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:22:14.245390 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 651/1301] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:22:14 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:22:14.268588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464eb9d-b728-44d2-a168-212cb39c1158 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:14.280314 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464eb9d-b728-44d2-a168-212cb39c1158 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:14.285270 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3894c5-9164-45a0-a67b-119f8e2f86e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:14.286033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3894c5-9164-45a0-a67b-119f8e2f86e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:14.286317 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3894c5-9164-45a0-a67b-119f8e2f86e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:14.286593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3894c5-9164-45a0-a67b-119f8e2f86e4 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:14.287288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3894c5-9164-45a0-a67b-119f8e2f86e4 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:14.288865 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3894c5-9164-45a0-a67b-119f8e2f86e4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:14.299702 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING keystone.server.flask.application [None req-2d3894c5-9164-45a0-a67b-119f8e2f86e4 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 13:22:14.301058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 651/1302] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Dec 15 13:22:14 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:22:14.307137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12c586-b189-4ab4-addc-cdd0808c224c None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:14.316295 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12c586-b189-4ab4-addc-cdd0808c224c None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:14.320743 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe7d8b-f082-4240-b508-9f5660118ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:14.321397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe7d8b-f082-4240-b508-9f5660118ada admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:14.321681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe7d8b-f082-4240-b508-9f5660118ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:14.321958 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe7d8b-f082-4240-b508-9f5660118ada admin admin] PATH_INFO: `/v3/services` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:14.322674 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe7d8b-f082-4240-b508-9f5660118ada admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:22:14.323015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe7d8b-f082-4240-b508-9f5660118ada admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:14.324611 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe7d8b-f082-4240-b508-9f5660118ada admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:14.330543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 652/1303] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Dec 15 13:22:14 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:22:14.336520 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3894c5-9164-45a0-a67b-119f8e2f86e4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:22:14.346719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3894c5-9164-45a0-a67b-119f8e2f86e4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:22:14.351586 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeadf41-d529-4ecb-be49-39d8440859b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:22:14.352198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeadf41-d529-4ecb-be49-39d8440859b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:22:14.352478 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeadf41-d529-4ecb-be49-39d8440859b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:22:14.352758 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeadf41-d529-4ecb-be49-39d8440859b9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:22:14.353510 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeadf41-d529-4ecb-be49-39d8440859b9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:22:14.355125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeadf41-d529-4ecb-be49-39d8440859b9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:22:14.373762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 652/1304] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Dec 15 13:22:14 2021] POST /identity/v3/endpoints => generated 331 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:23:16.625724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7f002-a739-4ba5-8442-7b189f66c66d None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:16.626301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7f002-a739-4ba5-8442-7b189f66c66d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:16.626301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7f002-a739-4ba5-8442-7b189f66c66d None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:16.634108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd3509-c57a-4a7d-8eeb-2a97cb471a64 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:16.634566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd3509-c57a-4a7d-8eeb-2a97cb471a64 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:16.634646 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd3509-c57a-4a7d-8eeb-2a97cb471a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:16.638730 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 653/1305] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:23:16 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:16.748939 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-26cd3509-c57a-4a7d-8eeb-2a97cb471a64 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:16.750350 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-26cd3509-c57a-4a7d-8eeb-2a97cb471a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:16.935682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 653/1306] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:23:16.949851 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7f002-a739-4ba5-8442-7b189f66c66d None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:16.952764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a8c7f002-a739-4ba5-8442-7b189f66c66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:17.103515 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7f002-a739-4ba5-8442-7b189f66c66d None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:17.206083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb8828-772b-4ae1-88f3-d11f087a9808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:17.207296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb8828-772b-4ae1-88f3-d11f087a9808 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:17.207793 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb8828-772b-4ae1-88f3-d11f087a9808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:17.208277 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb8828-772b-4ae1-88f3-d11f087a9808 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:17.209230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb8828-772b-4ae1-88f3-d11f087a9808 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:17.211915 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb8828-772b-4ae1-88f3-d11f087a9808 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:17.234107 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 654/1307] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Dec 15 13:23:16 2021] GET /identity/v3/projects => generated 2553 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:23:19.725968 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f1d1a-8ae0-49fb-8f89-17f921e4271c None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:19.726514 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f1d1a-8ae0-49fb-8f89-17f921e4271c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:19.726514 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f1d1a-8ae0-49fb-8f89-17f921e4271c None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:19.728353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 654/1308] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:23:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:19.734785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c9244-2661-4f22-9bab-a275364c454a None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:19.735227 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c9244-2661-4f22-9bab-a275364c454a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:19.735406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c9244-2661-4f22-9bab-a275364c454a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:19.804697 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-557c9244-2661-4f22-9bab-a275364c454a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:19.805803 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-557c9244-2661-4f22-9bab-a275364c454a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:19.898672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 655/1309] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:23:19.952990 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb2c01-3ea7-4371-b9b1-cf273d3b4e4e None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:19.953283 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb2c01-3ea7-4371-b9b1-cf273d3b4e4e None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:19.953570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb2c01-3ea7-4371-b9b1-cf273d3b4e4e None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:19.955413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 655/1310] 10.222.0.60 () {54 vars in 964 bytes} [Wed Dec 15 13:23:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:19.961642 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3884-8fc0-4a32-ae7d-d2cc706e49d5 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:19.961933 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3884-8fc0-4a32-ae7d-d2cc706e49d5 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:19.962216 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3884-8fc0-4a32-ae7d-d2cc706e49d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:20.037305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-3a2e3884-8fc0-4a32-ae7d-d2cc706e49d5 None None] MFA Rules not processed for user `c9a44a13e31941b5af9579d8bec345ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:20.038597 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-3a2e3884-8fc0-4a32-ae7d-d2cc706e49d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:20.112962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 656/1311] 10.222.0.60 () {58 vars in 1061 bytes} [Wed Dec 15 13:23:19 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:23:20.122038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb2c01-3ea7-4371-b9b1-cf273d3b4e4e None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:20.123595 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-1fcb2c01-3ea7-4371-b9b1-cf273d3b4e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:20.224932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb2c01-3ea7-4371-b9b1-cf273d3b4e4e None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:20.303232 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c85dd9-b5dc-4680-a3fb-00f2597333c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:20.303881 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85dd9-b5dc-4680-a3fb-00f2597333c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:20.304165 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85dd9-b5dc-4680-a3fb-00f2597333c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:20.304442 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85dd9-b5dc-4680-a3fb-00f2597333c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:20.306063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-73c85dd9-b5dc-4680-a3fb-00f2597333c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:20.413442 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c85dd9-b5dc-4680-a3fb-00f2597333c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:20.414791 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c85dd9-b5dc-4680-a3fb-00f2597333c0 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:20.433126 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 656/1312] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:23:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:23:23.052560 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4d641-bcde-466a-be74-3968fa22bf6d None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:23.053077 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4d641-bcde-466a-be74-3968fa22bf6d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:23.053171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4d641-bcde-466a-be74-3968fa22bf6d None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:23.054954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 657/1313] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:23:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:23.061294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2dc17-8b32-401c-af77-90b0669179a8 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:23.061670 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2dc17-8b32-401c-af77-90b0669179a8 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:23.061848 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2dc17-8b32-401c-af77-90b0669179a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:23.124542 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-d5f2dc17-8b32-401c-af77-90b0669179a8 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:23.125739 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d5f2dc17-8b32-401c-af77-90b0669179a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:23.218522 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 657/1314] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:23:23.257672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4d641-bcde-466a-be74-3968fa22bf6d None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:23.259215 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-7ae4d641-bcde-466a-be74-3968fa22bf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:23.358298 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4d641-bcde-466a-be74-3968fa22bf6d None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:23.428109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9b71d-d302-40d4-b59c-bbeca82142d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:23.428748 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b71d-d302-40d4-b59c-bbeca82142d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:23.429030 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b71d-d302-40d4-b59c-bbeca82142d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:23.429305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b71d-d302-40d4-b59c-bbeca82142d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:23.430952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-8fa9b71d-d302-40d4-b59c-bbeca82142d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:23.534170 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9b71d-d302-40d4-b59c-bbeca82142d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:23.535644 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9b71d-d302-40d4-b59c-bbeca82142d6 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:23.553278 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 658/1315] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:23:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:23:26.196990 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc3fa3-5743-4346-9aaf-74812510f6f3 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:26.197572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc3fa3-5743-4346-9aaf-74812510f6f3 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:26.197572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc3fa3-5743-4346-9aaf-74812510f6f3 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:26.199863 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 658/1316] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:23:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:26.205708 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685bdd6-b10d-463c-bc40-2121c4077947 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:26.206088 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685bdd6-b10d-463c-bc40-2121c4077947 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:26.206282 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685bdd6-b10d-463c-bc40-2121c4077947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:26.268901 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-b685bdd6-b10d-463c-bc40-2121c4077947 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:26.270113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b685bdd6-b10d-463c-bc40-2121c4077947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:26.364288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 659/1317] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:23:26.400635 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc3fa3-5743-4346-9aaf-74812510f6f3 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:26.402177 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d8bc3fa3-5743-4346-9aaf-74812510f6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:26.522592 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc3fa3-5743-4346-9aaf-74812510f6f3 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:26.610837 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89679a-2c98-4cd6-a3c3-ece05bee2f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:26.611937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89679a-2c98-4cd6-a3c3-ece05bee2f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:26.612221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89679a-2c98-4cd6-a3c3-ece05bee2f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:26.612500 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89679a-2c98-4cd6-a3c3-ece05bee2f38 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:26.622538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89679a-2c98-4cd6-a3c3-ece05bee2f38 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:26.624632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89679a-2c98-4cd6-a3c3-ece05bee2f38 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:26.626328 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 659/1318] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:26 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:26.639234 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685bdd6-b10d-463c-bc40-2121c4077947 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:26.640448 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b685bdd6-b10d-463c-bc40-2121c4077947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:26.732496 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685bdd6-b10d-463c-bc40-2121c4077947 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:26.801933 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5776956-83c0-4e5e-adcb-a376337569dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:26.802501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776956-83c0-4e5e-adcb-a376337569dc service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:26.802776 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776956-83c0-4e5e-adcb-a376337569dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:26.803073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776956-83c0-4e5e-adcb-a376337569dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:26.804671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a5776956-83c0-4e5e-adcb-a376337569dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:26.909127 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5776956-83c0-4e5e-adcb-a376337569dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:26.910555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5776956-83c0-4e5e-adcb-a376337569dc service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:26.927431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 660/1319] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:23:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:23:29.864074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b318d-a3c4-42cb-962d-600032dbfa6c None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:29.864589 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b318d-a3c4-42cb-962d-600032dbfa6c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:29.864681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b318d-a3c4-42cb-962d-600032dbfa6c None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:29.866424 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 660/1320] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:23:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:29.872744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec3933-5838-4ccd-940c-f7d0867a807f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:29.873125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec3933-5838-4ccd-940c-f7d0867a807f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:29.873271 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec3933-5838-4ccd-940c-f7d0867a807f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:29.934729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-aeec3933-5838-4ccd-940c-f7d0867a807f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:29.936752 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-aeec3933-5838-4ccd-940c-f7d0867a807f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:30.026557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 661/1321] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:23:30.061409 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b318d-a3c4-42cb-962d-600032dbfa6c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:30.062898 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2c5b318d-a3c4-42cb-962d-600032dbfa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:30.180568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b318d-a3c4-42cb-962d-600032dbfa6c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:30.270047 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd79b1-a8b9-48a9-b2ab-1873aa29af80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:30.270905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd79b1-a8b9-48a9-b2ab-1873aa29af80 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:30.271185 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd79b1-a8b9-48a9-b2ab-1873aa29af80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:30.271457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd79b1-a8b9-48a9-b2ab-1873aa29af80 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:30.281415 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd79b1-a8b9-48a9-b2ab-1873aa29af80 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:30.283424 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd79b1-a8b9-48a9-b2ab-1873aa29af80 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:30.285097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 661/1322] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:30 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:30.298025 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec3933-5838-4ccd-940c-f7d0867a807f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:30.299259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-aeec3933-5838-4ccd-940c-f7d0867a807f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:30.391235 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec3933-5838-4ccd-940c-f7d0867a807f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:30.460573 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1248cec-8ea6-4285-bff6-f2c929704c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:30.461207 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1248cec-8ea6-4285-bff6-f2c929704c4b service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:30.461489 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1248cec-8ea6-4285-bff6-f2c929704c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:30.461764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1248cec-8ea6-4285-bff6-f2c929704c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:30.463397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a1248cec-8ea6-4285-bff6-f2c929704c4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:30.568033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1248cec-8ea6-4285-bff6-f2c929704c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:30.569389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1248cec-8ea6-4285-bff6-f2c929704c4b service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:30.586327 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 662/1323] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:23:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:23:33.598991 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4312987-e68b-4adc-993b-8d31e83fd2b5 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.599536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4312987-e68b-4adc-993b-8d31e83fd2b5 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.599536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4312987-e68b-4adc-993b-8d31e83fd2b5 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.601318 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 662/1324] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:23:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:33.607596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8b82-a2be-48a5-8114-89bf5ad9363a None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.608020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8b82-a2be-48a5-8114-89bf5ad9363a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.608146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8b82-a2be-48a5-8114-89bf5ad9363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.671770 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-9c2d8b82-a2be-48a5-8114-89bf5ad9363a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:33.672968 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9c2d8b82-a2be-48a5-8114-89bf5ad9363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:33.766555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 663/1325] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:23:33.804114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4312987-e68b-4adc-993b-8d31e83fd2b5 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.805616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a4312987-e68b-4adc-993b-8d31e83fd2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:33.906951 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4312987-e68b-4adc-993b-8d31e83fd2b5 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.977399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd45026-f331-487b-8d26-9fc57748077b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.978048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45026-f331-487b-8d26-9fc57748077b service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.978325 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45026-f331-487b-8d26-9fc57748077b service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.978593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45026-f331-487b-8d26-9fc57748077b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.980228 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-cfd45026-f331-487b-8d26-9fc57748077b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:34.083911 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd45026-f331-487b-8d26-9fc57748077b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:34.085242 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd45026-f331-487b-8d26-9fc57748077b service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:34.102765 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 663/1326] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:23:36.520791 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e1017-575f-4fd7-8496-646842b7f4c2 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.521381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e1017-575f-4fd7-8496-646842b7f4c2 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.521381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e1017-575f-4fd7-8496-646842b7f4c2 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.523194 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 664/1327] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:23:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:36.528984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddc21e-771e-4845-a034-d0e8920b952b None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.529401 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddc21e-771e-4845-a034-d0e8920b952b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.529690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddc21e-771e-4845-a034-d0e8920b952b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.593727 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-6eddc21e-771e-4845-a034-d0e8920b952b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:36.594951 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-6eddc21e-771e-4845-a034-d0e8920b952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:36.688867 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 664/1328] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:23:36.725089 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e1017-575f-4fd7-8496-646842b7f4c2 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:36.726637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-970e1017-575f-4fd7-8496-646842b7f4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:36.835550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e1017-575f-4fd7-8496-646842b7f4c2 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:36.906427 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f207ab6-73ae-4740-88ad-7f7fa9ac2dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:36.907096 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f207ab6-73ae-4740-88ad-7f7fa9ac2dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.907379 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f207ab6-73ae-4740-88ad-7f7fa9ac2dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.907652 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f207ab6-73ae-4740-88ad-7f7fa9ac2dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.909262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-2f207ab6-73ae-4740-88ad-7f7fa9ac2dd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:37.013259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f207ab6-73ae-4740-88ad-7f7fa9ac2dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:37.014705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f207ab6-73ae-4740-88ad-7f7fa9ac2dd2 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:37.032323 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 665/1329] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:23:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:23:39.422830 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b6ca5-183c-4070-a7e5-ed0b0c06323d None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:39.423367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b6ca5-183c-4070-a7e5-ed0b0c06323d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:39.423367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b6ca5-183c-4070-a7e5-ed0b0c06323d None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:39.425183 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 665/1330] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:23:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:39.430765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e0ea1-3a2e-4e3f-b1c9-8830c1bd8c31 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:39.431293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e0ea1-3a2e-4e3f-b1c9-8830c1bd8c31 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:39.431390 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e0ea1-3a2e-4e3f-b1c9-8830c1bd8c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:39.494613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-db5e0ea1-3a2e-4e3f-b1c9-8830c1bd8c31 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:39.495881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-db5e0ea1-3a2e-4e3f-b1c9-8830c1bd8c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:39.588610 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 666/1331] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:23:39.621920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b6ca5-183c-4070-a7e5-ed0b0c06323d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:39.623461 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9d8b6ca5-183c-4070-a7e5-ed0b0c06323d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:39.751351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b6ca5-183c-4070-a7e5-ed0b0c06323d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:39.841129 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5916df-3424-4e4e-8014-78ac670c9b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:39.841981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5916df-3424-4e4e-8014-78ac670c9b60 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:39.842263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5916df-3424-4e4e-8014-78ac670c9b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:39.842542 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5916df-3424-4e4e-8014-78ac670c9b60 admin admin] PATH_INFO: `/v3/projects/d9bef98222d5424aa293398d503f422d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:39.852343 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5916df-3424-4e4e-8014-78ac670c9b60 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9bef98222d5424aa293398d503f422d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:39.854395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5916df-3424-4e4e-8014-78ac670c9b60 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:39.856189 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 666/1332] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:39 2021] GET /identity/v3/projects/d9bef98222d5424aa293398d503f422d => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:39.868313 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e0ea1-3a2e-4e3f-b1c9-8830c1bd8c31 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:39.869505 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-db5e0ea1-3a2e-4e3f-b1c9-8830c1bd8c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:39.958839 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e0ea1-3a2e-4e3f-b1c9-8830c1bd8c31 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:40.030088 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7b44d-7508-434d-ba3b-fb6d5c623cc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:40.030738 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7b44d-7508-434d-ba3b-fb6d5c623cc8 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:40.031048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7b44d-7508-434d-ba3b-fb6d5c623cc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:40.031328 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7b44d-7508-434d-ba3b-fb6d5c623cc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:40.032944 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-60e7b44d-7508-434d-ba3b-fb6d5c623cc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:40.148997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7b44d-7508-434d-ba3b-fb6d5c623cc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:40.150450 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7b44d-7508-434d-ba3b-fb6d5c623cc8 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:40.169727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 667/1333] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:23:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:23:42.741336 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f4ddd-c60e-4f43-9390-95dfa0a41b44 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:42.741851 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f4ddd-c60e-4f43-9390-95dfa0a41b44 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:42.741957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f4ddd-c60e-4f43-9390-95dfa0a41b44 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:42.743689 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 667/1334] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:23:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:42.749747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0856ba-aa8e-40f2-9f9e-9661df107aac None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:42.750179 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0856ba-aa8e-40f2-9f9e-9661df107aac None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:42.750308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0856ba-aa8e-40f2-9f9e-9661df107aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:42.812665 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-da0856ba-aa8e-40f2-9f9e-9661df107aac None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:42.813845 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-da0856ba-aa8e-40f2-9f9e-9661df107aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:42.916200 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 668/1335] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:23:42.953085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f4ddd-c60e-4f43-9390-95dfa0a41b44 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:42.954608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-7a8f4ddd-c60e-4f43-9390-95dfa0a41b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:43.053407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f4ddd-c60e-4f43-9390-95dfa0a41b44 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:43.121753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db4f3d-ac5d-4860-bed0-46413545eff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:43.122386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db4f3d-ac5d-4860-bed0-46413545eff3 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:43.122663 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db4f3d-ac5d-4860-bed0-46413545eff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:43.122964 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db4f3d-ac5d-4860-bed0-46413545eff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:43.124550 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-11db4f3d-ac5d-4860-bed0-46413545eff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:43.239564 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db4f3d-ac5d-4860-bed0-46413545eff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:43.241002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db4f3d-ac5d-4860-bed0-46413545eff3 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:43.258795 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 668/1336] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:23:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:23:45.642481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52941493-91b4-4105-a1ab-ba375f9e1649 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.643065 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52941493-91b4-4105-a1ab-ba375f9e1649 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.643065 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52941493-91b4-4105-a1ab-ba375f9e1649 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.644850 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 669/1337] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:23:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:45.651225 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272f024-add9-4999-af7f-2b5c400eca79 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.651646 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272f024-add9-4999-af7f-2b5c400eca79 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.651790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272f024-add9-4999-af7f-2b5c400eca79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.715468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-8272f024-add9-4999-af7f-2b5c400eca79 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:45.716682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8272f024-add9-4999-af7f-2b5c400eca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:45.812471 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 669/1338] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:23:45.854955 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52941493-91b4-4105-a1ab-ba375f9e1649 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.856469 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-52941493-91b4-4105-a1ab-ba375f9e1649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:45.959484 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52941493-91b4-4105-a1ab-ba375f9e1649 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:46.029669 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6a5a4-c70b-44ab-9d10-ea765f1cf30a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:46.030304 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6a5a4-c70b-44ab-9d10-ea765f1cf30a service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:46.030586 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6a5a4-c70b-44ab-9d10-ea765f1cf30a service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:46.030886 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6a5a4-c70b-44ab-9d10-ea765f1cf30a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:46.032509 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-36a6a5a4-c70b-44ab-9d10-ea765f1cf30a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:46.135607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6a5a4-c70b-44ab-9d10-ea765f1cf30a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:46.137050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6a5a4-c70b-44ab-9d10-ea765f1cf30a service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:46.154571 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 670/1339] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:23:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:23:48.785200 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c669-93f8-470f-8b23-cdccf440360b None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.785704 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c669-93f8-470f-8b23-cdccf440360b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.785815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c669-93f8-470f-8b23-cdccf440360b None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.787556 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 670/1340] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:23:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:48.793872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8684aa2-4797-4f32-8511-11dba934fcab None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.794287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8684aa2-4797-4f32-8511-11dba934fcab None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.794436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8684aa2-4797-4f32-8511-11dba934fcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.863862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-b8684aa2-4797-4f32-8511-11dba934fcab None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:48.865062 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b8684aa2-4797-4f32-8511-11dba934fcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:48.970317 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 671/1341] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:23:49.007282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c669-93f8-470f-8b23-cdccf440360b None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:49.009386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2dc9c669-93f8-470f-8b23-cdccf440360b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:49.100197 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c669-93f8-470f-8b23-cdccf440360b None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:49.104290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45ddb8-3cdb-49eb-80eb-86bfe778fb7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:49.104929 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45ddb8-3cdb-49eb-80eb-86bfe778fb7e service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:49.105215 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45ddb8-3cdb-49eb-80eb-86bfe778fb7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:49.105496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45ddb8-3cdb-49eb-80eb-86bfe778fb7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:49.114131 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45ddb8-3cdb-49eb-80eb-86bfe778fb7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:49.115576 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45ddb8-3cdb-49eb-80eb-86bfe778fb7e service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:49.124636 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 671/1342] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:23:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:23:53.343200 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a78dc-5f1e-4a23-ab67-7399341740bf None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:53.343721 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a78dc-5f1e-4a23-ab67-7399341740bf None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:53.343815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a78dc-5f1e-4a23-ab67-7399341740bf None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:53.345533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 672/1343] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:23:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:53.351284 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5c412-6685-4bae-8ca7-34e018b9493c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:53.351712 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5c412-6685-4bae-8ca7-34e018b9493c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:53.352487 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5c412-6685-4bae-8ca7-34e018b9493c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:53.370444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-90c5c412-6685-4bae-8ca7-34e018b9493c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:53.371650 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-90c5c412-6685-4bae-8ca7-34e018b9493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:53.379818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 672/1344] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:23:53.419770 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a78dc-5f1e-4a23-ab67-7399341740bf None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:53.430830 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a78dc-5f1e-4a23-ab67-7399341740bf None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:53.434801 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ac6fa-cc82-40f0-93a4-ed233eb1f62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:53.435458 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac6fa-cc82-40f0-93a4-ed233eb1f62c service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:53.435739 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac6fa-cc82-40f0-93a4-ed233eb1f62c service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:53.436019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac6fa-cc82-40f0-93a4-ed233eb1f62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:53.444688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ac6fa-cc82-40f0-93a4-ed233eb1f62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:53.446118 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ac6fa-cc82-40f0-93a4-ed233eb1f62c service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:53.455462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 673/1345] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:23:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:23:56.445468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2cb3-9835-427e-a8ac-2b0aaeca92dd None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:56.446006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2cb3-9835-427e-a8ac-2b0aaeca92dd None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:56.446006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2cb3-9835-427e-a8ac-2b0aaeca92dd None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:56.447845 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 673/1346] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:23:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:56.453526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775b7c7-4200-4f0c-8ebc-472afcfde9ac None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:56.453951 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775b7c7-4200-4f0c-8ebc-472afcfde9ac None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:56.454092 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775b7c7-4200-4f0c-8ebc-472afcfde9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:56.472612 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a775b7c7-4200-4f0c-8ebc-472afcfde9ac None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:56.473803 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a775b7c7-4200-4f0c-8ebc-472afcfde9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:56.481558 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 674/1347] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:23:56.519891 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d2cb3-9835-427e-a8ac-2b0aaeca92dd None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:56.531125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d2cb3-9835-427e-a8ac-2b0aaeca92dd None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:56.534754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c879cf2-7744-4575-9f1c-640134d75a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:56.535496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c879cf2-7744-4575-9f1c-640134d75a91 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:56.535851 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c879cf2-7744-4575-9f1c-640134d75a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:56.536197 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c879cf2-7744-4575-9f1c-640134d75a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:56.545152 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c879cf2-7744-4575-9f1c-640134d75a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:56.546652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c879cf2-7744-4575-9f1c-640134d75a91 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:56.556257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 674/1348] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:23:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:00.914224 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a73e-308b-4cb5-8bc0-b5fcb99107ee None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.914747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a73e-308b-4cb5-8bc0-b5fcb99107ee None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.914747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a73e-308b-4cb5-8bc0-b5fcb99107ee None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.916581 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 675/1349] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:00.922576 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7aa05-f466-4360-869d-0a2e3714df2d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.923027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7aa05-f466-4360-869d-0a2e3714df2d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.923171 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7aa05-f466-4360-869d-0a2e3714df2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.941069 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-a7c7aa05-f466-4360-869d-0a2e3714df2d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:00.942191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a7c7aa05-f466-4360-869d-0a2e3714df2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:00.951146 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 675/1350] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:01.002808 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca01f5f-30a2-4480-be8f-f8e74d620707 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:01.003216 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca01f5f-30a2-4480-be8f-f8e74d620707 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:01.003500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca01f5f-30a2-4480-be8f-f8e74d620707 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:01.005286 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 676/1351] 10.222.0.60 () {54 vars in 964 bytes} [Wed Dec 15 13:24:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:01.012040 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ceb08-2cef-4811-90e4-3a0807a6c8f2 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:01.012334 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ceb08-2cef-4811-90e4-3a0807a6c8f2 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:01.012615 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ceb08-2cef-4811-90e4-3a0807a6c8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:01.073124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-cb0ceb08-2cef-4811-90e4-3a0807a6c8f2 None None] MFA Rules not processed for user `c9a44a13e31941b5af9579d8bec345ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:01.074309 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-cb0ceb08-2cef-4811-90e4-3a0807a6c8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:01.080673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 676/1352] 10.222.0.60 () {58 vars in 1061 bytes} [Wed Dec 15 13:24:01 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:01.090355 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca01f5f-30a2-4480-be8f-f8e74d620707 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:01.100569 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca01f5f-30a2-4480-be8f-f8e74d620707 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:01.104045 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2e239-4822-41fc-b631-0c9490886d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:01.104670 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e239-4822-41fc-b631-0c9490886d2a service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:01.104948 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e239-4822-41fc-b631-0c9490886d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:01.105220 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e239-4822-41fc-b631-0c9490886d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:01.115128 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2e239-4822-41fc-b631-0c9490886d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:01.116583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2e239-4822-41fc-b631-0c9490886d2a service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:01.126457 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 677/1353] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:06.452960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1860c-4c4b-4b47-b5c5-27ceb1308254 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:06.453468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1860c-4c4b-4b47-b5c5-27ceb1308254 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:06.454231 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1860c-4c4b-4b47-b5c5-27ceb1308254 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:06.457596 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 677/1354] 10.222.0.60 () {54 vars in 921 bytes} [Wed Dec 15 13:24:06 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:06.463702 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd594-ef16-4776-90cd-e99174d6d875 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:06.464137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd594-ef16-4776-90cd-e99174d6d875 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:06.466653 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd594-ef16-4776-90cd-e99174d6d875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:06.523598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-1bfdd594-ef16-4776-90cd-e99174d6d875 None None] MFA Rules not processed for user `8e05695f0d91463bae1f2a67a58cb54b`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:06.525727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-1bfdd594-ef16-4776-90cd-e99174d6d875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:06.626360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 678/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Dec 15 13:24:06 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:10.965998 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881e5e-787d-4518-b73f-c0db5890d98d None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:10.966523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881e5e-787d-4518-b73f-c0db5890d98d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:10.966613 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881e5e-787d-4518-b73f-c0db5890d98d None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:10.968356 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 678/1356] 10.222.0.60 () {54 vars in 921 bytes} [Wed Dec 15 13:24:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:10.975348 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b779455-c52e-4476-bf0f-42c09d60d007 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:10.975783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b779455-c52e-4476-bf0f-42c09d60d007 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:10.975904 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b779455-c52e-4476-bf0f-42c09d60d007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:10.994141 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-0b779455-c52e-4476-bf0f-42c09d60d007 None None] MFA Rules not processed for user `8e05695f0d91463bae1f2a67a58cb54b`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:10.995454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0b779455-c52e-4476-bf0f-42c09d60d007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:11.003903 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 679/1357] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Dec 15 13:24:10 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:12.427699 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65888016-6257-46e0-97c0-807764ad3113 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.428217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65888016-6257-46e0-97c0-807764ad3113 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.428350 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65888016-6257-46e0-97c0-807764ad3113 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.430136 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 679/1358] 10.222.0.60 () {54 vars in 921 bytes} [Wed Dec 15 13:24:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:24:12.435871 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da7ed-c9d4-40ad-a04b-dd965d9e4796 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.436300 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da7ed-c9d4-40ad-a04b-dd965d9e4796 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.436557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da7ed-c9d4-40ad-a04b-dd965d9e4796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.456379 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e11da7ed-c9d4-40ad-a04b-dd965d9e4796 None None] MFA Rules not processed for user `8e05695f0d91463bae1f2a67a58cb54b`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:12.457655 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e11da7ed-c9d4-40ad-a04b-dd965d9e4796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:12.467080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 680/1359] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Dec 15 13:24:12 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:16.422267 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00e8a-a57f-4a30-85c4-ef5224435310 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.422768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00e8a-a57f-4a30-85c4-ef5224435310 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.422768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00e8a-a57f-4a30-85c4-ef5224435310 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.424724 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 680/1360] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:16.431993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e03694-7cc5-45fb-b046-4f45924e66b0 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.433034 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e03694-7cc5-45fb-b046-4f45924e66b0 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.433552 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e03694-7cc5-45fb-b046-4f45924e66b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.454403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e2e03694-7cc5-45fb-b046-4f45924e66b0 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:16.455755 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e2e03694-7cc5-45fb-b046-4f45924e66b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:16.463603 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 681/1361] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:16.514067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2e2f1-8e7c-4e69-bbfa-7104d271b809 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.514490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2e2f1-8e7c-4e69-bbfa-7104d271b809 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.514910 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2e2f1-8e7c-4e69-bbfa-7104d271b809 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.516997 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 681/1362] 10.222.0.60 () {54 vars in 961 bytes} [Wed Dec 15 13:24:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:16.522979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4166f-2894-40ed-9ed1-749d7062d9c5 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.523315 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4166f-2894-40ed-9ed1-749d7062d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.523568 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4166f-2894-40ed-9ed1-749d7062d9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.576064 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-bcc4166f-2894-40ed-9ed1-749d7062d9c5 None None] MFA Rules not processed for user `d61a8e4d64664e68a5710fdf766e4685`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:16.577495 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-bcc4166f-2894-40ed-9ed1-749d7062d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:16.675356 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 682/1363] 10.222.0.60 () {58 vars in 1058 bytes} [Wed Dec 15 13:24:16 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:16.684547 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2e2f1-8e7c-4e69-bbfa-7104d271b809 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:16.702112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2e2f1-8e7c-4e69-bbfa-7104d271b809 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:16.707793 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0406aa3-0a6e-4be4-a159-8d329de80c30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:16.708523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0406aa3-0a6e-4be4-a159-8d329de80c30 service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.708878 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0406aa3-0a6e-4be4-a159-8d329de80c30 service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.709227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0406aa3-0a6e-4be4-a159-8d329de80c30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.717193 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0406aa3-0a6e-4be4-a159-8d329de80c30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:16.718869 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0406aa3-0a6e-4be4-a159-8d329de80c30 service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:16.728538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 682/1364] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:19.316213 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6494ef-168a-4826-b271-73a754648b19 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:19.317229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6494ef-168a-4826-b271-73a754648b19 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:19.317229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6494ef-168a-4826-b271-73a754648b19 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:19.319077 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 683/1365] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:19.324584 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b445c-cc20-4eee-9ecd-749276a156e6 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:19.325008 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b445c-cc20-4eee-9ecd-749276a156e6 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:19.325136 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b445c-cc20-4eee-9ecd-749276a156e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:19.343709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-e50b445c-cc20-4eee-9ecd-749276a156e6 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:19.344902 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e50b445c-cc20-4eee-9ecd-749276a156e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:19.352884 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 683/1366] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:19.399880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6494ef-168a-4826-b271-73a754648b19 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:19.414838 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6494ef-168a-4826-b271-73a754648b19 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:19.420553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1379f7-d7a7-4433-bc6c-2f8212da124d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:19.421070 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1379f7-d7a7-4433-bc6c-2f8212da124d service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:19.421352 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1379f7-d7a7-4433-bc6c-2f8212da124d service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:19.421627 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1379f7-d7a7-4433-bc6c-2f8212da124d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:19.431209 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1379f7-d7a7-4433-bc6c-2f8212da124d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:19.432822 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1379f7-d7a7-4433-bc6c-2f8212da124d service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:19.443563 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 684/1367] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:22.110977 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a56323-2c16-4a79-95cd-2425fd504ff1 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:22.111498 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a56323-2c16-4a79-95cd-2425fd504ff1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:22.111498 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a56323-2c16-4a79-95cd-2425fd504ff1 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:22.113203 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 684/1368] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:22.119087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53851cd9-f524-4e27-8cd7-131e86dcc77e None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:22.119874 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53851cd9-f524-4e27-8cd7-131e86dcc77e None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:22.120151 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53851cd9-f524-4e27-8cd7-131e86dcc77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:22.141362 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-53851cd9-f524-4e27-8cd7-131e86dcc77e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:22.142924 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-53851cd9-f524-4e27-8cd7-131e86dcc77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:22.153331 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 685/1369] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:22.203466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd84cf-390c-4149-9199-e33c9e9f4408 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:22.203755 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd84cf-390c-4149-9199-e33c9e9f4408 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:22.204038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd84cf-390c-4149-9199-e33c9e9f4408 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:22.205904 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 685/1370] 10.222.0.60 () {54 vars in 961 bytes} [Wed Dec 15 13:24:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:22.212691 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e82413-cc0b-43b5-b6ed-2983c6239636 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:22.213264 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e82413-cc0b-43b5-b6ed-2983c6239636 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:22.213638 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e82413-cc0b-43b5-b6ed-2983c6239636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:22.234688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-26e82413-cc0b-43b5-b6ed-2983c6239636 None None] MFA Rules not processed for user `d61a8e4d64664e68a5710fdf766e4685`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:22.236251 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-26e82413-cc0b-43b5-b6ed-2983c6239636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:22.252782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 686/1371] 10.222.0.60 () {58 vars in 1058 bytes} [Wed Dec 15 13:24:22 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:22.262180 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd84cf-390c-4149-9199-e33c9e9f4408 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:22.279663 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd84cf-390c-4149-9199-e33c9e9f4408 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:22.287593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419b19f-9154-4a2f-9118-3cbd298392f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:22.288276 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419b19f-9154-4a2f-9118-3cbd298392f0 service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:22.288558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419b19f-9154-4a2f-9118-3cbd298392f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:22.288839 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419b19f-9154-4a2f-9118-3cbd298392f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:22.298080 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419b19f-9154-4a2f-9118-3cbd298392f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:22.299500 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419b19f-9154-4a2f-9118-3cbd298392f0 service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:22.310226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 686/1372] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:24:24.403862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ecfad-642b-413b-98d3-d6733becf54c None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.404385 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ecfad-642b-413b-98d3-d6733becf54c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.404467 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ecfad-642b-413b-98d3-d6733becf54c None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.406172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 687/1373] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:24.412513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a925108-2f53-482b-9f70-f2350f142ea3 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.413029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a925108-2f53-482b-9f70-f2350f142ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.413120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a925108-2f53-482b-9f70-f2350f142ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.431601 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-8a925108-2f53-482b-9f70-f2350f142ea3 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:24.432783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8a925108-2f53-482b-9f70-f2350f142ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:24.441456 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 687/1374] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:24.493428 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631eec7-0090-4dd8-a4b8-11e287b0d776 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.493714 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631eec7-0090-4dd8-a4b8-11e287b0d776 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.494274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631eec7-0090-4dd8-a4b8-11e287b0d776 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.496179 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 688/1375] 10.222.0.60 () {54 vars in 963 bytes} [Wed Dec 15 13:24:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:24.501516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01552a7b-60fc-48f5-8c97-d9c96b71562d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.501805 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01552a7b-60fc-48f5-8c97-d9c96b71562d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.502085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01552a7b-60fc-48f5-8c97-d9c96b71562d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.550995 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-01552a7b-60fc-48f5-8c97-d9c96b71562d None None] MFA Rules not processed for user `69bf09fafcb24a13a1ef14cba8da380a`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:24.552179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-01552a7b-60fc-48f5-8c97-d9c96b71562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:24.610771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 688/1376] 10.222.0.60 () {58 vars in 1060 bytes} [Wed Dec 15 13:24:24 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:24.618990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631eec7-0090-4dd8-a4b8-11e287b0d776 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.630973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631eec7-0090-4dd8-a4b8-11e287b0d776 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.634567 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cbc42-4e83-4e29-8138-5eb5ffa1477e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.635302 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cbc42-4e83-4e29-8138-5eb5ffa1477e service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.636253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cbc42-4e83-4e29-8138-5eb5ffa1477e service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.636253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cbc42-4e83-4e29-8138-5eb5ffa1477e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.646356 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cbc42-4e83-4e29-8138-5eb5ffa1477e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.647959 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cbc42-4e83-4e29-8138-5eb5ffa1477e service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.663968 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 689/1377] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:24.773624 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f0710-4e1d-4fcd-9323-27e864229ad8 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.773943 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f0710-4e1d-4fcd-9323-27e864229ad8 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.774305 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f0710-4e1d-4fcd-9323-27e864229ad8 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.776581 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 689/1378] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:24.782520 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43bb9b-3dbf-4f07-819c-d03b01c0bb96 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.782811 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43bb9b-3dbf-4f07-819c-d03b01c0bb96 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.783137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43bb9b-3dbf-4f07-819c-d03b01c0bb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.801589 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ed43bb9b-3dbf-4f07-819c-d03b01c0bb96 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:24.802760 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ed43bb9b-3dbf-4f07-819c-d03b01c0bb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:24.811295 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 690/1379] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:24.857093 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f0710-4e1d-4fcd-9323-27e864229ad8 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.873865 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f0710-4e1d-4fcd-9323-27e864229ad8 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.879517 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b4231-07e6-4950-bea1-366f4760e1ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.880168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b4231-07e6-4950-bea1-366f4760e1ad service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.880450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b4231-07e6-4950-bea1-366f4760e1ad service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.880725 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b4231-07e6-4950-bea1-366f4760e1ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.890232 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b4231-07e6-4950-bea1-366f4760e1ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.891843 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b4231-07e6-4950-bea1-366f4760e1ad service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.901753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 690/1380] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:27.283148 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad343e-8f05-4d10-92db-bbd281f4077a None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.284149 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad343e-8f05-4d10-92db-bbd281f4077a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.284247 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad343e-8f05-4d10-92db-bbd281f4077a None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.285985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 691/1381] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:27.291576 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57243a-4cf1-44ef-a8a0-bcb7e9662915 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.291974 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57243a-4cf1-44ef-a8a0-bcb7e9662915 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.292219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57243a-4cf1-44ef-a8a0-bcb7e9662915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.311355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-fb57243a-4cf1-44ef-a8a0-bcb7e9662915 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:27.312527 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-fb57243a-4cf1-44ef-a8a0-bcb7e9662915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:27.320454 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 691/1382] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:24:27.367234 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad343e-8f05-4d10-92db-bbd281f4077a None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:27.381373 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad343e-8f05-4d10-92db-bbd281f4077a None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:27.386799 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639d3b1-9729-49f3-acde-76ea555725f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:27.387485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639d3b1-9729-49f3-acde-76ea555725f1 service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.387767 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639d3b1-9729-49f3-acde-76ea555725f1 service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.388046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639d3b1-9729-49f3-acde-76ea555725f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.396028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639d3b1-9729-49f3-acde-76ea555725f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:27.397612 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639d3b1-9729-49f3-acde-76ea555725f1 service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:27.406824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 692/1383] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:29.827234 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9737d-f22b-4675-a553-10a16892aa6e None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.827743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9737d-f22b-4675-a553-10a16892aa6e None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.827743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9737d-f22b-4675-a553-10a16892aa6e None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.829471 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 692/1384] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:29.835170 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad471e-a250-4756-8063-40f0ad81f749 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.835559 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad471e-a250-4756-8063-40f0ad81f749 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.835728 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad471e-a250-4756-8063-40f0ad81f749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.853337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-bfad471e-a250-4756-8063-40f0ad81f749 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:29.854514 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-bfad471e-a250-4756-8063-40f0ad81f749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:29.863064 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 693/1385] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:29.909476 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9737d-f22b-4675-a553-10a16892aa6e None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.923681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9737d-f22b-4675-a553-10a16892aa6e None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.930013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb6e15-d605-4261-8526-5f49af52177d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.930653 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6e15-d605-4261-8526-5f49af52177d service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.930967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6e15-d605-4261-8526-5f49af52177d service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.931249 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6e15-d605-4261-8526-5f49af52177d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.940302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb6e15-d605-4261-8526-5f49af52177d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.941876 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb6e15-d605-4261-8526-5f49af52177d service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.951788 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 693/1386] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:32.394445 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e08d1-dddf-466e-acf6-db8a2d258c33 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.395040 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e08d1-dddf-466e-acf6-db8a2d258c33 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.395040 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e08d1-dddf-466e-acf6-db8a2d258c33 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.396894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 694/1387] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:32.403986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e93031-f09b-497f-a2ea-9d9c53fc31c1 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.404411 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e93031-f09b-497f-a2ea-9d9c53fc31c1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.404550 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e93031-f09b-497f-a2ea-9d9c53fc31c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.422907 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-46e93031-f09b-497f-a2ea-9d9c53fc31c1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:32.424690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-46e93031-f09b-497f-a2ea-9d9c53fc31c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:32.433088 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 694/1388] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:32.476084 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e08d1-dddf-466e-acf6-db8a2d258c33 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:32.490957 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e08d1-dddf-466e-acf6-db8a2d258c33 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:32.496633 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93def17b-5d6b-44e9-87bf-9f0eedda64fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:32.497289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93def17b-5d6b-44e9-87bf-9f0eedda64fe service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.497572 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93def17b-5d6b-44e9-87bf-9f0eedda64fe service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.497882 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93def17b-5d6b-44e9-87bf-9f0eedda64fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.506394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93def17b-5d6b-44e9-87bf-9f0eedda64fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:32.508016 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93def17b-5d6b-44e9-87bf-9f0eedda64fe service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:32.517574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 695/1389] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:35.271717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a710d9b-b443-428f-a837-2f31da07ed5d None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.272258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a710d9b-b443-428f-a837-2f31da07ed5d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.272356 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a710d9b-b443-428f-a837-2f31da07ed5d None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.274220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 695/1390] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:35.281043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00396e71-427f-4545-aa1f-ba4a5a377ce1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.281505 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00396e71-427f-4545-aa1f-ba4a5a377ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.281597 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00396e71-427f-4545-aa1f-ba4a5a377ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.300207 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-00396e71-427f-4545-aa1f-ba4a5a377ce1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:35.301401 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-00396e71-427f-4545-aa1f-ba4a5a377ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:35.309658 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 696/1391] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:24:35.364463 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a710d9b-b443-428f-a837-2f31da07ed5d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.379081 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a710d9b-b443-428f-a837-2f31da07ed5d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.384490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f76ed1-762e-4c13-b48d-f7c05fdf1a1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.385127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f76ed1-762e-4c13-b48d-f7c05fdf1a1f service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.385411 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f76ed1-762e-4c13-b48d-f7c05fdf1a1f service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.385688 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f76ed1-762e-4c13-b48d-f7c05fdf1a1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.394542 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f76ed1-762e-4c13-b48d-f7c05fdf1a1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.396159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f76ed1-762e-4c13-b48d-f7c05fdf1a1f service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.405807 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 696/1392] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:37.829027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e8061-0724-4a21-a85e-441665e63271 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:37.830187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e8061-0724-4a21-a85e-441665e63271 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:37.830187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e8061-0724-4a21-a85e-441665e63271 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:37.832078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 697/1393] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:37.837923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b198e-b4d0-486e-8759-398c91f97410 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:37.838342 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b198e-b4d0-486e-8759-398c91f97410 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:37.838508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b198e-b4d0-486e-8759-398c91f97410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:37.856013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-710b198e-b4d0-486e-8759-398c91f97410 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:37.857192 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-710b198e-b4d0-486e-8759-398c91f97410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:37.865015 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 697/1394] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:37.911513 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e8061-0724-4a21-a85e-441665e63271 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:37.925594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e8061-0724-4a21-a85e-441665e63271 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:37.931158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4607697-a0bb-4c3b-9836-ce98209405e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:37.931779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4607697-a0bb-4c3b-9836-ce98209405e5 service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:37.932060 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4607697-a0bb-4c3b-9836-ce98209405e5 service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:37.932333 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4607697-a0bb-4c3b-9836-ce98209405e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:37.941124 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4607697-a0bb-4c3b-9836-ce98209405e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:37.942744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4607697-a0bb-4c3b-9836-ce98209405e5 service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:37.952085 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 698/1395] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:39.754732 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d709577-172f-4bf7-8672-b77a4e39069d None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.755290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d709577-172f-4bf7-8672-b77a4e39069d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.755290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d709577-172f-4bf7-8672-b77a4e39069d None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.757012 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 698/1396] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:39.762717 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010154c-eca4-429b-ad27-e1329ec7b42f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.763183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010154c-eca4-429b-ad27-e1329ec7b42f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.763310 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010154c-eca4-429b-ad27-e1329ec7b42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.781011 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-7010154c-eca4-429b-ad27-e1329ec7b42f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:39.782234 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-7010154c-eca4-429b-ad27-e1329ec7b42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:39.790627 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 699/1397] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:39.848088 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04147-4458-41f2-81d1-2236bd9dd5aa None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.848379 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04147-4458-41f2-81d1-2236bd9dd5aa None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.848664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04147-4458-41f2-81d1-2236bd9dd5aa None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.850436 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 699/1398] 10.222.0.60 () {54 vars in 962 bytes} [Wed Dec 15 13:24:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:39.856079 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa6b4a-e841-4136-ba8a-f37830e4cd97 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.856373 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa6b4a-e841-4136-ba8a-f37830e4cd97 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.856657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa6b4a-e841-4136-ba8a-f37830e4cd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.905018 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-5eaa6b4a-e841-4136-ba8a-f37830e4cd97 None None] MFA Rules not processed for user `5b9aff45fefe408fa1667e5298f8ff6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:39.906190 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5eaa6b4a-e841-4136-ba8a-f37830e4cd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:39.968708 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 700/1399] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Dec 15 13:24:39 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:39.976723 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f04147-4458-41f2-81d1-2236bd9dd5aa None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.987268 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f04147-4458-41f2-81d1-2236bd9dd5aa None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.990930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d4703-7bf8-4338-b943-1b0be98d80d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9aff45fefe408fa1667e5298f8ff6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.991570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d4703-7bf8-4338-b943-1b0be98d80d3 service glance] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.991861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d4703-7bf8-4338-b943-1b0be98d80d3 service glance] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.992138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d4703-7bf8-4338-b943-1b0be98d80d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:40.001526 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d4703-7bf8-4338-b943-1b0be98d80d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:40.002978 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d4703-7bf8-4338-b943-1b0be98d80d3 service glance] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:40.012255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 700/1400] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:40.321171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317997d6-e64b-45f3-b8fc-7922a511364b None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:40.321471 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317997d6-e64b-45f3-b8fc-7922a511364b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:40.321743 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317997d6-e64b-45f3-b8fc-7922a511364b None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:40.323565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 701/1401] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:40.329591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769341e-3640-4e9d-95c8-98dda9da743c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:40.329884 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769341e-3640-4e9d-95c8-98dda9da743c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:40.330166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769341e-3640-4e9d-95c8-98dda9da743c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:40.349939 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-1769341e-3640-4e9d-95c8-98dda9da743c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:40.351717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-1769341e-3640-4e9d-95c8-98dda9da743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:40.360932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 701/1402] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:40.408338 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317997d6-e64b-45f3-b8fc-7922a511364b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:40.423708 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317997d6-e64b-45f3-b8fc-7922a511364b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:40.428257 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d307a-14a4-4952-940f-72828522802b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:40.428889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d307a-14a4-4952-940f-72828522802b service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:40.429174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d307a-14a4-4952-940f-72828522802b service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:40.429453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d307a-14a4-4952-940f-72828522802b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:40.437762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d307a-14a4-4952-940f-72828522802b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:40.440072 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d307a-14a4-4952-940f-72828522802b service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:40.449677 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 702/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:40.449862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8642c82-0767-40b6-bcf0-edb54e22c63b None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:40.450150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8642c82-0767-40b6-bcf0-edb54e22c63b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:40.450435 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8642c82-0767-40b6-bcf0-edb54e22c63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:40.500555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-f8642c82-0767-40b6-bcf0-edb54e22c63b None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:40.502523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-f8642c82-0767-40b6-bcf0-edb54e22c63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:40.572348 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 702/1404] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:24:40 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:24:40.617231 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23a4d6-073f-4540-ab81-0364ae0d8535 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:40.617616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23a4d6-073f-4540-ab81-0364ae0d8535 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:40.618104 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23a4d6-073f-4540-ab81-0364ae0d8535 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:40.620184 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 703/1405] 10.222.0.60 () {54 vars in 942 bytes} [Wed Dec 15 13:24:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:40.627991 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761ec1-4cc9-4ebd-a60d-f76667f0a47c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:40.628368 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761ec1-4cc9-4ebd-a60d-f76667f0a47c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:40.628721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761ec1-4cc9-4ebd-a60d-f76667f0a47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:40.682764 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-8d761ec1-4cc9-4ebd-a60d-f76667f0a47c None None] MFA Rules not processed for user `27fd1a6075694b2c833b345485d5319c`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:40.684038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8d761ec1-4cc9-4ebd-a60d-f76667f0a47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:40.759419 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 703/1406] 10.222.0.60 () {58 vars in 1039 bytes} [Wed Dec 15 13:24:40 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:40.769210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23a4d6-073f-4540-ab81-0364ae0d8535 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:40.782910 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23a4d6-073f-4540-ab81-0364ae0d8535 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:40.787827 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76b5e5-15e6-4420-830d-57c7a33ae30d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:40.788457 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76b5e5-15e6-4420-830d-57c7a33ae30d service swift] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:40.788805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76b5e5-15e6-4420-830d-57c7a33ae30d service swift] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:40.789080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76b5e5-15e6-4420-830d-57c7a33ae30d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:40.796967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76b5e5-15e6-4420-830d-57c7a33ae30d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:40.799119 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76b5e5-15e6-4420-830d-57c7a33ae30d service swift] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:40.807225 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 704/1407] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:24:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:42.847940 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3ceaf-9fd4-4d6a-8334-14ffb9d97bd6 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.848720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3ceaf-9fd4-4d6a-8334-14ffb9d97bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.849141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3ceaf-9fd4-4d6a-8334-14ffb9d97bd6 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.850965 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 704/1408] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:42.856844 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2a6d-fb4c-4be5-9e66-13546b8dbe57 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.857289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2a6d-fb4c-4be5-9e66-13546b8dbe57 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.857391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2a6d-fb4c-4be5-9e66-13546b8dbe57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.877076 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-24de2a6d-fb4c-4be5-9e66-13546b8dbe57 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:42.878301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-24de2a6d-fb4c-4be5-9e66-13546b8dbe57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:42.886413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 705/1409] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:24:42.932937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3ceaf-9fd4-4d6a-8334-14ffb9d97bd6 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.947367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3ceaf-9fd4-4d6a-8334-14ffb9d97bd6 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.953822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c837a16-9b68-460c-9f54-dda7b084f7ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:42.954487 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c837a16-9b68-460c-9f54-dda7b084f7ec service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.954766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c837a16-9b68-460c-9f54-dda7b084f7ec service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.955093 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c837a16-9b68-460c-9f54-dda7b084f7ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.963761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c837a16-9b68-460c-9f54-dda7b084f7ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:42.965337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c837a16-9b68-460c-9f54-dda7b084f7ec service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:42.975011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 705/1410] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:45.405617 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f4306-430f-42f3-8109-c21a591ed0a8 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.406171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f4306-430f-42f3-8109-c21a591ed0a8 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.406171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f4306-430f-42f3-8109-c21a591ed0a8 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.413829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35324cc-46ca-48e9-b781-329157b1c89d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.414256 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35324cc-46ca-48e9-b781-329157b1c89d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.414897 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35324cc-46ca-48e9-b781-329157b1c89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.420050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 706/1411] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:24:45 2021] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:45.444081 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-e35324cc-46ca-48e9-b781-329157b1c89d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:45.445446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e35324cc-46ca-48e9-b781-329157b1c89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:45.470943 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 706/1412] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:24:45.503200 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f4306-430f-42f3-8109-c21a591ed0a8 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:45.518166 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f4306-430f-42f3-8109-c21a591ed0a8 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:45.523821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97ea61-57ae-4e1c-9693-91396a2d2dd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:45.524566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97ea61-57ae-4e1c-9693-91396a2d2dd4 service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.524927 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97ea61-57ae-4e1c-9693-91396a2d2dd4 service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.525287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97ea61-57ae-4e1c-9693-91396a2d2dd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.534413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97ea61-57ae-4e1c-9693-91396a2d2dd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:45.536158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97ea61-57ae-4e1c-9693-91396a2d2dd4 service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:45.546160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 707/1413] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:24:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:03.694433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c146db6-4341-49e5-95a1-6a66310efc88 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.694898 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c146db6-4341-49e5-95a1-6a66310efc88 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.695058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c146db6-4341-49e5-95a1-6a66310efc88 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.696894 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 707/1414] 10.222.0.60 () {54 vars in 918 bytes} [Wed Dec 15 13:25:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:03.703295 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76715a-ba29-4b66-ac14-b81ee77c4334 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.703721 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76715a-ba29-4b66-ac14-b81ee77c4334 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.703902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76715a-ba29-4b66-ac14-b81ee77c4334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.722804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-2e76715a-ba29-4b66-ac14-b81ee77c4334 None None] MFA Rules not processed for user `8e05695f0d91463bae1f2a67a58cb54b`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:03.724031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-2e76715a-ba29-4b66-ac14-b81ee77c4334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:03.732378 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 708/1415] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Dec 15 13:25:03 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:03.747112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a28e-33d0-496b-af0e-a02926b13d16 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.747405 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a28e-33d0-496b-af0e-a02926b13d16 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.747685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a28e-33d0-496b-af0e-a02926b13d16 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.749466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 708/1416] 10.222.0.60 () {54 vars in 918 bytes} [Wed Dec 15 13:25:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:03.754472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e5f68-8829-4ea8-8843-0a41342c2b50 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.754755 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e5f68-8829-4ea8-8843-0a41342c2b50 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.755053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e5f68-8829-4ea8-8843-0a41342c2b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.772693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-541e5f68-8829-4ea8-8843-0a41342c2b50 None None] MFA Rules not processed for user `d61a8e4d64664e68a5710fdf766e4685`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:03.773845 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-541e5f68-8829-4ea8-8843-0a41342c2b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:03.783778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 709/1417] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Dec 15 13:25:03 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:25:06.517740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bc483-de17-45be-94da-2ee3efb58df1 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.518297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bc483-de17-45be-94da-2ee3efb58df1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.518297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bc483-de17-45be-94da-2ee3efb58df1 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.520079 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 709/1418] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:25:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:06.525859 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446f1ab-ea4c-43c4-aab2-5c05c55d678b None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.526312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446f1ab-ea4c-43c4-aab2-5c05c55d678b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.526412 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446f1ab-ea4c-43c4-aab2-5c05c55d678b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.544311 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-4446f1ab-ea4c-43c4-aab2-5c05c55d678b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:06.545494 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4446f1ab-ea4c-43c4-aab2-5c05c55d678b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:06.553429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 710/1419] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:25:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:06.598500 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bc483-de17-45be-94da-2ee3efb58df1 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.612240 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bc483-de17-45be-94da-2ee3efb58df1 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.617746 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924cf81-345a-4177-a6a1-90835f62591a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.618379 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924cf81-345a-4177-a6a1-90835f62591a service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.618664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924cf81-345a-4177-a6a1-90835f62591a service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.618971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924cf81-345a-4177-a6a1-90835f62591a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.626901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924cf81-345a-4177-a6a1-90835f62591a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.628470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924cf81-345a-4177-a6a1-90835f62591a service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.637501 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 710/1420] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:08.207915 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f72d49-80a1-421e-b489-4b3f9239aa60 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:08.208454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f72d49-80a1-421e-b489-4b3f9239aa60 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:08.208454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f72d49-80a1-421e-b489-4b3f9239aa60 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:08.210262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 711/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:25:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:08.215783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d56da-96c1-4475-8d99-b36957e8d246 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:08.216189 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d56da-96c1-4475-8d99-b36957e8d246 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:08.216364 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d56da-96c1-4475-8d99-b36957e8d246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:08.234413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-9f1d56da-96c1-4475-8d99-b36957e8d246 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:08.235631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9f1d56da-96c1-4475-8d99-b36957e8d246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:08.243190 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 711/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:25:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:08.394867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f72d49-80a1-421e-b489-4b3f9239aa60 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:08.409127 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f72d49-80a1-421e-b489-4b3f9239aa60 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:08.414357 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68e593-f839-498a-aaea-5f2b99a34591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:08.415013 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68e593-f839-498a-aaea-5f2b99a34591 service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:08.415293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68e593-f839-498a-aaea-5f2b99a34591 service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:08.415564 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68e593-f839-498a-aaea-5f2b99a34591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:08.423809 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68e593-f839-498a-aaea-5f2b99a34591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:08.425368 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68e593-f839-498a-aaea-5f2b99a34591 service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:08.434526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 712/1423] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:10.059045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c70219-96b8-4b9b-85e2-fa0f24e54fe5 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:10.059630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c70219-96b8-4b9b-85e2-fa0f24e54fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:10.059630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c70219-96b8-4b9b-85e2-fa0f24e54fe5 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:10.061941 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 712/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:25:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:10.067265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d3e5-28e4-4147-a6f3-fc908b306ef4 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:10.067711 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d3e5-28e4-4147-a6f3-fc908b306ef4 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:10.067814 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d3e5-28e4-4147-a6f3-fc908b306ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:10.086075 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-f987d3e5-28e4-4147-a6f3-fc908b306ef4 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:10.087288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f987d3e5-28e4-4147-a6f3-fc908b306ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:10.095027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 713/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:25:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:10.245844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c70219-96b8-4b9b-85e2-fa0f24e54fe5 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:10.260499 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c70219-96b8-4b9b-85e2-fa0f24e54fe5 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:10.265858 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6b1a6-13c4-40d9-b767-1041a7c2a23b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:10.266486 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6b1a6-13c4-40d9-b767-1041a7c2a23b service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:10.266772 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6b1a6-13c4-40d9-b767-1041a7c2a23b service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:10.267086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6b1a6-13c4-40d9-b767-1041a7c2a23b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:10.274983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6b1a6-13c4-40d9-b767-1041a7c2a23b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:10.276569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6b1a6-13c4-40d9-b767-1041a7c2a23b service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:10.285664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 713/1426] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:11.797014 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d3d16-a1b4-4167-8a2a-7ea3d494ba9b None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:11.797565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d3d16-a1b4-4167-8a2a-7ea3d494ba9b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:11.797565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d3d16-a1b4-4167-8a2a-7ea3d494ba9b None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:11.799660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 714/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:25:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:25:11.805413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688ef7-c286-4c43-87fa-eb9d1c8b118c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:11.805812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688ef7-c286-4c43-87fa-eb9d1c8b118c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:11.805976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688ef7-c286-4c43-87fa-eb9d1c8b118c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:11.824981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-a4688ef7-c286-4c43-87fa-eb9d1c8b118c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:11.826207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a4688ef7-c286-4c43-87fa-eb9d1c8b118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:11.833855 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 714/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:25:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:11.993090 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d3d16-a1b4-4167-8a2a-7ea3d494ba9b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.008038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d3d16-a1b4-4167-8a2a-7ea3d494ba9b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.013566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6059c4-10b9-448b-9c7d-7077e3011078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.014202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6059c4-10b9-448b-9c7d-7077e3011078 service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.014485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6059c4-10b9-448b-9c7d-7077e3011078 service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.014764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6059c4-10b9-448b-9c7d-7077e3011078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.022815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6059c4-10b9-448b-9c7d-7077e3011078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.024415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6059c4-10b9-448b-9c7d-7077e3011078 service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.033465 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 715/1429] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:13.557159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ed2e6-a158-439f-85ff-dbc78870cb06 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:13.557716 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ed2e6-a158-439f-85ff-dbc78870cb06 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:13.557716 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ed2e6-a158-439f-85ff-dbc78870cb06 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:13.559495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 715/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:25:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:13.565406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259f833-957c-4340-b930-f604834dc055 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:13.565839 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259f833-957c-4340-b930-f604834dc055 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:13.565995 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259f833-957c-4340-b930-f604834dc055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:13.583551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-3259f833-957c-4340-b930-f604834dc055 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:13.584730 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-3259f833-957c-4340-b930-f604834dc055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:13.593091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 716/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:25:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:13.746128 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ed2e6-a158-439f-85ff-dbc78870cb06 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:13.759770 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ed2e6-a158-439f-85ff-dbc78870cb06 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:13.765009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131bab7-e285-4fad-b880-5bd552b7e594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:13.765630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131bab7-e285-4fad-b880-5bd552b7e594 service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:13.765906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131bab7-e285-4fad-b880-5bd552b7e594 service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:13.766179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131bab7-e285-4fad-b880-5bd552b7e594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:13.774285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131bab7-e285-4fad-b880-5bd552b7e594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:13.776273 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131bab7-e285-4fad-b880-5bd552b7e594 service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:13.786098 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 716/1432] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:15.261788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e6e33-c08d-4829-af00-132e51f5851b None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:15.262233 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e6e33-c08d-4829-af00-132e51f5851b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:15.262351 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e6e33-c08d-4829-af00-132e51f5851b None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:15.264765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 717/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:25:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:15.270224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dbae1-3cbd-4afc-ac56-d10f0782e6f1 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:15.270650 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dbae1-3cbd-4afc-ac56-d10f0782e6f1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:15.270783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dbae1-3cbd-4afc-ac56-d10f0782e6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:15.288489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-395dbae1-3cbd-4afc-ac56-d10f0782e6f1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:15.289675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-395dbae1-3cbd-4afc-ac56-d10f0782e6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:15.297431 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 717/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:25:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:15.449362 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e6e33-c08d-4829-af00-132e51f5851b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:15.463922 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e6e33-c08d-4829-af00-132e51f5851b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:15.469331 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5213e3-772e-4d8e-982f-4a65c94b262c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:15.469955 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5213e3-772e-4d8e-982f-4a65c94b262c service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:15.470240 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5213e3-772e-4d8e-982f-4a65c94b262c service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:15.470523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5213e3-772e-4d8e-982f-4a65c94b262c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:15.478453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5213e3-772e-4d8e-982f-4a65c94b262c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:15.480072 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5213e3-772e-4d8e-982f-4a65c94b262c service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:15.489875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 718/1435] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:16.957875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac82831-2ed9-4301-87ce-4cf1542297b3 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:16.958403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac82831-2ed9-4301-87ce-4cf1542297b3 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:16.958403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac82831-2ed9-4301-87ce-4cf1542297b3 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:16.960236 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 718/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:25:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:16.965963 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28a17d-ac15-4392-9c9b-9fa8fae76d6b None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:16.966359 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28a17d-ac15-4392-9c9b-9fa8fae76d6b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:16.967185 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28a17d-ac15-4392-9c9b-9fa8fae76d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:16.984678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ac28a17d-ac15-4392-9c9b-9fa8fae76d6b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:16.985845 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ac28a17d-ac15-4392-9c9b-9fa8fae76d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:16.993410 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 719/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:25:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:17.146954 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac82831-2ed9-4301-87ce-4cf1542297b3 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:17.161400 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac82831-2ed9-4301-87ce-4cf1542297b3 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:17.166698 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466264c-cdc7-4404-87da-52df2edb0b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:17.167352 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466264c-cdc7-4404-87da-52df2edb0b4d service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:17.167633 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466264c-cdc7-4404-87da-52df2edb0b4d service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:17.167905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466264c-cdc7-4404-87da-52df2edb0b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:17.175928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466264c-cdc7-4404-87da-52df2edb0b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:17.177484 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466264c-cdc7-4404-87da-52df2edb0b4d service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:17.186538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 719/1438] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:18.664880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4e09-3ee0-4fe4-880a-21e97ee36576 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:18.665380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4e09-3ee0-4fe4-880a-21e97ee36576 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:18.665380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4e09-3ee0-4fe4-880a-21e97ee36576 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:18.667336 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 720/1439] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:25:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:18.674777 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee29185-7978-4df2-8647-4aedacf9b62b None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:18.675488 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee29185-7978-4df2-8647-4aedacf9b62b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:18.675661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee29185-7978-4df2-8647-4aedacf9b62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:18.694048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-fee29185-7978-4df2-8647-4aedacf9b62b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:18.695276 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-fee29185-7978-4df2-8647-4aedacf9b62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:18.702976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 720/1440] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:25:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:18.856674 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c4e09-3ee0-4fe4-880a-21e97ee36576 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:18.871202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c4e09-3ee0-4fe4-880a-21e97ee36576 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:18.876600 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f9bc9-67a3-49aa-ac20-4bfde1a491a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:18.877219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f9bc9-67a3-49aa-ac20-4bfde1a491a7 service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:18.877503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f9bc9-67a3-49aa-ac20-4bfde1a491a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:18.877780 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f9bc9-67a3-49aa-ac20-4bfde1a491a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:18.885589 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f9bc9-67a3-49aa-ac20-4bfde1a491a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:18.887219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f9bc9-67a3-49aa-ac20-4bfde1a491a7 service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:18.896270 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 721/1441] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:20.363679 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e3f13-5d47-4703-870b-dd5319c9bdfe None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:20.364224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e3f13-5d47-4703-870b-dd5319c9bdfe None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:20.364451 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e3f13-5d47-4703-870b-dd5319c9bdfe None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:20.366459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 721/1442] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:25:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:20.372019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3c2e5-c7bb-43ff-8731-4ca450c6e1d1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:20.372444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3c2e5-c7bb-43ff-8731-4ca450c6e1d1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:20.372599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3c2e5-c7bb-43ff-8731-4ca450c6e1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:20.390735 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-acc3c2e5-c7bb-43ff-8731-4ca450c6e1d1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:20.391937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-acc3c2e5-c7bb-43ff-8731-4ca450c6e1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:20.399503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 722/1443] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:25:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:20.551383 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e3f13-5d47-4703-870b-dd5319c9bdfe None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:20.565022 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e3f13-5d47-4703-870b-dd5319c9bdfe None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:20.570179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237e33e-3943-4044-8d93-a9f519256f51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:20.570798 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237e33e-3943-4044-8d93-a9f519256f51 service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:20.571113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237e33e-3943-4044-8d93-a9f519256f51 service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:20.571383 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237e33e-3943-4044-8d93-a9f519256f51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:20.579199 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237e33e-3943-4044-8d93-a9f519256f51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:20.580746 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237e33e-3943-4044-8d93-a9f519256f51 service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:20.590042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 722/1444] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:22.822527 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933fd35-57cc-4214-9a74-7bd07f0558ba None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:22.823091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933fd35-57cc-4214-9a74-7bd07f0558ba None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:22.823091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933fd35-57cc-4214-9a74-7bd07f0558ba None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:22.824885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 723/1445] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:25:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:22.834051 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54c3b4-47fd-45f4-8db7-66bfcc2d9b8f None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:22.834477 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54c3b4-47fd-45f4-8db7-66bfcc2d9b8f None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:22.834645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54c3b4-47fd-45f4-8db7-66bfcc2d9b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:22.855782 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-cc54c3b4-47fd-45f4-8db7-66bfcc2d9b8f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:22.857646 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-cc54c3b4-47fd-45f4-8db7-66bfcc2d9b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:22.866140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 723/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:25:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:22.905709 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933fd35-57cc-4214-9a74-7bd07f0558ba None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:22.916385 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933fd35-57cc-4214-9a74-7bd07f0558ba None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:22.920440 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c94c6c-a28c-4748-9a51-c1a9d5824f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:22.921356 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c94c6c-a28c-4748-9a51-c1a9d5824f75 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:22.921645 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c94c6c-a28c-4748-9a51-c1a9d5824f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:22.921920 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c94c6c-a28c-4748-9a51-c1a9d5824f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:22.930808 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c94c6c-a28c-4748-9a51-c1a9d5824f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:22.932267 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c94c6c-a28c-4748-9a51-c1a9d5824f75 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:22.941328 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 724/1447] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:25.457271 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8841a50-bc40-460a-82e2-16c50982338c None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:25.457825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8841a50-bc40-460a-82e2-16c50982338c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:25.457825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8841a50-bc40-460a-82e2-16c50982338c None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:25.459652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 724/1448] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:25:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:25.465747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e34cc-b371-4379-8086-267270a4dbd3 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:25.466745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e34cc-b371-4379-8086-267270a4dbd3 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:25.466885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e34cc-b371-4379-8086-267270a4dbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:25.484121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-294e34cc-b371-4379-8086-267270a4dbd3 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:25.485224 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-294e34cc-b371-4379-8086-267270a4dbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:25.492774 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 725/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:25:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:25.532226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8841a50-bc40-460a-82e2-16c50982338c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:25.542503 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8841a50-bc40-460a-82e2-16c50982338c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:25.545972 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afc06a-8821-4eec-bea5-97d864233d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:25.546593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afc06a-8821-4eec-bea5-97d864233d58 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:25.546900 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afc06a-8821-4eec-bea5-97d864233d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:25.547177 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afc06a-8821-4eec-bea5-97d864233d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:25.555995 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afc06a-8821-4eec-bea5-97d864233d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:25.557393 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afc06a-8821-4eec-bea5-97d864233d58 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:25.566871 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 725/1450] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:28.279579 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc33b7-a03a-4c66-81d2-7dd15524a86d None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:28.280145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc33b7-a03a-4c66-81d2-7dd15524a86d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:28.280145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc33b7-a03a-4c66-81d2-7dd15524a86d None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:28.281875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 726/1451] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:25:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:28.287805 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a04b69-85f9-4c94-aecf-67e0a82bd7f2 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:28.288207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a04b69-85f9-4c94-aecf-67e0a82bd7f2 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:28.288361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a04b69-85f9-4c94-aecf-67e0a82bd7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:28.305862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-a1a04b69-85f9-4c94-aecf-67e0a82bd7f2 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:28.307085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a1a04b69-85f9-4c94-aecf-67e0a82bd7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:28.315133 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 726/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:25:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:28.355389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc33b7-a03a-4c66-81d2-7dd15524a86d None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:28.365761 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc33b7-a03a-4c66-81d2-7dd15524a86d None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:28.369247 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190a871-1e5e-4a51-b585-0091fa2549fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:28.369864 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a871-1e5e-4a51-b585-0091fa2549fd service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:28.370138 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a871-1e5e-4a51-b585-0091fa2549fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:28.370410 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a871-1e5e-4a51-b585-0091fa2549fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:28.379002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190a871-1e5e-4a51-b585-0091fa2549fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:28.380424 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190a871-1e5e-4a51-b585-0091fa2549fd service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:28.389884 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 727/1453] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:30.832511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a23104-58f8-4d5f-b54a-d8efa6d27831 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:30.833067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a23104-58f8-4d5f-b54a-d8efa6d27831 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:30.833067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a23104-58f8-4d5f-b54a-d8efa6d27831 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:30.834835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 727/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:25:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:30.840753 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1153e4-dc0e-488c-bfc4-dc815cf00962 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:30.841174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1153e4-dc0e-488c-bfc4-dc815cf00962 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:30.841284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1153e4-dc0e-488c-bfc4-dc815cf00962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:30.858506 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-4b1153e4-dc0e-488c-bfc4-dc815cf00962 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:30.859716 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4b1153e4-dc0e-488c-bfc4-dc815cf00962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:30.867332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 728/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:25:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:30.906869 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a23104-58f8-4d5f-b54a-d8efa6d27831 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:30.921392 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a23104-58f8-4d5f-b54a-d8efa6d27831 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:30.929637 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8b41e-0312-4082-a662-62af6479ba67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:30.930276 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b41e-0312-4082-a662-62af6479ba67 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:30.930555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b41e-0312-4082-a662-62af6479ba67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:30.930827 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b41e-0312-4082-a662-62af6479ba67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:30.941514 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8b41e-0312-4082-a662-62af6479ba67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:30.943029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8b41e-0312-4082-a662-62af6479ba67 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:30.952699 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 728/1456] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:33.328347 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e49a3-832a-46fd-b93a-08d20694033b None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:33.328871 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e49a3-832a-46fd-b93a-08d20694033b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:33.328967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e49a3-832a-46fd-b93a-08d20694033b None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:33.330673 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 729/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:25:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:33.336686 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffebe9-2524-42b7-9f42-3ddba74773e8 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:33.337081 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffebe9-2524-42b7-9f42-3ddba74773e8 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:33.337287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffebe9-2524-42b7-9f42-3ddba74773e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:33.355407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-1bffebe9-2524-42b7-9f42-3ddba74773e8 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:33.357295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-1bffebe9-2524-42b7-9f42-3ddba74773e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:33.364963 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 729/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:25:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:33.403694 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e49a3-832a-46fd-b93a-08d20694033b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:33.414041 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e49a3-832a-46fd-b93a-08d20694033b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:33.417594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23b693-9b09-422e-bddb-1b56d77b56c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:33.418223 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23b693-9b09-422e-bddb-1b56d77b56c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:33.418506 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23b693-9b09-422e-bddb-1b56d77b56c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:33.419408 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23b693-9b09-422e-bddb-1b56d77b56c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:33.428332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23b693-9b09-422e-bddb-1b56d77b56c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:33.429767 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23b693-9b09-422e-bddb-1b56d77b56c7 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:33.439015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 730/1459] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:35.840259 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e4fe1-220a-4435-8019-f6e6b9ea79c2 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:35.840795 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e4fe1-220a-4435-8019-f6e6b9ea79c2 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:35.840892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e4fe1-220a-4435-8019-f6e6b9ea79c2 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:35.843211 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 730/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:25:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:35.849224 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788f0cd-4fa0-4ae8-b83d-0909da1b5567 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:35.849659 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788f0cd-4fa0-4ae8-b83d-0909da1b5567 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:35.849781 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788f0cd-4fa0-4ae8-b83d-0909da1b5567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:35.867318 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-0788f0cd-4fa0-4ae8-b83d-0909da1b5567 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:35.868523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0788f0cd-4fa0-4ae8-b83d-0909da1b5567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:35.876112 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 731/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:25:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:35.915060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e4fe1-220a-4435-8019-f6e6b9ea79c2 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:35.925633 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e4fe1-220a-4435-8019-f6e6b9ea79c2 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:35.929132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde490-0407-4c19-9575-c9bb54d7f421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:35.929762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde490-0407-4c19-9575-c9bb54d7f421 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:35.930046 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde490-0407-4c19-9575-c9bb54d7f421 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:35.930325 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde490-0407-4c19-9575-c9bb54d7f421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:35.939153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dde490-0407-4c19-9575-c9bb54d7f421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:35.940590 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dde490-0407-4c19-9575-c9bb54d7f421 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:35.950354 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 731/1462] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:38.364779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22409bd7-2c84-4133-b9ba-da78d9d12a84 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:38.365365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22409bd7-2c84-4133-b9ba-da78d9d12a84 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:38.365365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22409bd7-2c84-4133-b9ba-da78d9d12a84 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:38.367150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 732/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:25:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:38.373464 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fc983-6bd4-4dc1-8832-e4c3aff6cf76 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:38.373890 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fc983-6bd4-4dc1-8832-e4c3aff6cf76 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:38.374057 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fc983-6bd4-4dc1-8832-e4c3aff6cf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:38.391901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-1a9fc983-6bd4-4dc1-8832-e4c3aff6cf76 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:38.393072 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-1a9fc983-6bd4-4dc1-8832-e4c3aff6cf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:38.400639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 732/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:25:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:38.438813 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22409bd7-2c84-4133-b9ba-da78d9d12a84 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:38.449383 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22409bd7-2c84-4133-b9ba-da78d9d12a84 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:38.453513 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b9f63-c0cd-4a7c-b6fa-31172d46fcc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:38.454137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b9f63-c0cd-4a7c-b6fa-31172d46fcc3 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:38.454420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b9f63-c0cd-4a7c-b6fa-31172d46fcc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:38.454699 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b9f63-c0cd-4a7c-b6fa-31172d46fcc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:38.463408 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b9f63-c0cd-4a7c-b6fa-31172d46fcc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:38.465124 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b9f63-c0cd-4a7c-b6fa-31172d46fcc3 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:38.474253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 733/1465] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:40.868728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b05084-6738-4900-81a1-4b5f8d444dbd None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:40.869305 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b05084-6738-4900-81a1-4b5f8d444dbd None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:40.869305 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b05084-6738-4900-81a1-4b5f8d444dbd None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:40.871097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 733/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:25:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:40.876917 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd91f1-8893-4def-b777-6b2de5bc4b5f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:40.877336 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd91f1-8893-4def-b777-6b2de5bc4b5f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:40.877485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd91f1-8893-4def-b777-6b2de5bc4b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:40.895164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-2dbd91f1-8893-4def-b777-6b2de5bc4b5f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:40.896347 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-2dbd91f1-8893-4def-b777-6b2de5bc4b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:40.904776 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 734/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:25:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:40.943452 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b05084-6738-4900-81a1-4b5f8d444dbd None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:40.954278 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b05084-6738-4900-81a1-4b5f8d444dbd None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:40.957738 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5e554-75d8-4d4a-9616-ce6d0ed812c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:40.958365 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5e554-75d8-4d4a-9616-ce6d0ed812c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:40.958645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5e554-75d8-4d4a-9616-ce6d0ed812c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:40.958961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5e554-75d8-4d4a-9616-ce6d0ed812c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:40.968214 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5e554-75d8-4d4a-9616-ce6d0ed812c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:40.969625 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5e554-75d8-4d4a-9616-ce6d0ed812c8 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:40.978908 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 734/1468] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:43.320297 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784a2d0-eac3-4180-9574-4eac9a38039f None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:43.320818 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784a2d0-eac3-4180-9574-4eac9a38039f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:43.320938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784a2d0-eac3-4180-9574-4eac9a38039f None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:43.322620 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 735/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:25:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:43.329038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98147ae2-bbbc-445b-be8e-3ef2e6108c90 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:43.329459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98147ae2-bbbc-445b-be8e-3ef2e6108c90 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:43.329625 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98147ae2-bbbc-445b-be8e-3ef2e6108c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:43.347758 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-98147ae2-bbbc-445b-be8e-3ef2e6108c90 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:43.348967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-98147ae2-bbbc-445b-be8e-3ef2e6108c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:43.357192 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 735/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:25:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:25:43.394797 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784a2d0-eac3-4180-9574-4eac9a38039f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:43.406014 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784a2d0-eac3-4180-9574-4eac9a38039f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:43.409760 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff6796-58e8-4ca5-8c6a-3093e5582c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:43.410525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff6796-58e8-4ca5-8c6a-3093e5582c82 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:43.410865 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff6796-58e8-4ca5-8c6a-3093e5582c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:43.411214 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff6796-58e8-4ca5-8c6a-3093e5582c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:43.421019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff6796-58e8-4ca5-8c6a-3093e5582c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:43.422492 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff6796-58e8-4ca5-8c6a-3093e5582c82 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:43.431873 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 736/1471] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:45.777030 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75225f9b-9d68-44e3-ae92-ef92cf8ad7a1 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:45.777560 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75225f9b-9d68-44e3-ae92-ef92cf8ad7a1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:45.777692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75225f9b-9d68-44e3-ae92-ef92cf8ad7a1 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:45.779456 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 736/1472] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:25:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:45.785612 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c357b-d431-4bb5-961f-86fa1e162f8d None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:45.786064 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c357b-d431-4bb5-961f-86fa1e162f8d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:45.786155 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c357b-d431-4bb5-961f-86fa1e162f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:45.806127 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ac1c357b-d431-4bb5-961f-86fa1e162f8d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:45.807471 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ac1c357b-d431-4bb5-961f-86fa1e162f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:45.816140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 737/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:25:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:45.853756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75225f9b-9d68-44e3-ae92-ef92cf8ad7a1 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:45.865764 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75225f9b-9d68-44e3-ae92-ef92cf8ad7a1 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:45.869578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02574de7-4f3d-40b9-9618-27b2c59d38f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:45.870216 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574de7-4f3d-40b9-9618-27b2c59d38f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:45.870533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574de7-4f3d-40b9-9618-27b2c59d38f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:45.870808 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574de7-4f3d-40b9-9618-27b2c59d38f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:45.880065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02574de7-4f3d-40b9-9618-27b2c59d38f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:45.881501 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02574de7-4f3d-40b9-9618-27b2c59d38f0 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:45.890775 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 737/1474] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:25:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:26:02.927051 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc94a56-6e44-483a-93f6-95ac1e4efba9 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:02.927635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc94a56-6e44-483a-93f6-95ac1e4efba9 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:02.927635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc94a56-6e44-483a-93f6-95ac1e4efba9 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:02.929425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 738/1475] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:26:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:26:02.935263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9639a-3229-4fee-8993-43cc3bb8605c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:02.935710 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9639a-3229-4fee-8993-43cc3bb8605c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:02.935815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9639a-3229-4fee-8993-43cc3bb8605c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:02.953741 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-1db9639a-3229-4fee-8993-43cc3bb8605c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:26:02.954926 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-1db9639a-3229-4fee-8993-43cc3bb8605c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:26:02.962485 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 738/1476] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:26:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:26:03.009976 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79966608-b4e6-44fc-8a2d-52a915460c3b None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:03.010265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79966608-b4e6-44fc-8a2d-52a915460c3b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:03.010539 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79966608-b4e6-44fc-8a2d-52a915460c3b None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:03.012836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 739/1477] 10.222.0.60 () {54 vars in 962 bytes} [Wed Dec 15 13:26:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:26:03.018124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54150e-8b2a-4d1b-a728-41e80daf9d0a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:03.018413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54150e-8b2a-4d1b-a728-41e80daf9d0a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:03.018697 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54150e-8b2a-4d1b-a728-41e80daf9d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:03.038570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-af54150e-8b2a-4d1b-a728-41e80daf9d0a None None] MFA Rules not processed for user `5b9aff45fefe408fa1667e5298f8ff6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:26:03.039812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-af54150e-8b2a-4d1b-a728-41e80daf9d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:26:03.046221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 739/1478] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Dec 15 13:26:03 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:26:03.054268 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79966608-b4e6-44fc-8a2d-52a915460c3b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:26:03.065183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79966608-b4e6-44fc-8a2d-52a915460c3b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:26:03.069414 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442823f-032e-4982-a974-c02eff5ced69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9aff45fefe408fa1667e5298f8ff6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:26:03.070040 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442823f-032e-4982-a974-c02eff5ced69 service glance] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:03.070324 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442823f-032e-4982-a974-c02eff5ced69 service glance] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:03.070604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442823f-032e-4982-a974-c02eff5ced69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:03.079307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442823f-032e-4982-a974-c02eff5ced69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:26:03.080730 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442823f-032e-4982-a974-c02eff5ced69 service glance] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:26:03.090440 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 740/1479] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:26:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:26:05.514132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b4cbd-fd1b-435a-a86d-2783b0dded69 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:05.514682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b4cbd-fd1b-435a-a86d-2783b0dded69 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:05.514682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b4cbd-fd1b-435a-a86d-2783b0dded69 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:05.516406 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 740/1480] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:26:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:26:05.522288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e89d-bde1-40ff-8ff8-d1e836702938 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:05.522682 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e89d-bde1-40ff-8ff8-d1e836702938 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:05.522865 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e89d-bde1-40ff-8ff8-d1e836702938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:05.541418 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-8767e89d-bde1-40ff-8ff8-d1e836702938 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:26:05.542596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-8767e89d-bde1-40ff-8ff8-d1e836702938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:26:05.550637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 741/1481] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:26:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:26:05.575513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b4cbd-fd1b-435a-a86d-2783b0dded69 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:26:05.587669 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b4cbd-fd1b-435a-a86d-2783b0dded69 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:26:05.592024 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1d7d6-9f81-4418-b198-378aa4bec42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:26:05.592661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1d7d6-9f81-4418-b198-378aa4bec42f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:05.592941 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1d7d6-9f81-4418-b198-378aa4bec42f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:05.593217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1d7d6-9f81-4418-b198-378aa4bec42f admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:05.593959 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1d7d6-9f81-4418-b198-378aa4bec42f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:26:05.595829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1d7d6-9f81-4418-b198-378aa4bec42f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:26:05.614595 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 741/1482] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Dec 15 13:26:05 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:26:07.977947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9f8d4-06fd-4c0c-92f5-bde37374a0f5 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:07.978490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9f8d4-06fd-4c0c-92f5-bde37374a0f5 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:07.978490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9f8d4-06fd-4c0c-92f5-bde37374a0f5 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:07.980819 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 742/1483] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:26:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:26:07.988864 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb41d5e-6196-43be-bac2-94736b82cc54 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:07.989304 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb41d5e-6196-43be-bac2-94736b82cc54 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:07.989457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb41d5e-6196-43be-bac2-94736b82cc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:08.007502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-2cb41d5e-6196-43be-bac2-94736b82cc54 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:26:08.008684 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2cb41d5e-6196-43be-bac2-94736b82cc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:26:08.016534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 742/1484] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:26:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:26:08.060232 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9f8d4-06fd-4c0c-92f5-bde37374a0f5 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:26:08.074096 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9f8d4-06fd-4c0c-92f5-bde37374a0f5 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:26:08.079370 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300200b-9f21-40ea-9626-4b35f8213deb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:26:08.080005 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300200b-9f21-40ea-9626-4b35f8213deb service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:08.080272 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300200b-9f21-40ea-9626-4b35f8213deb service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:08.080548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300200b-9f21-40ea-9626-4b35f8213deb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:08.088461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300200b-9f21-40ea-9626-4b35f8213deb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:26:08.090093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300200b-9f21-40ea-9626-4b35f8213deb service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:26:08.099172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 743/1485] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:26:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:26:10.644976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256244a2-9cf1-4ed6-b983-50eabd39e845 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:10.645544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256244a2-9cf1-4ed6-b983-50eabd39e845 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:10.645544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256244a2-9cf1-4ed6-b983-50eabd39e845 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:10.647394 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 743/1486] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:26:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:26:10.653353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425027f2-2fa0-4d08-8ba2-2525caf5cefd None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:10.653803 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425027f2-2fa0-4d08-8ba2-2525caf5cefd None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:10.654099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425027f2-2fa0-4d08-8ba2-2525caf5cefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:10.673561 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-425027f2-2fa0-4d08-8ba2-2525caf5cefd None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:26:10.674768 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-425027f2-2fa0-4d08-8ba2-2525caf5cefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:26:10.682991 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 744/1487] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:26:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:26:10.725293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256244a2-9cf1-4ed6-b983-50eabd39e845 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:26:10.737209 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256244a2-9cf1-4ed6-b983-50eabd39e845 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:26:10.741232 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618ce1e-4203-4712-9e94-c50b5904631b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:26:10.741871 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618ce1e-4203-4712-9e94-c50b5904631b service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:10.742156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618ce1e-4203-4712-9e94-c50b5904631b service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:10.742434 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618ce1e-4203-4712-9e94-c50b5904631b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:10.752033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618ce1e-4203-4712-9e94-c50b5904631b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:26:10.753467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618ce1e-4203-4712-9e94-c50b5904631b service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:26:10.763596 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 744/1488] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:26:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:26:13.178252 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f34acd-f692-4485-8ac9-0182311ef0a7 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:13.178789 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f34acd-f692-4485-8ac9-0182311ef0a7 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:13.178789 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f34acd-f692-4485-8ac9-0182311ef0a7 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:13.180592 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 745/1489] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:26:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:26:13.186261 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041c4dd-aed5-44a9-9db0-22723868cd2d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:13.186665 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041c4dd-aed5-44a9-9db0-22723868cd2d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:13.186828 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041c4dd-aed5-44a9-9db0-22723868cd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:13.205861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-e041c4dd-aed5-44a9-9db0-22723868cd2d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:26:13.207089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e041c4dd-aed5-44a9-9db0-22723868cd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:26:13.215642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 745/1490] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:26:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:26:13.253553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f34acd-f692-4485-8ac9-0182311ef0a7 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:26:13.264346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f34acd-f692-4485-8ac9-0182311ef0a7 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:26:13.267775 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfe510-d247-4a49-a6f5-a8f45e5d4a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:26:13.268391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfe510-d247-4a49-a6f5-a8f45e5d4a30 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:13.268666 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfe510-d247-4a49-a6f5-a8f45e5d4a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:13.268939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfe510-d247-4a49-a6f5-a8f45e5d4a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:13.278050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfe510-d247-4a49-a6f5-a8f45e5d4a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:26:13.279497 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfe510-d247-4a49-a6f5-a8f45e5d4a30 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:26:13.288399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 746/1491] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:26:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:26:15.787586 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748254b-6b63-4884-8156-fff4edbeb54c None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:15.788103 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748254b-6b63-4884-8156-fff4edbeb54c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:15.788227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748254b-6b63-4884-8156-fff4edbeb54c None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:15.790123 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 746/1492] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:26:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:26:15.796137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253fe0-5d9b-4e3b-9728-067b658a6783 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:15.796608 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253fe0-5d9b-4e3b-9728-067b658a6783 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:15.796710 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253fe0-5d9b-4e3b-9728-067b658a6783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:15.815717 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-bd253fe0-5d9b-4e3b-9728-067b658a6783 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:26:15.816890 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-bd253fe0-5d9b-4e3b-9728-067b658a6783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:26:15.825409 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 747/1493] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:26:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:26:15.866323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748254b-6b63-4884-8156-fff4edbeb54c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:26:15.877102 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748254b-6b63-4884-8156-fff4edbeb54c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:26:15.880580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b10e3-c2ee-449b-a5be-510589bd7eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:26:15.881198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b10e3-c2ee-449b-a5be-510589bd7eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:15.881477 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b10e3-c2ee-449b-a5be-510589bd7eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:15.881751 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b10e3-c2ee-449b-a5be-510589bd7eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:15.890957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b10e3-c2ee-449b-a5be-510589bd7eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:26:15.892358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b10e3-c2ee-449b-a5be-510589bd7eb8 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:26:15.901556 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 747/1494] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:26:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:26:18.536537 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da927c-c5de-4eb6-9dc0-fbc1114b8877 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:18.537091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da927c-c5de-4eb6-9dc0-fbc1114b8877 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:18.537091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da927c-c5de-4eb6-9dc0-fbc1114b8877 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:18.538897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 748/1495] 10.222.0.60 () {54 vars in 926 bytes} [Wed Dec 15 13:26:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:26:18.545222 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbea2f-abb3-4155-9b31-25e60c35e5f5 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:18.545640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbea2f-abb3-4155-9b31-25e60c35e5f5 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:18.545761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbea2f-abb3-4155-9b31-25e60c35e5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:18.564160 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-adfbea2f-abb3-4155-9b31-25e60c35e5f5 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:26:18.565335 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-adfbea2f-abb3-4155-9b31-25e60c35e5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:26:18.572893 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 748/1496] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Dec 15 13:26:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:26:18.612977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da927c-c5de-4eb6-9dc0-fbc1114b8877 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:26:18.624099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da927c-c5de-4eb6-9dc0-fbc1114b8877 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:26:18.627581 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c8637-dfca-439e-8ea8-a1ae8e37c9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:26:18.628203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c8637-dfca-439e-8ea8-a1ae8e37c9ac service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:18.628485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c8637-dfca-439e-8ea8-a1ae8e37c9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:18.628763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c8637-dfca-439e-8ea8-a1ae8e37c9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:18.637379 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c8637-dfca-439e-8ea8-a1ae8e37c9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:26:18.638800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c8637-dfca-439e-8ea8-a1ae8e37c9ac service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:26:18.648284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 749/1497] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:26:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:27:30.590566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e7889-3d53-4f57-ae2d-d443a99db042 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:30.591179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e7889-3d53-4f57-ae2d-d443a99db042 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:30.591179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e7889-3d53-4f57-ae2d-d443a99db042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:30.609338 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-933e7889-3d53-4f57-ae2d-d443a99db042 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:27:30.610527 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-933e7889-3d53-4f57-ae2d-d443a99db042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:30.618183 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 749/1498] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:27:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:27:30.626637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ce9f-904a-4432-8016-20a9554dd6c5 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:30.627130 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ce9f-904a-4432-8016-20a9554dd6c5 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:30.627236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ce9f-904a-4432-8016-20a9554dd6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:30.645241 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-9020ce9f-904a-4432-8016-20a9554dd6c5 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:27:30.646415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9020ce9f-904a-4432-8016-20a9554dd6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:30.654636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 750/1499] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:27:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:27:30.659105 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e7889-3d53-4f57-ae2d-d443a99db042 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:30.668583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e7889-3d53-4f57-ae2d-d443a99db042 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:30.673011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b18aa-8300-4a3d-9d71-4892cbfe87f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:30.673657 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b18aa-8300-4a3d-9d71-4892cbfe87f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:30.673937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b18aa-8300-4a3d-9d71-4892cbfe87f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:30.674212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b18aa-8300-4a3d-9d71-4892cbfe87f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:30.674987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b18aa-8300-4a3d-9d71-4892cbfe87f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:30.675299 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b18aa-8300-4a3d-9d71-4892cbfe87f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:30.676906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b18aa-8300-4a3d-9d71-4892cbfe87f7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:30.688453 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 750/1500] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:27:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:30.696515 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020ce9f-904a-4432-8016-20a9554dd6c5 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:30.705992 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020ce9f-904a-4432-8016-20a9554dd6c5 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:30.710460 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5ae66-f86b-4acf-9e4a-c31d42d6b755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:30.711137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5ae66-f86b-4acf-9e4a-c31d42d6b755 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:30.711420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5ae66-f86b-4acf-9e4a-c31d42d6b755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:30.711698 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5ae66-f86b-4acf-9e4a-c31d42d6b755 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:30.712405 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5ae66-f86b-4acf-9e4a-c31d42d6b755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:30.714303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5ae66-f86b-4acf-9e4a-c31d42d6b755 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:30.747973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 751/1501] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:27:30 2021] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:27:30.751978 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b18aa-8300-4a3d-9d71-4892cbfe87f7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:30.761581 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b18aa-8300-4a3d-9d71-4892cbfe87f7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:30.815909 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05f329-cfde-405c-98b4-ab63ed982af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:30.816597 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05f329-cfde-405c-98b4-ab63ed982af4 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:30.816882 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05f329-cfde-405c-98b4-ab63ed982af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:30.817179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05f329-cfde-405c-98b4-ab63ed982af4 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:30.817874 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05f329-cfde-405c-98b4-ab63ed982af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:30.819814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05f329-cfde-405c-98b4-ab63ed982af4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:30.839181 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 751/1502] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:27:30 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:27:30.843248 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5ae66-f86b-4acf-9e4a-c31d42d6b755 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:30.853432 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5ae66-f86b-4acf-9e4a-c31d42d6b755 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:30.857979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfb192-bdf3-4531-b4f3-3a2a259e67ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:30.858631 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfb192-bdf3-4531-b4f3-3a2a259e67ce admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:30.858952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfb192-bdf3-4531-b4f3-3a2a259e67ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:30.859237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfb192-bdf3-4531-b4f3-3a2a259e67ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:30.860013 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dfb192-bdf3-4531-b4f3-3a2a259e67ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:30.861613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dfb192-bdf3-4531-b4f3-3a2a259e67ce admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:30.874612 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 752/1503] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:27:30 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:27:30.878423 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05f329-cfde-405c-98b4-ab63ed982af4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:30.887837 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05f329-cfde-405c-98b4-ab63ed982af4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:30.892862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf7713-9794-49f7-9605-048493041b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:30.893506 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7713-9794-49f7-9605-048493041b9f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:30.893793 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7713-9794-49f7-9605-048493041b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:30.894074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7713-9794-49f7-9605-048493041b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:30.894814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf7713-9794-49f7-9605-048493041b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:30.896413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf7713-9794-49f7-9605-048493041b9f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:30.909429 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 752/1504] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:27:30 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:27:30.913226 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfb192-bdf3-4531-b4f3-3a2a259e67ce admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:30.922763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfb192-bdf3-4531-b4f3-3a2a259e67ce admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:30.927330 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ba8d1-8ea8-47ca-9562-edcdeb3770ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:30.928446 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ba8d1-8ea8-47ca-9562-edcdeb3770ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:30.928736 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ba8d1-8ea8-47ca-9562-edcdeb3770ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:30.929009 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ba8d1-8ea8-47ca-9562-edcdeb3770ea admin admin] PATH_INFO: `/v3/projects/4e2517131914436eb31d65a87d806ba5/users/946a80854cf0475aa7b1699d13f516ba/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:30.943701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ba8d1-8ea8-47ca-9562-edcdeb3770ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2517131914436eb31d65a87d806ba5, user_id=946a80854cf0475aa7b1699d13f516ba, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:30.946331 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ba8d1-8ea8-47ca-9562-edcdeb3770ea admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:30.959658 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 753/1505] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:27:30 2021] PUT /identity/v3/projects/4e2517131914436eb31d65a87d806ba5/users/946a80854cf0475aa7b1699d13f516ba/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:27:30.970588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a90eb-d23d-43ab-a60b-ebf9a3325c3d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:30.970916 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a90eb-d23d-43ab-a60b-ebf9a3325c3d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:30.971201 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a90eb-d23d-43ab-a60b-ebf9a3325c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:30.996353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-db4a90eb-d23d-43ab-a60b-ebf9a3325c3d None None] MFA Rules not processed for user `946a80854cf0475aa7b1699d13f516ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:27:30.997545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-db4a90eb-d23d-43ab-a60b-ebf9a3325c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:31.058643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 753/1506] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:27:30 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:27:31.071647 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ba8d1-8ea8-47ca-9562-edcdeb3770ea admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:31.137961 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ba8d1-8ea8-47ca-9562-edcdeb3770ea admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:31.143947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e51eb-6262-413d-aa79-db030937267a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:31.144563 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e51eb-6262-413d-aa79-db030937267a service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:31.144846 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e51eb-6262-413d-aa79-db030937267a service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:31.145123 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e51eb-6262-413d-aa79-db030937267a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:31.152606 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e51eb-6262-413d-aa79-db030937267a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:31.154255 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e51eb-6262-413d-aa79-db030937267a service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:31.162661 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 754/1507] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:27:31 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:27:31.229317 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189e2cd-e59c-4381-a4f3-0fe511555d28 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:31.229606 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189e2cd-e59c-4381-a4f3-0fe511555d28 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:31.229885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189e2cd-e59c-4381-a4f3-0fe511555d28 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:31.231621 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 754/1508] 10.222.0.60 () {52 vars in 829 bytes} [Wed Dec 15 13:27:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:27:31.235718 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e51eb-6262-413d-aa79-db030937267a service nova] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:31.295181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e51eb-6262-413d-aa79-db030937267a service nova] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:31.299643 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:31.300492 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:31.300772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:31.301049 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] PATH_INFO: `/v3/users/946a80854cf0475aa7b1699d13f516ba` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:31.302233 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=946a80854cf0475aa7b1699d13f516ba)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:31.303551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:27:31.303551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:27:31.303551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:27:31.304758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:31.368860 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '946a80854cf0475aa7b1699d13f516ba'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:27:31.390250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '946a80854cf0475aa7b1699d13f516ba'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:27:31.399036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '946a80854cf0475aa7b1699d13f516ba'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:27:31.410825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '946a80854cf0475aa7b1699d13f516ba'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:27:31.411500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '946a80854cf0475aa7b1699d13f516ba'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:27:31.417301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 755/1509] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:27:31 2021] DELETE /identity/v3/users/946a80854cf0475aa7b1699d13f516ba => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:27:31.422193 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573f238-a139-4fd0-9746-92fb84ccaeda None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:31.422497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573f238-a139-4fd0-9746-92fb84ccaeda None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:31.422758 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573f238-a139-4fd0-9746-92fb84ccaeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:31.446031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-7573f238-a139-4fd0-9746-92fb84ccaeda None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:27:31.447263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-7573f238-a139-4fd0-9746-92fb84ccaeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:31.506585 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 755/1510] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:27:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:27:31.516360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:31.517769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:31.574990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6d7b9-705d-452c-8978-9b496ffdf944 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:31.578635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98be2c-a78f-4992-9f5b-999e3f249e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:31.579318 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98be2c-a78f-4992-9f5b-999e3f249e8e service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:31.579601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98be2c-a78f-4992-9f5b-999e3f249e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:31.579887 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98be2c-a78f-4992-9f5b-999e3f249e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:31.588668 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98be2c-a78f-4992-9f5b-999e3f249e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:31.590191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98be2c-a78f-4992-9f5b-999e3f249e8e service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:31.600092 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 756/1511] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:27:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:27:31.960622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573f238-a139-4fd0-9746-92fb84ccaeda None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:31.962505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-7573f238-a139-4fd0-9746-92fb84ccaeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:31.974615 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573f238-a139-4fd0-9746-92fb84ccaeda None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:31.979368 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bd61f-df21-4342-9d44-0c694fd525fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:31.980412 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bd61f-df21-4342-9d44-0c694fd525fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:31.980691 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bd61f-df21-4342-9d44-0c694fd525fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:31.980966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bd61f-df21-4342-9d44-0c694fd525fa admin admin] PATH_INFO: `/v3/projects/4e2517131914436eb31d65a87d806ba5` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:31.982218 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bd61f-df21-4342-9d44-0c694fd525fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e2517131914436eb31d65a87d806ba5)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:31.983321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-082bd61f-df21-4342-9d44-0c694fd525fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:27:31.983321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:27:31.983321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:27:31.984385 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bd61f-df21-4342-9d44-0c694fd525fa admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:32.043152 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-082bd61f-df21-4342-9d44-0c694fd525fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e2517131914436eb31d65a87d806ba5', 'request_id': 'req-082bd61f-df21-4342-9d44-0c694fd525fa'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:27:32.052211 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-082bd61f-df21-4342-9d44-0c694fd525fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e2517131914436eb31d65a87d806ba5', 'request_id': 'req-082bd61f-df21-4342-9d44-0c694fd525fa'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:27:32.066084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-082bd61f-df21-4342-9d44-0c694fd525fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e2517131914436eb31d65a87d806ba5', 'request_id': 'req-082bd61f-df21-4342-9d44-0c694fd525fa'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:27:32.077038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-082bd61f-df21-4342-9d44-0c694fd525fa admin admin] The token cache is being invalidate because project 4e2517131914436eb31d65a87d806ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:27:32.077326 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-082bd61f-df21-4342-9d44-0c694fd525fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:27:32.077972 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-082bd61f-df21-4342-9d44-0c694fd525fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:27:32.079623 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 756/1512] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:27:31 2021] DELETE /identity/v3/projects/4e2517131914436eb31d65a87d806ba5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:29:02.990535 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c720b-006d-4757-94db-0b27a7a1a3fe None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:02.991160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c720b-006d-4757-94db-0b27a7a1a3fe None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:02.991160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c720b-006d-4757-94db-0b27a7a1a3fe None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:02.992906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 757/1513] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:29:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:02.998239 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a8222-3aeb-4496-badd-63ba4841c221 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:02.998776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a8222-3aeb-4496-badd-63ba4841c221 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:02.998901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a8222-3aeb-4496-badd-63ba4841c221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:03.018135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-e86a8222-3aeb-4496-badd-63ba4841c221 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:03.019394 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e86a8222-3aeb-4496-badd-63ba4841c221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:03.075509 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 757/1514] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:29:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:29:03.231320 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c720b-006d-4757-94db-0b27a7a1a3fe None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:03.233016 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0b1c720b-006d-4757-94db-0b27a7a1a3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:03.303845 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c720b-006d-4757-94db-0b27a7a1a3fe None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:03.309096 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd02112-a4fa-4043-80b6-fcbe0037fc3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:03.309725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd02112-a4fa-4043-80b6-fcbe0037fc3c service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:03.310008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd02112-a4fa-4043-80b6-fcbe0037fc3c service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:03.310283 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd02112-a4fa-4043-80b6-fcbe0037fc3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:03.318493 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd02112-a4fa-4043-80b6-fcbe0037fc3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:03.320140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd02112-a4fa-4043-80b6-fcbe0037fc3c service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:03.329196 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 758/1515] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:03.732978 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6b86a-d0d7-49b1-89e0-1f325339c57a None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:03.733274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6b86a-d0d7-49b1-89e0-1f325339c57a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:03.733561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6b86a-d0d7-49b1-89e0-1f325339c57a None None] PATH_INFO: `/v3` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:03.734931 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 758/1516] 10.222.0.46 () {54 vars in 925 bytes} [Wed Dec 15 13:29:03 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:29:03.741981 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237f1ca-aa42-49de-89ac-1cd4b78f6f95 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:03.742267 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237f1ca-aa42-49de-89ac-1cd4b78f6f95 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:03.742546 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237f1ca-aa42-49de-89ac-1cd4b78f6f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:03.760526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-c237f1ca-aa42-49de-89ac-1cd4b78f6f95 None None] MFA Rules not processed for user `8e05695f0d91463bae1f2a67a58cb54b`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:03.761713 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c237f1ca-aa42-49de-89ac-1cd4b78f6f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:03.822563 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 759/1517] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Dec 15 13:29:03 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:04.852661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d60af6-aad0-4dbc-8a90-0f3b82d1aec3 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:04.853228 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d60af6-aad0-4dbc-8a90-0f3b82d1aec3 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:04.853228 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d60af6-aad0-4dbc-8a90-0f3b82d1aec3 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:04.855064 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 759/1518] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:29:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:04.860285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be117-4ebc-487e-b7c7-9672a23f9500 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:04.860690 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be117-4ebc-487e-b7c7-9672a23f9500 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:04.860866 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be117-4ebc-487e-b7c7-9672a23f9500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:04.879783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-c48be117-4ebc-487e-b7c7-9672a23f9500 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:04.880956 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c48be117-4ebc-487e-b7c7-9672a23f9500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:04.888556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 760/1519] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:29:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:05.042478 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d60af6-aad0-4dbc-8a90-0f3b82d1aec3 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:05.056844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d60af6-aad0-4dbc-8a90-0f3b82d1aec3 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:05.062349 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d71c0-cae6-4462-8c44-0a324271d037 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:05.062999 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d71c0-cae6-4462-8c44-0a324271d037 service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:05.063281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d71c0-cae6-4462-8c44-0a324271d037 service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:05.063557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d71c0-cae6-4462-8c44-0a324271d037 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:05.071461 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d71c0-cae6-4462-8c44-0a324271d037 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:05.073029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d71c0-cae6-4462-8c44-0a324271d037 service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:05.081975 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 760/1520] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:07.546399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5421b-e1a2-4178-99f7-84fcfa062147 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:07.546911 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5421b-e1a2-4178-99f7-84fcfa062147 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:07.547053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5421b-e1a2-4178-99f7-84fcfa062147 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:07.548764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 761/1521] 10.222.0.60 () {54 vars in 960 bytes} [Wed Dec 15 13:29:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:07.554692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a5956-7854-4d5d-b211-c0d5c54fb339 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:07.555145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a5956-7854-4d5d-b211-c0d5c54fb339 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:07.555285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a5956-7854-4d5d-b211-c0d5c54fb339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:07.574245 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-bf2a5956-7854-4d5d-b211-c0d5c54fb339 None None] MFA Rules not processed for user `8e05695f0d91463bae1f2a67a58cb54b`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:07.575453 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-bf2a5956-7854-4d5d-b211-c0d5c54fb339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:07.583744 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 761/1522] 10.222.0.60 () {58 vars in 1057 bytes} [Wed Dec 15 13:29:07 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:29:07.591519 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5421b-e1a2-4178-99f7-84fcfa062147 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:07.604663 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5421b-e1a2-4178-99f7-84fcfa062147 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:07.609490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f009314-e25a-4471-9446-1d8f884d4f18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e05695f0d91463bae1f2a67a58cb54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:07.610109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009314-e25a-4471-9446-1d8f884d4f18 service placement] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:07.610386 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009314-e25a-4471-9446-1d8f884d4f18 service placement] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:07.610661 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009314-e25a-4471-9446-1d8f884d4f18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:07.619153 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f009314-e25a-4471-9446-1d8f884d4f18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:07.620738 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f009314-e25a-4471-9446-1d8f884d4f18 service placement] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:07.630610 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 762/1523] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:07 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:16.996945 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7d73a-96d6-4e87-9489-6f30e07f1b36 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:16.997467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7d73a-96d6-4e87-9489-6f30e07f1b36 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:16.997602 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7d73a-96d6-4e87-9489-6f30e07f1b36 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:16.999295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 762/1524] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:29:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:17.004432 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d570fd-d364-4431-8c0e-8c96e485d3d4 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:17.004834 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d570fd-d364-4431-8c0e-8c96e485d3d4 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:17.004998 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d570fd-d364-4431-8c0e-8c96e485d3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:17.022583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-46d570fd-d364-4431-8c0e-8c96e485d3d4 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:17.023809 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-46d570fd-d364-4431-8c0e-8c96e485d3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:17.031462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 763/1525] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:29:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:17.189386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7d73a-96d6-4e87-9489-6f30e07f1b36 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:17.203340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7d73a-96d6-4e87-9489-6f30e07f1b36 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:17.208614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31737f69-10f2-4997-ace7-73a3685aa46a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:17.209240 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31737f69-10f2-4997-ace7-73a3685aa46a service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:17.209518 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31737f69-10f2-4997-ace7-73a3685aa46a service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:17.209796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31737f69-10f2-4997-ace7-73a3685aa46a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:17.217607 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31737f69-10f2-4997-ace7-73a3685aa46a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:17.219212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31737f69-10f2-4997-ace7-73a3685aa46a service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:17.228666 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 763/1526] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:18.742287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3297b4-fd3d-4b4d-86d3-5ec8b14519a0 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:18.742744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3297b4-fd3d-4b4d-86d3-5ec8b14519a0 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:18.742840 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3297b4-fd3d-4b4d-86d3-5ec8b14519a0 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:18.744695 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 764/1527] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:29:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:18.749967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a07cf8-bd51-4e86-a604-1ed64bc17791 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:18.750399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a07cf8-bd51-4e86-a604-1ed64bc17791 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:18.750519 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a07cf8-bd51-4e86-a604-1ed64bc17791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:18.769310 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-f5a07cf8-bd51-4e86-a604-1ed64bc17791 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:18.770521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-f5a07cf8-bd51-4e86-a604-1ed64bc17791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:18.778171 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 764/1528] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:29:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:29:18.933279 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3297b4-fd3d-4b4d-86d3-5ec8b14519a0 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:18.947484 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3297b4-fd3d-4b4d-86d3-5ec8b14519a0 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:18.952894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db640e-6d45-41c0-8e74-f9ffef7c571c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:18.953520 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db640e-6d45-41c0-8e74-f9ffef7c571c service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:18.953826 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db640e-6d45-41c0-8e74-f9ffef7c571c service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:18.954100 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db640e-6d45-41c0-8e74-f9ffef7c571c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:18.962744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db640e-6d45-41c0-8e74-f9ffef7c571c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:18.964420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db640e-6d45-41c0-8e74-f9ffef7c571c service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:18.974555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 765/1529] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:23.311723 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe5889-fe65-404b-a994-93a10ff6b397 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:23.312582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe5889-fe65-404b-a994-93a10ff6b397 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:23.312582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe5889-fe65-404b-a994-93a10ff6b397 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:23.314345 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 765/1530] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:29:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:23.320011 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4000a0-3e49-4b38-b8c7-f01c7cb79804 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:23.320414 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4000a0-3e49-4b38-b8c7-f01c7cb79804 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:23.320569 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4000a0-3e49-4b38-b8c7-f01c7cb79804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:23.338643 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-af4000a0-3e49-4b38-b8c7-f01c7cb79804 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:23.339866 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-af4000a0-3e49-4b38-b8c7-f01c7cb79804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:23.347655 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 766/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:29:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:23.386257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe5889-fe65-404b-a994-93a10ff6b397 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:23.387967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b0fe5889-fe65-404b-a994-93a10ff6b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:23.443323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe5889-fe65-404b-a994-93a10ff6b397 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:23.446990 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d7ab8-5a94-40d4-a01e-202474c826ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:23.447638 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d7ab8-5a94-40d4-a01e-202474c826ac service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:23.447923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d7ab8-5a94-40d4-a01e-202474c826ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:23.448203 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d7ab8-5a94-40d4-a01e-202474c826ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:23.457022 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d7ab8-5a94-40d4-a01e-202474c826ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:23.458973 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d7ab8-5a94-40d4-a01e-202474c826ac service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:23.468042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 766/1532] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:25.812958 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eafeb-e89a-44c3-b92d-d1537175980b None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:25.813540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eafeb-e89a-44c3-b92d-d1537175980b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:25.813540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eafeb-e89a-44c3-b92d-d1537175980b None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:25.815383 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 767/1533] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:29:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:25.821603 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889578ba-ec93-4d72-9e59-4274807fb791 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:25.822035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889578ba-ec93-4d72-9e59-4274807fb791 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:25.822176 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889578ba-ec93-4d72-9e59-4274807fb791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:25.840325 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-889578ba-ec93-4d72-9e59-4274807fb791 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:25.841522 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-889578ba-ec93-4d72-9e59-4274807fb791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:25.849719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 767/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:29:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:25.886894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eafeb-e89a-44c3-b92d-d1537175980b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:25.897458 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eafeb-e89a-44c3-b92d-d1537175980b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:25.900972 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fb85f-10b9-42c1-a110-ca215ff20766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:25.901598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fb85f-10b9-42c1-a110-ca215ff20766 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:25.901882 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fb85f-10b9-42c1-a110-ca215ff20766 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:25.902160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fb85f-10b9-42c1-a110-ca215ff20766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:25.910890 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fb85f-10b9-42c1-a110-ca215ff20766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:25.913182 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fb85f-10b9-42c1-a110-ca215ff20766 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:25.922680 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 768/1535] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:29.855578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e4191-f602-4877-93a2-0d5a49268263 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:29.856140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e4191-f602-4877-93a2-0d5a49268263 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:29.856140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e4191-f602-4877-93a2-0d5a49268263 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:29.857923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 768/1536] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:29:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:29.863644 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3303f-90e8-457e-8524-781a0943a4d7 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:29.864083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3303f-90e8-457e-8524-781a0943a4d7 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:29.864190 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3303f-90e8-457e-8524-781a0943a4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:29.882733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-0ce3303f-90e8-457e-8524-781a0943a4d7 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:29.883955 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0ce3303f-90e8-457e-8524-781a0943a4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:29.891659 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 769/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:29:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:29.941783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e4191-f602-4877-93a2-0d5a49268263 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:29.943873 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-cc1e4191-f602-4877-93a2-0d5a49268263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:29.998806 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e4191-f602-4877-93a2-0d5a49268263 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:30.002390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c1648-a560-4d49-a867-c8438fc9e4fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:30.003059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c1648-a560-4d49-a867-c8438fc9e4fe service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:30.003347 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c1648-a560-4d49-a867-c8438fc9e4fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:30.003628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c1648-a560-4d49-a867-c8438fc9e4fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:30.013123 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c1648-a560-4d49-a867-c8438fc9e4fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:30.014543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c1648-a560-4d49-a867-c8438fc9e4fe service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:30.024165 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 769/1538] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:32.396854 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f248b39-dcd1-442e-b8fb-b1e58649ca79 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:32.397905 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f248b39-dcd1-442e-b8fb-b1e58649ca79 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:32.398210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f248b39-dcd1-442e-b8fb-b1e58649ca79 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:32.400706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 770/1539] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:29:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:32.406986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7ff42-23c4-40ae-82a6-db3c9b1330c0 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:32.407467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7ff42-23c4-40ae-82a6-db3c9b1330c0 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:32.407576 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7ff42-23c4-40ae-82a6-db3c9b1330c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:32.425166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-d9c7ff42-23c4-40ae-82a6-db3c9b1330c0 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:32.426488 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d9c7ff42-23c4-40ae-82a6-db3c9b1330c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:32.434962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 770/1540] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:29:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:32.484004 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ac9c2-9649-456e-ba81-ec309a80fa8b None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:32.484294 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ac9c2-9649-456e-ba81-ec309a80fa8b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:32.484575 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ac9c2-9649-456e-ba81-ec309a80fa8b None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:32.486382 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 771/1541] 10.222.0.60 () {54 vars in 963 bytes} [Wed Dec 15 13:29:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:32.492227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff1da8-6bd4-408e-9b2f-e5ad430ce727 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:32.492521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff1da8-6bd4-408e-9b2f-e5ad430ce727 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:32.492802 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff1da8-6bd4-408e-9b2f-e5ad430ce727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:32.511268 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-edff1da8-6bd4-408e-9b2f-e5ad430ce727 None None] MFA Rules not processed for user `69bf09fafcb24a13a1ef14cba8da380a`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:32.512448 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-edff1da8-6bd4-408e-9b2f-e5ad430ce727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:32.518752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 771/1542] 10.222.0.60 () {58 vars in 1060 bytes} [Wed Dec 15 13:29:32 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:32.530726 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ac9c2-9649-456e-ba81-ec309a80fa8b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:32.542126 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ac9c2-9649-456e-ba81-ec309a80fa8b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:32.545612 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0bd52-0b8f-4c30-a934-efceeca5c1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:32.546240 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0bd52-0b8f-4c30-a934-efceeca5c1ee service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:32.546522 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0bd52-0b8f-4c30-a934-efceeca5c1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:32.546806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0bd52-0b8f-4c30-a934-efceeca5c1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:32.556221 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0bd52-0b8f-4c30-a934-efceeca5c1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:32.557659 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0bd52-0b8f-4c30-a934-efceeca5c1ee service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:32.567684 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 772/1543] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:55.151852 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a509017-55ce-4485-aeaa-2f130ef2ecbf None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.155722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a509017-55ce-4485-aeaa-2f130ef2ecbf None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.155722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a509017-55ce-4485-aeaa-2f130ef2ecbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.167872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee95dc-e574-4a20-aa45-5fef14afb672 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.169389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee95dc-e574-4a20-aa45-5fef14afb672 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.169823 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee95dc-e574-4a20-aa45-5fef14afb672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.181331 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-1a509017-55ce-4485-aeaa-2f130ef2ecbf None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.181331 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-1a509017-55ce-4485-aeaa-2f130ef2ecbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.190064 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 772/1544] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:55.198573 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b63ac-d9c2-41de-814b-52369fb8918d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.199120 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-58ee95dc-e574-4a20-aa45-5fef14afb672 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.199301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b63ac-d9c2-41de-814b-52369fb8918d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.199740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b63ac-d9c2-41de-814b-52369fb8918d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.200945 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-58ee95dc-e574-4a20-aa45-5fef14afb672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.214766 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 773/1545] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:30:55.222583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2176d-67ce-40c7-a5fc-813d48c344e0 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.222959 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2176d-67ce-40c7-a5fc-813d48c344e0 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.223338 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2176d-67ce-40c7-a5fc-813d48c344e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.236413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-966b63ac-d9c2-41de-814b-52369fb8918d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.239500 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-966b63ac-d9c2-41de-814b-52369fb8918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.259764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ecf2176d-67ce-40c7-a5fc-813d48c344e0 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.261364 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ecf2176d-67ce-40c7-a5fc-813d48c344e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.261851 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 773/1546] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:30:55.267789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b63ac-d9c2-41de-814b-52369fb8918d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.279964 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 774/1547] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:30:55.281562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8ae8f-e297-45bd-bcab-d6f6dbfa0060 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.282393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8ae8f-e297-45bd-bcab-d6f6dbfa0060 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.282681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8ae8f-e297-45bd-bcab-d6f6dbfa0060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.286797 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b63ac-d9c2-41de-814b-52369fb8918d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.312293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-11f8ae8f-e297-45bd-bcab-d6f6dbfa0060 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.314066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-11f8ae8f-e297-45bd-bcab-d6f6dbfa0060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.315806 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d088020-692e-49b1-ba7b-0da290ca4983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.316506 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d088020-692e-49b1-ba7b-0da290ca4983 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.316891 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d088020-692e-49b1-ba7b-0da290ca4983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.317143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d088020-692e-49b1-ba7b-0da290ca4983 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.318072 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d088020-692e-49b1-ba7b-0da290ca4983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:30:55.318543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d088020-692e-49b1-ba7b-0da290ca4983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.320338 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d088020-692e-49b1-ba7b-0da290ca4983 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.329002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 775/1548] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:55.330185 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8ae8f-e297-45bd-bcab-d6f6dbfa0060 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.343848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8ae8f-e297-45bd-bcab-d6f6dbfa0060 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.345530 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 774/1549] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:30:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:30:55.347213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c0621-f5fb-4a33-8ad0-73b59553b47c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.347735 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c0621-f5fb-4a33-8ad0-73b59553b47c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.348288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c0621-f5fb-4a33-8ad0-73b59553b47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.354283 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0686b6-f4d3-4195-8315-4b1f986892eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.354987 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0686b6-f4d3-4195-8315-4b1f986892eb admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.355455 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0686b6-f4d3-4195-8315-4b1f986892eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.355909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0686b6-f4d3-4195-8315-4b1f986892eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.356861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0686b6-f4d3-4195-8315-4b1f986892eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:30:55.357342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0686b6-f4d3-4195-8315-4b1f986892eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.359158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0686b6-f4d3-4195-8315-4b1f986892eb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.373711 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 776/1550] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:30:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:30:55.375033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0686b6-f4d3-4195-8315-4b1f986892eb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.386563 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-c33c0621-f5fb-4a33-8ad0-73b59553b47c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.389094 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c33c0621-f5fb-4a33-8ad0-73b59553b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.397377 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0686b6-f4d3-4195-8315-4b1f986892eb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.402278 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a585bf6-8fda-44d7-8e40-5c318f191828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.406868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a585bf6-8fda-44d7-8e40-5c318f191828 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.406868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a585bf6-8fda-44d7-8e40-5c318f191828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.406868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a585bf6-8fda-44d7-8e40-5c318f191828 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.406868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a585bf6-8fda-44d7-8e40-5c318f191828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.408154 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a585bf6-8fda-44d7-8e40-5c318f191828 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.419135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 775/1551] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:55.420861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b4193-1ba6-4a3c-ae48-ad85e729197f None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.421364 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b4193-1ba6-4a3c-ae48-ad85e729197f None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.421861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b4193-1ba6-4a3c-ae48-ad85e729197f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.442885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 777/1552] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:55.442885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a585bf6-8fda-44d7-8e40-5c318f191828 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.455835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-f25b4193-1ba6-4a3c-ae48-ad85e729197f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.457388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-f25b4193-1ba6-4a3c-ae48-ad85e729197f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.508108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a585bf6-8fda-44d7-8e40-5c318f191828 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.513657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d2276-8c02-4f18-bc1b-a0261099ad42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.514319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d2276-8c02-4f18-bc1b-a0261099ad42 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.514601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d2276-8c02-4f18-bc1b-a0261099ad42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.514889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d2276-8c02-4f18-bc1b-a0261099ad42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.515609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d2276-8c02-4f18-bc1b-a0261099ad42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.517674 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d2276-8c02-4f18-bc1b-a0261099ad42 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.525408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 776/1553] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:55.527105 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42656908-8ea0-4319-ae6c-d65b62381b06 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.527623 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42656908-8ea0-4319-ae6c-d65b62381b06 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.528114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42656908-8ea0-4319-ae6c-d65b62381b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.551992 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 778/1554] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:55.553043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d2276-8c02-4f18-bc1b-a0261099ad42 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.561005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-42656908-8ea0-4319-ae6c-d65b62381b06 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.561005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-42656908-8ea0-4319-ae6c-d65b62381b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.623874 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 777/1555] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:55.624703 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42656908-8ea0-4319-ae6c-d65b62381b06 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.627996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d2276-8c02-4f18-bc1b-a0261099ad42 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.633841 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485309e-73f3-4ae6-a3b1-c54be6505472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.634337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42656908-8ea0-4319-ae6c-d65b62381b06 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.634500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485309e-73f3-4ae6-a3b1-c54be6505472 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.634782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485309e-73f3-4ae6-a3b1-c54be6505472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.635086 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485309e-73f3-4ae6-a3b1-c54be6505472 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.635831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485309e-73f3-4ae6-a3b1-c54be6505472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:30:55.636143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485309e-73f3-4ae6-a3b1-c54be6505472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.637817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485309e-73f3-4ae6-a3b1-c54be6505472 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.640066 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a904c-2813-4b6c-a394-ab17b0a47111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.640871 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a904c-2813-4b6c-a394-ab17b0a47111 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.641174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a904c-2813-4b6c-a394-ab17b0a47111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.641450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a904c-2813-4b6c-a394-ab17b0a47111 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.642154 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a904c-2813-4b6c-a394-ab17b0a47111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.644091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a904c-2813-4b6c-a394-ab17b0a47111 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.650060 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 779/1556] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:30:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:30:55.651406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5d087-1a25-4149-9426-940bf1541267 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.651698 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5d087-1a25-4149-9426-940bf1541267 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.651978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5d087-1a25-4149-9426-940bf1541267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.667705 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 778/1557] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:55.669062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb63359-c56d-403c-9dcb-4ab6804061c3 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.669915 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb63359-c56d-403c-9dcb-4ab6804061c3 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.670191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb63359-c56d-403c-9dcb-4ab6804061c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.678410 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a2a5d087-1a25-4149-9426-940bf1541267 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.679644 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a2a5d087-1a25-4149-9426-940bf1541267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.690989 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 780/1558] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:55.691189 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-feb63359-c56d-403c-9dcb-4ab6804061c3 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.691308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83392e-c129-41b7-b95d-95971cc92938 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.691308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83392e-c129-41b7-b95d-95971cc92938 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.691308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83392e-c129-41b7-b95d-95971cc92938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.691574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-feb63359-c56d-403c-9dcb-4ab6804061c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.701081 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 779/1559] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:55.701867 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb63359-c56d-403c-9dcb-4ab6804061c3 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.710700 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-5c83392e-c129-41b7-b95d-95971cc92938 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.711084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb63359-c56d-403c-9dcb-4ab6804061c3 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.711904 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5c83392e-c129-41b7-b95d-95971cc92938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.715709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754db9c-840f-4563-bddb-170a5c766765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.716865 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754db9c-840f-4563-bddb-170a5c766765 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.717147 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754db9c-840f-4563-bddb-170a5c766765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.717584 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754db9c-840f-4563-bddb-170a5c766765 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.718114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754db9c-840f-4563-bddb-170a5c766765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.720048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754db9c-840f-4563-bddb-170a5c766765 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.720568 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 781/1560] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:55.721852 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2f59d-d43d-4dcc-b0d8-e3427ae1b224 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.722145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2f59d-d43d-4dcc-b0d8-e3427ae1b224 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.722425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2f59d-d43d-4dcc-b0d8-e3427ae1b224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.740584 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-58e2f59d-d43d-4dcc-b0d8-e3427ae1b224 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.744144 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 780/1561] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/users => generated 284 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:55.744282 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-58e2f59d-d43d-4dcc-b0d8-e3427ae1b224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.744388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f3299-49dd-4c48-bf84-fa5262411dbf None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.744388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f3299-49dd-4c48-bf84-fa5262411dbf None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.744388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f3299-49dd-4c48-bf84-fa5262411dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.751688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 782/1562] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:55.752434 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2f59d-d43d-4dcc-b0d8-e3427ae1b224 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.761133 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-3b8f3299-49dd-4c48-bf84-fa5262411dbf None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.761957 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2f59d-d43d-4dcc-b0d8-e3427ae1b224 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.762327 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3b8f3299-49dd-4c48-bf84-fa5262411dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.767063 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f907c-090f-4766-9175-d5a08b5e86d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.767700 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f907c-090f-4766-9175-d5a08b5e86d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.767983 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f907c-090f-4766-9175-d5a08b5e86d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.768261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f907c-090f-4766-9175-d5a08b5e86d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.768963 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f907c-090f-4766-9175-d5a08b5e86d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.770877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f907c-090f-4766-9175-d5a08b5e86d8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.771373 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 781/1563] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:55.775535 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f3299-49dd-4c48-bf84-fa5262411dbf None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.784759 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f3299-49dd-4c48-bf84-fa5262411dbf None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.789911 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cc745-a48f-4937-b9d5-33258cf270b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.790681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cc745-a48f-4937-b9d5-33258cf270b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.791020 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cc745-a48f-4937-b9d5-33258cf270b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.791284 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cc745-a48f-4937-b9d5-33258cf270b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.792020 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cc745-a48f-4937-b9d5-33258cf270b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.793606 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cc745-a48f-4937-b9d5-33258cf270b6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.796609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 783/1564] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:55.797755 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b1d12-674f-4f84-b9ce-f7e22e225ef3 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.798042 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b1d12-674f-4f84-b9ce-f7e22e225ef3 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.798317 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b1d12-674f-4f84-b9ce-f7e22e225ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.806680 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 782/1565] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:55 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:55.806680 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cc745-a48f-4937-b9d5-33258cf270b6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.814418 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cc745-a48f-4937-b9d5-33258cf270b6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.816778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-0a3b1d12-674f-4f84-b9ce-f7e22e225ef3 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.817961 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0a3b1d12-674f-4f84-b9ce-f7e22e225ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.873182 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacb30f-9506-4917-a869-01f975716405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.873841 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacb30f-9506-4917-a869-01f975716405 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.874120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacb30f-9506-4917-a869-01f975716405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.874390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacb30f-9506-4917-a869-01f975716405 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.875145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacb30f-9506-4917-a869-01f975716405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:30:55.875450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacb30f-9506-4917-a869-01f975716405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.877174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 784/1566] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:55.877295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacb30f-9506-4917-a869-01f975716405 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.878387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b14816-1830-4378-a6a5-996092d77c27 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.878676 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b14816-1830-4378-a6a5-996092d77c27 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.878991 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b14816-1830-4378-a6a5-996092d77c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.895866 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 783/1567] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:30:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:30:55.895866 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacb30f-9506-4917-a869-01f975716405 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.896883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-17b14816-1830-4378-a6a5-996092d77c27 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.898078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-17b14816-1830-4378-a6a5-996092d77c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.898640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacb30f-9506-4917-a869-01f975716405 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.903064 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3838dd-2a49-4053-9b32-6d960c898c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.903723 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3838dd-2a49-4053-9b32-6d960c898c5e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.904002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3838dd-2a49-4053-9b32-6d960c898c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.904279 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3838dd-2a49-4053-9b32-6d960c898c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.905011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3838dd-2a49-4053-9b32-6d960c898c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.906034 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 785/1568] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:55.906569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3838dd-2a49-4053-9b32-6d960c898c5e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.907397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2166c8-ce4e-449f-ab42-55ee49f49fde None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.907718 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2166c8-ce4e-449f-ab42-55ee49f49fde None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.907970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2166c8-ce4e-449f-ab42-55ee49f49fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.924300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 784/1569] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:55 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:55.924300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3838dd-2a49-4053-9b32-6d960c898c5e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.926776 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-6b2166c8-ce4e-449f-ab42-55ee49f49fde None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.928028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-6b2166c8-ce4e-449f-ab42-55ee49f49fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.937051 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 786/1570] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:55.937717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3838dd-2a49-4053-9b32-6d960c898c5e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.937832 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2166c8-ce4e-449f-ab42-55ee49f49fde None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.942903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dd146-be93-43a7-941a-330ed3751e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.943567 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dd146-be93-43a7-941a-330ed3751e1b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.943846 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dd146-be93-43a7-941a-330ed3751e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.944122 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dd146-be93-43a7-941a-330ed3751e1b admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.944858 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dd146-be93-43a7-941a-330ed3751e1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:30:55.945167 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dd146-be93-43a7-941a-330ed3751e1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.947149 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dd146-be93-43a7-941a-330ed3751e1b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.947372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2166c8-ce4e-449f-ab42-55ee49f49fde None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.952007 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d72f70-c928-46b3-97be-ea21cd938c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.952695 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d72f70-c928-46b3-97be-ea21cd938c83 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.952964 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d72f70-c928-46b3-97be-ea21cd938c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.953236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d72f70-c928-46b3-97be-ea21cd938c83 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.953931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d72f70-c928-46b3-97be-ea21cd938c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.956072 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d72f70-c928-46b3-97be-ea21cd938c83 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.966077 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 785/1571] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:30:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:30:55.966077 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dd146-be93-43a7-941a-330ed3751e1b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.975975 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 787/1572] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/users => generated 290 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:55.976559 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dd146-be93-43a7-941a-330ed3751e1b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.977286 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d72f70-c928-46b3-97be-ea21cd938c83 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.981151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff698-04aa-438e-9bd9-f93fcde85e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.982333 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff698-04aa-438e-9bd9-f93fcde85e00 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.982642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff698-04aa-438e-9bd9-f93fcde85e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.982943 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff698-04aa-438e-9bd9-f93fcde85e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.983679 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ff698-04aa-438e-9bd9-f93fcde85e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.985263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ff698-04aa-438e-9bd9-f93fcde85e00 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.987554 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d72f70-c928-46b3-97be-ea21cd938c83 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.992567 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7462b-18e7-4566-813a-4c7e4b85704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.993198 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7462b-18e7-4566-813a-4c7e4b85704a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.993477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7462b-18e7-4566-813a-4c7e4b85704a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.993750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7462b-18e7-4566-813a-4c7e4b85704a admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.994471 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7462b-18e7-4566-813a-4c7e4b85704a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:30:55.994776 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7462b-18e7-4566-813a-4c7e4b85704a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.998773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 786/1573] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:55 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:55.998773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff698-04aa-438e-9bd9-f93fcde85e00 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.999031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7462b-18e7-4566-813a-4c7e4b85704a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.005957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff698-04aa-438e-9bd9-f93fcde85e00 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.008639 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 788/1574] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:30:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:30:56.009427 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7462b-18e7-4566-813a-4c7e4b85704a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.010730 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad53461-1f52-444a-b40c-a98ea1095ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.011395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad53461-1f52-444a-b40c-a98ea1095ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.011674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad53461-1f52-444a-b40c-a98ea1095ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.011947 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad53461-1f52-444a-b40c-a98ea1095ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.012637 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad53461-1f52-444a-b40c-a98ea1095ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.014626 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad53461-1f52-444a-b40c-a98ea1095ae7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.018878 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7462b-18e7-4566-813a-4c7e4b85704a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.023364 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b06b7-746c-4ac4-9c8e-7da79b3a09ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.023987 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b06b7-746c-4ac4-9c8e-7da79b3a09ee admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.024267 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b06b7-746c-4ac4-9c8e-7da79b3a09ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.024570 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b06b7-746c-4ac4-9c8e-7da79b3a09ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.025290 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b06b7-746c-4ac4-9c8e-7da79b3a09ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:30:56.025593 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b06b7-746c-4ac4-9c8e-7da79b3a09ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.027200 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b06b7-746c-4ac4-9c8e-7da79b3a09ee admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.039988 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 789/1575] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:30:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:30:56.040596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b06b7-746c-4ac4-9c8e-7da79b3a09ee admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.041000 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 787/1576] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:56.041983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad53461-1f52-444a-b40c-a98ea1095ae7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.053645 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b06b7-746c-4ac4-9c8e-7da79b3a09ee admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.102030 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad53461-1f52-444a-b40c-a98ea1095ae7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.107246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9c1ba-cd40-494f-a207-2ebfddb31daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.107910 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9c1ba-cd40-494f-a207-2ebfddb31daf admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.108077 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b8df9-32b4-486d-9ccd-0b7854343f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.108213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9c1ba-cd40-494f-a207-2ebfddb31daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.108447 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9c1ba-cd40-494f-a207-2ebfddb31daf admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.108733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b8df9-32b4-486d-9ccd-0b7854343f8c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.109013 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b8df9-32b4-486d-9ccd-0b7854343f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.109177 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9c1ba-cd40-494f-a207-2ebfddb31daf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:30:56.109291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b8df9-32b4-486d-9ccd-0b7854343f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.109538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9c1ba-cd40-494f-a207-2ebfddb31daf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.110033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b8df9-32b4-486d-9ccd-0b7854343f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.111186 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9c1ba-cd40-494f-a207-2ebfddb31daf admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.111646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b8df9-32b4-486d-9ccd-0b7854343f8c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.121432 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 790/1577] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:56 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:56.122230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b8df9-32b4-486d-9ccd-0b7854343f8c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.123883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 788/1578] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:30:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:30:56.124675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9c1ba-cd40-494f-a207-2ebfddb31daf admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.134388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9c1ba-cd40-494f-a207-2ebfddb31daf admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.135361 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b8df9-32b4-486d-9ccd-0b7854343f8c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.139074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14946fef-2518-442d-a429-de8ea02f78b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.139727 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14946fef-2518-442d-a429-de8ea02f78b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.139856 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27c12a-a267-41a0-a309-b81fddac5144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.140013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14946fef-2518-442d-a429-de8ea02f78b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.140294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14946fef-2518-442d-a429-de8ea02f78b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.140480 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27c12a-a267-41a0-a309-b81fddac5144 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.140763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27c12a-a267-41a0-a309-b81fddac5144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.141036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27c12a-a267-41a0-a309-b81fddac5144 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.141188 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14946fef-2518-442d-a429-de8ea02f78b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.141759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27c12a-a267-41a0-a309-b81fddac5144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.142870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14946fef-2518-442d-a429-de8ea02f78b5 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.143680 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27c12a-a267-41a0-a309-b81fddac5144 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.153179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 789/1579] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:56.153947 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14946fef-2518-442d-a429-de8ea02f78b5 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.163409 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14946fef-2518-442d-a429-de8ea02f78b5 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.168286 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fb6e0-012b-400b-a517-668e11ef6e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.169665 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fb6e0-012b-400b-a517-668e11ef6e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.169945 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fb6e0-012b-400b-a517-668e11ef6e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.170222 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fb6e0-012b-400b-a517-668e11ef6e07 admin admin] PATH_INFO: `/v3/projects/18c80dfcc63a49f7b54f89f08cd8842f/users/df94523ab7c545f2a17a2cafe936d2ed/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.173451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 791/1580] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:30:56 2021] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:56.173451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27c12a-a267-41a0-a309-b81fddac5144 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.184816 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fb6e0-012b-400b-a517-668e11ef6e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c80dfcc63a49f7b54f89f08cd8842f, user_id=df94523ab7c545f2a17a2cafe936d2ed, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.187870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fb6e0-012b-400b-a517-668e11ef6e07 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.202565 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 790/1581] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:30:56 2021] PUT /identity/v3/projects/18c80dfcc63a49f7b54f89f08cd8842f/users/df94523ab7c545f2a17a2cafe936d2ed/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:30:56.203442 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fb6e0-012b-400b-a517-668e11ef6e07 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.242203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27c12a-a267-41a0-a309-b81fddac5144 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.267103 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fb6e0-012b-400b-a517-668e11ef6e07 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.271639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479dba09-a7fd-4169-8551-d3ab8e932f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.272307 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dba09-a7fd-4169-8551-d3ab8e932f98 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.272585 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dba09-a7fd-4169-8551-d3ab8e932f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.272863 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dba09-a7fd-4169-8551-d3ab8e932f98 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.273604 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479dba09-a7fd-4169-8551-d3ab8e932f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.275555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479dba09-a7fd-4169-8551-d3ab8e932f98 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.298097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 791/1582] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:30:56 2021] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:56.298909 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479dba09-a7fd-4169-8551-d3ab8e932f98 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.299454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf2dd9-08bc-45eb-afce-cc02ba9a268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.300148 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf2dd9-08bc-45eb-afce-cc02ba9a268b admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.300429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf2dd9-08bc-45eb-afce-cc02ba9a268b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.300706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf2dd9-08bc-45eb-afce-cc02ba9a268b admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.301597 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf2dd9-08bc-45eb-afce-cc02ba9a268b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.303553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf2dd9-08bc-45eb-afce-cc02ba9a268b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.310223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479dba09-a7fd-4169-8551-d3ab8e932f98 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.314790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2161a5-4118-4edd-ac73-ed7a4d3e3942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.315443 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2161a5-4118-4edd-ac73-ed7a4d3e3942 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.315724 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2161a5-4118-4edd-ac73-ed7a4d3e3942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.316021 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2161a5-4118-4edd-ac73-ed7a4d3e3942 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.316703 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2161a5-4118-4edd-ac73-ed7a4d3e3942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.318796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2161a5-4118-4edd-ac73-ed7a4d3e3942 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.330862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 792/1583] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:30:56 2021] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:56.331676 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf2dd9-08bc-45eb-afce-cc02ba9a268b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.351669 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 792/1584] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:30:56 2021] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:56.351669 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2161a5-4118-4edd-ac73-ed7a4d3e3942 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.392685 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf2dd9-08bc-45eb-afce-cc02ba9a268b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.409986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2161a5-4118-4edd-ac73-ed7a4d3e3942 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.414532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dc98d-e38a-47cf-a2f0-53e827affe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.415217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dc98d-e38a-47cf-a2f0-53e827affe43 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.415507 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dc98d-e38a-47cf-a2f0-53e827affe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.415780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dc98d-e38a-47cf-a2f0-53e827affe43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.416474 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04dc98d-e38a-47cf-a2f0-53e827affe43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.418355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04dc98d-e38a-47cf-a2f0-53e827affe43 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.444524 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 793/1585] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:30:56 2021] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:56.445272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dc98d-e38a-47cf-a2f0-53e827affe43 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.450735 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9897f-4f3f-4700-9be1-11b086120fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.451662 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9897f-4f3f-4700-9be1-11b086120fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.451946 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9897f-4f3f-4700-9be1-11b086120fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.452255 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9897f-4f3f-4700-9be1-11b086120fcb admin admin] PATH_INFO: `/v3/projects/4e7a9d4667274ac18c39ea5371d04ae2/users/35c998cec2744ee1aa309dd31c6b8b57/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.466997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9897f-4f3f-4700-9be1-11b086120fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7a9d4667274ac18c39ea5371d04ae2, user_id=35c998cec2744ee1aa309dd31c6b8b57, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.469646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9897f-4f3f-4700-9be1-11b086120fcb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.483863 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 793/1586] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:30:56 2021] PUT /identity/v3/projects/4e7a9d4667274ac18c39ea5371d04ae2/users/35c998cec2744ee1aa309dd31c6b8b57/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:30:56.484648 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9897f-4f3f-4700-9be1-11b086120fcb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.508086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dc98d-e38a-47cf-a2f0-53e827affe43 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.550145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9897f-4f3f-4700-9be1-11b086120fcb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.554831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44698a3-9062-484e-9708-250758ad0169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.555521 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44698a3-9062-484e-9708-250758ad0169 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.555830 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44698a3-9062-484e-9708-250758ad0169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.556109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44698a3-9062-484e-9708-250758ad0169 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.556816 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44698a3-9062-484e-9708-250758ad0169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.558769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44698a3-9062-484e-9708-250758ad0169 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.562699 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f8b59-9c77-490d-8d45-2e32db8d3ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.563395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f8b59-9c77-490d-8d45-2e32db8d3ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.563675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f8b59-9c77-490d-8d45-2e32db8d3ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.563950 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f8b59-9c77-490d-8d45-2e32db8d3ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.564684 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f8b59-9c77-490d-8d45-2e32db8d3ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.566425 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f8b59-9c77-490d-8d45-2e32db8d3ef0 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.577610 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 794/1587] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:56 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:56.578859 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54991798-ddd7-4996-bff4-591f3da61ac4 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.579151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54991798-ddd7-4996-bff4-591f3da61ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.579423 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54991798-ddd7-4996-bff4-591f3da61ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.581514 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 794/1588] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:30:56 2021] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:56.582372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44698a3-9062-484e-9708-250758ad0169 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.592716 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44698a3-9062-484e-9708-250758ad0169 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.597935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be291722-8034-4a89-996d-0ee8317cb45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.598626 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be291722-8034-4a89-996d-0ee8317cb45d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.598896 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be291722-8034-4a89-996d-0ee8317cb45d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.599183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be291722-8034-4a89-996d-0ee8317cb45d admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.599935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be291722-8034-4a89-996d-0ee8317cb45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.601869 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-54991798-ddd7-4996-bff4-591f3da61ac4 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:56.602724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be291722-8034-4a89-996d-0ee8317cb45d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.603089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-54991798-ddd7-4996-bff4-591f3da61ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:56.611405 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 795/1589] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:56.612258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54991798-ddd7-4996-bff4-591f3da61ac4 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.616444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 795/1590] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:56 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:56.616444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be291722-8034-4a89-996d-0ee8317cb45d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.622114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54991798-ddd7-4996-bff4-591f3da61ac4 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.625305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be291722-8034-4a89-996d-0ee8317cb45d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.626706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cfbba-faa5-4b0b-b34b-35f53b09b1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.627443 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cfbba-faa5-4b0b-b34b-35f53b09b1cb admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.627725 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cfbba-faa5-4b0b-b34b-35f53b09b1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.628000 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cfbba-faa5-4b0b-b34b-35f53b09b1cb admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.628711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cfbba-faa5-4b0b-b34b-35f53b09b1cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.630208 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faf0b1-51db-4294-a7be-53c6da70dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.630606 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cfbba-faa5-4b0b-b34b-35f53b09b1cb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.630879 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faf0b1-51db-4294-a7be-53c6da70dddc admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.631179 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faf0b1-51db-4294-a7be-53c6da70dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.631458 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faf0b1-51db-4294-a7be-53c6da70dddc admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.632162 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faf0b1-51db-4294-a7be-53c6da70dddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.634075 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faf0b1-51db-4294-a7be-53c6da70dddc admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.651035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 796/1591] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:30:56 2021] POST /identity/v3/users => generated 289 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:56.651814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cfbba-faa5-4b0b-b34b-35f53b09b1cb admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.656398 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 796/1592] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:30:56 2021] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:56.658255 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c311df-72cf-4ba1-bc17-002b605f490c None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.658555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c311df-72cf-4ba1-bc17-002b605f490c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.658883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c311df-72cf-4ba1-bc17-002b605f490c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.665406 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cfbba-faa5-4b0b-b34b-35f53b09b1cb admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.669928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6a7fb-f4b4-4e18-8e79-d337d32a93d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.670580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6a7fb-f4b4-4e18-8e79-d337d32a93d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.670903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6a7fb-f4b4-4e18-8e79-d337d32a93d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.671160 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6a7fb-f4b4-4e18-8e79-d337d32a93d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.671852 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6a7fb-f4b4-4e18-8e79-d337d32a93d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.673755 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6a7fb-f4b4-4e18-8e79-d337d32a93d6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.684325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-49c311df-72cf-4ba1-bc17-002b605f490c None None] MFA Rules not processed for user `35c998cec2744ee1aa309dd31c6b8b57`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:56.685930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-49c311df-72cf-4ba1-bc17-002b605f490c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:56.693979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 797/1593] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:30:56 2021] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:30:56.694839 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6a7fb-f4b4-4e18-8e79-d337d32a93d6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.705332 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6a7fb-f4b4-4e18-8e79-d337d32a93d6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.709917 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f294a4d-928d-48c0-afc4-ea34e5e17db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.710926 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f294a4d-928d-48c0-afc4-ea34e5e17db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.711211 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f294a4d-928d-48c0-afc4-ea34e5e17db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.711488 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f294a4d-928d-48c0-afc4-ea34e5e17db4 admin admin] PATH_INFO: `/v3/projects/c6099655f06b473db6eb84adfee54156/users/07defc49f2774d9e9c7001504aa647ef/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.726052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f294a4d-928d-48c0-afc4-ea34e5e17db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6099655f06b473db6eb84adfee54156, user_id=07defc49f2774d9e9c7001504aa647ef, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.728731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f294a4d-928d-48c0-afc4-ea34e5e17db4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.742928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 798/1594] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:30:56 2021] PUT /identity/v3/projects/c6099655f06b473db6eb84adfee54156/users/07defc49f2774d9e9c7001504aa647ef/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:30:56.743937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f294a4d-928d-48c0-afc4-ea34e5e17db4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.756424 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 797/1595] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:56 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:56.757281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c311df-72cf-4ba1-bc17-002b605f490c None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.768301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c311df-72cf-4ba1-bc17-002b605f490c None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.804849 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f294a4d-928d-48c0-afc4-ea34e5e17db4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.809588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e77e5-3db9-432a-9741-f16c6c69c45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.810277 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e77e5-3db9-432a-9741-f16c6c69c45d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.810555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e77e5-3db9-432a-9741-f16c6c69c45d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.810826 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e77e5-3db9-432a-9741-f16c6c69c45d admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.811707 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e77e5-3db9-432a-9741-f16c6c69c45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.813324 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e77e5-3db9-432a-9741-f16c6c69c45d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.821152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb28867-6133-4170-9e2b-b0df8b404d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.822080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb28867-6133-4170-9e2b-b0df8b404d19 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.822362 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb28867-6133-4170-9e2b-b0df8b404d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.822637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb28867-6133-4170-9e2b-b0df8b404d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.823202 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 799/1596] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:56 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:56.823979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e77e5-3db9-432a-9741-f16c6c69c45d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.827066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb28867-6133-4170-9e2b-b0df8b404d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.828704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb28867-6133-4170-9e2b-b0df8b404d19 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.838477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 798/1597] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:56 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:56.842940 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb28867-6133-4170-9e2b-b0df8b404d19 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.852097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb28867-6133-4170-9e2b-b0df8b404d19 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.856707 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5f8b1-7a97-44a5-b6c8-aa6fec3bdc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.857331 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5f8b1-7a97-44a5-b6c8-aa6fec3bdc6a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.857619 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5f8b1-7a97-44a5-b6c8-aa6fec3bdc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.857900 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5f8b1-7a97-44a5-b6c8-aa6fec3bdc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.858637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5f8b1-7a97-44a5-b6c8-aa6fec3bdc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.860307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5f8b1-7a97-44a5-b6c8-aa6fec3bdc6a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.869838 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 799/1598] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:56 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:56.870557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5f8b1-7a97-44a5-b6c8-aa6fec3bdc6a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.878607 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e77e5-3db9-432a-9741-f16c6c69c45d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.879669 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5f8b1-7a97-44a5-b6c8-aa6fec3bdc6a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.882162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac2c42-4158-4a97-8a6a-7c8a55065085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.882866 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac2c42-4158-4a97-8a6a-7c8a55065085 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.883163 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac2c42-4158-4a97-8a6a-7c8a55065085 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.883435 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac2c42-4158-4a97-8a6a-7c8a55065085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.884291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2ff0b-d4d3-440f-adf0-4223c81b3b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.884906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ff0b-d4d3-440f-adf0-4223c81b3b4c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.885192 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ff0b-d4d3-440f-adf0-4223c81b3b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.885474 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ff0b-d4d3-440f-adf0-4223c81b3b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.886196 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2ff0b-d4d3-440f-adf0-4223c81b3b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.887795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2ff0b-d4d3-440f-adf0-4223c81b3b4c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.892592 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac2c42-4158-4a97-8a6a-7c8a55065085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.893996 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac2c42-4158-4a97-8a6a-7c8a55065085 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.898171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 800/1599] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:56 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:56.898986 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2ff0b-d4d3-440f-adf0-4223c81b3b4c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.905955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 800/1600] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:56.907279 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d811d-20e4-4aef-9451-3054d5f822e1 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.907629 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d811d-20e4-4aef-9451-3054d5f822e1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.907975 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d811d-20e4-4aef-9451-3054d5f822e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.908590 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2ff0b-d4d3-440f-adf0-4223c81b3b4c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.913472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be24101-4aca-42d9-93fd-4d1fc1d39708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.914166 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be24101-4aca-42d9-93fd-4d1fc1d39708 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.915158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be24101-4aca-42d9-93fd-4d1fc1d39708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.915158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be24101-4aca-42d9-93fd-4d1fc1d39708 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.915418 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be24101-4aca-42d9-93fd-4d1fc1d39708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.917008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be24101-4aca-42d9-93fd-4d1fc1d39708 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.925551 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-674d811d-20e4-4aef-9451-3054d5f822e1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:56.926750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-674d811d-20e4-4aef-9451-3054d5f822e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:56.927986 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 801/1601] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:56.928697 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be24101-4aca-42d9-93fd-4d1fc1d39708 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.940805 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 801/1602] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:56.940805 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d811d-20e4-4aef-9451-3054d5f822e1 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.958956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d811d-20e4-4aef-9451-3054d5f822e1 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.963679 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b2109-d655-4815-aa40-6d02ef86b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.964350 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b2109-d655-4815-aa40-6d02ef86b514 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.964632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b2109-d655-4815-aa40-6d02ef86b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.964910 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b2109-d655-4815-aa40-6d02ef86b514 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:56.965651 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b2109-d655-4815-aa40-6d02ef86b514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:56.967873 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b2109-d655-4815-aa40-6d02ef86b514 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:56.981054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 802/1603] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:56 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:56.981054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b2109-d655-4815-aa40-6d02ef86b514 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:56.989545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b2109-d655-4815-aa40-6d02ef86b514 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.995464 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be24101-4aca-42d9-93fd-4d1fc1d39708 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:56.995740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c053dd4-9eaa-4682-83b8-b6c8e2cdf012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:56.996652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c053dd4-9eaa-4682-83b8-b6c8e2cdf012 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:56.996898 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c053dd4-9eaa-4682-83b8-b6c8e2cdf012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:56.997175 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c053dd4-9eaa-4682-83b8-b6c8e2cdf012 admin admin] PATH_INFO: `/v3/projects/033ccab1688f413d94bbccb97f875699/users/703c0c56be484124acef7c8e2a58e856/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.001141 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3f37d-aecc-4cd6-9247-168bb52cb79a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:57.002019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f37d-aecc-4cd6-9247-168bb52cb79a service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.002305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f37d-aecc-4cd6-9247-168bb52cb79a service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.002637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f37d-aecc-4cd6-9247-168bb52cb79a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.017093 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c053dd4-9eaa-4682-83b8-b6c8e2cdf012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033ccab1688f413d94bbccb97f875699, user_id=703c0c56be484124acef7c8e2a58e856, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:57.019977 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c053dd4-9eaa-4682-83b8-b6c8e2cdf012 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:57.035340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 803/1604] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:30:56 2021] PUT /identity/v3/projects/033ccab1688f413d94bbccb97f875699/users/703c0c56be484124acef7c8e2a58e856/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:30:57.047447 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c053dd4-9eaa-4682-83b8-b6c8e2cdf012 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:57.067900 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3f37d-aecc-4cd6-9247-168bb52cb79a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:57.069902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3f37d-aecc-4cd6-9247-168bb52cb79a service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:57.079658 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 802/1605] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:56 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:57.080328 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3f37d-aecc-4cd6-9247-168bb52cb79a service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:57.092236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3f37d-aecc-4cd6-9247-168bb52cb79a service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:57.116143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c053dd4-9eaa-4682-83b8-b6c8e2cdf012 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:57.121474 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd648f-0b90-4e06-93cd-004af0fda4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:57.122252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd648f-0b90-4e06-93cd-004af0fda4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.123066 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd648f-0b90-4e06-93cd-004af0fda4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.123415 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd648f-0b90-4e06-93cd-004af0fda4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.124276 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd648f-0b90-4e06-93cd-004af0fda4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:57.126013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd648f-0b90-4e06-93cd-004af0fda4f2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:57.138324 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 804/1606] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:57 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:57.142993 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd648f-0b90-4e06-93cd-004af0fda4f2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:57.163668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd648f-0b90-4e06-93cd-004af0fda4f2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:57.165370 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e82aa-a229-4d4e-a40b-e3de2b380625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:57.166388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e82aa-a229-4d4e-a40b-e3de2b380625 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.166495 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e82aa-a229-4d4e-a40b-e3de2b380625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.166726 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e82aa-a229-4d4e-a40b-e3de2b380625 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.167653 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e82aa-a229-4d4e-a40b-e3de2b380625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:57.168700 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba3274-24ea-4079-8dfe-3a7f7e5afc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:57.169922 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba3274-24ea-4079-8dfe-3a7f7e5afc5c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.170143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e82aa-a229-4d4e-a40b-e3de2b380625 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:57.170470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba3274-24ea-4079-8dfe-3a7f7e5afc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.170756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba3274-24ea-4079-8dfe-3a7f7e5afc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.171879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba3274-24ea-4079-8dfe-3a7f7e5afc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:57.173715 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba3274-24ea-4079-8dfe-3a7f7e5afc5c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:57.187762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 805/1608] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:57 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:57.187980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 803/1608] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:30:57 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:30:57.187980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e82aa-a229-4d4e-a40b-e3de2b380625 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:57.188496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba3274-24ea-4079-8dfe-3a7f7e5afc5c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:57.191645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8fba3274-24ea-4079-8dfe-3a7f7e5afc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:57.197626 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e82aa-a229-4d4e-a40b-e3de2b380625 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:57.203175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fd5ba-5c44-458a-adf0-c325f22356e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:57.204110 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fd5ba-5c44-458a-adf0-c325f22356e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.204395 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fd5ba-5c44-458a-adf0-c325f22356e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.204875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fd5ba-5c44-458a-adf0-c325f22356e9 admin admin] PATH_INFO: `/v3/projects/849d4c797afe475aa474e4415f6190c0/users/58ad05b9c93c48a4bf4d1f086b6d5ad1/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.235881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fd5ba-5c44-458a-adf0-c325f22356e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849d4c797afe475aa474e4415f6190c0, user_id=58ad05b9c93c48a4bf4d1f086b6d5ad1, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:57.238991 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fd5ba-5c44-458a-adf0-c325f22356e9 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:57.256236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 804/1609] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:30:57 2021] PUT /identity/v3/projects/849d4c797afe475aa474e4415f6190c0/users/58ad05b9c93c48a4bf4d1f086b6d5ad1/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:30:57.257619 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950fb02-1f11-48f8-8c7e-284b3097dd0f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.258351 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950fb02-1f11-48f8-8c7e-284b3097dd0f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.258650 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950fb02-1f11-48f8-8c7e-284b3097dd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.292080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e950fb02-1f11-48f8-8c7e-284b3097dd0f None None] MFA Rules not processed for user `703c0c56be484124acef7c8e2a58e856`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:57.293193 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba3274-24ea-4079-8dfe-3a7f7e5afc5c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:57.294949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e950fb02-1f11-48f8-8c7e-284b3097dd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:57.360645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390822a4-8001-4776-9ba0-1ee39f3d1339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:57.360645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390822a4-8001-4776-9ba0-1ee39f3d1339 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.360975 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390822a4-8001-4776-9ba0-1ee39f3d1339 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.361055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390822a4-8001-4776-9ba0-1ee39f3d1339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.390487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 805/1610] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:57 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:57.391442 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950fb02-1f11-48f8-8c7e-284b3097dd0f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:57.458071 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390822a4-8001-4776-9ba0-1ee39f3d1339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:57.459712 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390822a4-8001-4776-9ba0-1ee39f3d1339 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:57.472905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 806/1611] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:57.473770 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390822a4-8001-4776-9ba0-1ee39f3d1339 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:57.487437 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390822a4-8001-4776-9ba0-1ee39f3d1339 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:57.489183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950fb02-1f11-48f8-8c7e-284b3097dd0f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:57.495757 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69164ea4-e0e7-4552-a661-bcec1a94f665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:57.496240 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbe363-8d97-4e0a-b22a-3bfe5e926c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:57.496914 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69164ea4-e0e7-4552-a661-bcec1a94f665 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.497304 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbe363-8d97-4e0a-b22a-3bfe5e926c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.497616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69164ea4-e0e7-4552-a661-bcec1a94f665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.497803 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbe363-8d97-4e0a-b22a-3bfe5e926c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.498015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbe363-8d97-4e0a-b22a-3bfe5e926c2b admin admin] PATH_INFO: `/v3/projects/4cde9c0e34334ad7a7e79bfeb8963935/users/e2f51c315df74089bc6873e889cf80d7/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.498367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69164ea4-e0e7-4552-a661-bcec1a94f665 admin admin] PATH_INFO: `/v3/projects/6898e751314d4e94af3fc6df9b465470/users/a53d77fd836e4abda2cb59d5ed6c370e/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.517632 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbe363-8d97-4e0a-b22a-3bfe5e926c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cde9c0e34334ad7a7e79bfeb8963935, user_id=e2f51c315df74089bc6873e889cf80d7, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:57.519566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69164ea4-e0e7-4552-a661-bcec1a94f665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6898e751314d4e94af3fc6df9b465470, user_id=a53d77fd836e4abda2cb59d5ed6c370e, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:57.520678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbe363-8d97-4e0a-b22a-3bfe5e926c2b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:57.522788 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69164ea4-e0e7-4552-a661-bcec1a94f665 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:57.543808 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 806/1612] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:30:57 2021] PUT /identity/v3/projects/4cde9c0e34334ad7a7e79bfeb8963935/users/e2f51c315df74089bc6873e889cf80d7/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:30:57.544808 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbe363-8d97-4e0a-b22a-3bfe5e926c2b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:57.549718 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 807/1613] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:30:57 2021] PUT /identity/v3/projects/6898e751314d4e94af3fc6df9b465470/users/a53d77fd836e4abda2cb59d5ed6c370e/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:30:57.551397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9b1df-086e-4a55-a729-5f59b60bda09 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.551984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9b1df-086e-4a55-a729-5f59b60bda09 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.552368 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9b1df-086e-4a55-a729-5f59b60bda09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.595024 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-2ac9b1df-086e-4a55-a729-5f59b60bda09 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:57.597142 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2ac9b1df-086e-4a55-a729-5f59b60bda09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:57.642555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbe363-8d97-4e0a-b22a-3bfe5e926c2b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:57.676848 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 808/1614] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:57.676848 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aae480-2e01-446e-b7be-11c422e43c62 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.677735 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aae480-2e01-446e-b7be-11c422e43c62 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.678027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aae480-2e01-446e-b7be-11c422e43c62 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.680714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 809/1615] 10.222.0.60 () {54 vars in 961 bytes} [Wed Dec 15 13:30:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:57.682170 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b09222-ccc9-4943-834b-d61ecd62cae9 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.682601 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b09222-ccc9-4943-834b-d61ecd62cae9 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.683126 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b09222-ccc9-4943-834b-d61ecd62cae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.733202 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-d3b09222-ccc9-4943-834b-d61ecd62cae9 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:57.735204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d3b09222-ccc9-4943-834b-d61ecd62cae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:57.748986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 810/1616] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:57.754251 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54f86a-f9b6-4311-ac36-1edf63336b0a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.754661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54f86a-f9b6-4311-ac36-1edf63336b0a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.755073 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54f86a-f9b6-4311-ac36-1edf63336b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.768678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12ee98-9925-4905-ace0-63241c8e92d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:57.772190 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12ee98-9925-4905-ace0-63241c8e92d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.772548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12ee98-9925-4905-ace0-63241c8e92d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.772841 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12ee98-9925-4905-ace0-63241c8e92d9 admin admin] PATH_INFO: `/v3/projects/f871ced7f7414d71a91412e723ea54f1/users/78deb70afbc34d8b8c7ea61e43f2b700/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.777222 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-dd54f86a-f9b6-4311-ac36-1edf63336b0a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:57.778814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-dd54f86a-f9b6-4311-ac36-1edf63336b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:57.789533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 811/1617] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:57.794416 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54f86a-f9b6-4311-ac36-1edf63336b0a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:57.823720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12ee98-9925-4905-ace0-63241c8e92d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f871ced7f7414d71a91412e723ea54f1, user_id=78deb70afbc34d8b8c7ea61e43f2b700, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:57.823720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12ee98-9925-4905-ace0-63241c8e92d9 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:57.847319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 807/1618] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:30:57 2021] PUT /identity/v3/projects/f871ced7f7414d71a91412e723ea54f1/users/78deb70afbc34d8b8c7ea61e43f2b700/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:30:57.849246 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce191ddd-f1d5-400a-8f19-b89cc9b8a33d None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.849246 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce191ddd-f1d5-400a-8f19-b89cc9b8a33d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.849471 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce191ddd-f1d5-400a-8f19-b89cc9b8a33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.878139 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ce191ddd-f1d5-400a-8f19-b89cc9b8a33d None None] MFA Rules not processed for user `d61a8e4d64664e68a5710fdf766e4685`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:57.879568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54f86a-f9b6-4311-ac36-1edf63336b0a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:57.880203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ce191ddd-f1d5-400a-8f19-b89cc9b8a33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:57.953319 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85784bfd-35d8-4bdc-94d1-edaeea789918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:57.954316 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85784bfd-35d8-4bdc-94d1-edaeea789918 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.954806 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85784bfd-35d8-4bdc-94d1-edaeea789918 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.955423 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85784bfd-35d8-4bdc-94d1-edaeea789918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:57.971657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 808/1619] 10.222.0.60 () {58 vars in 1058 bytes} [Wed Dec 15 13:30:57 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:57.981461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce191ddd-f1d5-400a-8f19-b89cc9b8a33d None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:57.992116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce191ddd-f1d5-400a-8f19-b89cc9b8a33d None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:57.996116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49ffa8-00de-4df8-8b84-0281a71f9542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:57.996800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ffa8-00de-4df8-8b84-0281a71f9542 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:57.997053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ffa8-00de-4df8-8b84-0281a71f9542 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:57.998488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ffa8-00de-4df8-8b84-0281a71f9542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.046018 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85784bfd-35d8-4bdc-94d1-edaeea789918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:58.047505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85784bfd-35d8-4bdc-94d1-edaeea789918 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:58.058141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 812/1620] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:58.068965 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85784bfd-35d8-4bdc-94d1-edaeea789918 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:58.070453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49ffa8-00de-4df8-8b84-0281a71f9542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:58.073171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49ffa8-00de-4df8-8b84-0281a71f9542 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:58.081909 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85784bfd-35d8-4bdc-94d1-edaeea789918 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:58.086560 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8443d47-803c-4fb1-ade6-3da423f7fe5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:58.086719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 809/1621] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:58.087861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8443d47-803c-4fb1-ade6-3da423f7fe5c service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.088266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023afc45-cd91-4071-af66-a8b8cf1019f7 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.088731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8443d47-803c-4fb1-ade6-3da423f7fe5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.089413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8443d47-803c-4fb1-ade6-3da423f7fe5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.089771 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023afc45-cd91-4071-af66-a8b8cf1019f7 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.090074 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023afc45-cd91-4071-af66-a8b8cf1019f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.103784 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8443d47-803c-4fb1-ade6-3da423f7fe5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:58.106206 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8443d47-803c-4fb1-ade6-3da423f7fe5c service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:58.119315 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 813/1622] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:58.120574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8443d47-803c-4fb1-ade6-3da423f7fe5c service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:58.126977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-023afc45-cd91-4071-af66-a8b8cf1019f7 None None] MFA Rules not processed for user `78deb70afbc34d8b8c7ea61e43f2b700`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:58.128224 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-023afc45-cd91-4071-af66-a8b8cf1019f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:58.136827 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8443d47-803c-4fb1-ade6-3da423f7fe5c service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:58.145249 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4819f0-cb26-490c-b120-5b21c895cdb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:58.146332 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4819f0-cb26-490c-b120-5b21c895cdb4 service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.147157 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4819f0-cb26-490c-b120-5b21c895cdb4 service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.147803 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4819f0-cb26-490c-b120-5b21c895cdb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.234586 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 810/1623] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:58 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:58.252688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31474071-2a08-4010-a43b-0f1ac4a6b580 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.253469 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31474071-2a08-4010-a43b-0f1ac4a6b580 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.253996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31474071-2a08-4010-a43b-0f1ac4a6b580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.254591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4819f0-cb26-490c-b120-5b21c895cdb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:58.256719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4819f0-cb26-490c-b120-5b21c895cdb4 service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:58.271924 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 814/1624] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:58 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:58.274233 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e839ef-9192-4ece-a9ba-1cec44dca1dd None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.274964 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e839ef-9192-4ece-a9ba-1cec44dca1dd None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.275540 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e839ef-9192-4ece-a9ba-1cec44dca1dd None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.278256 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 815/1625] 10.222.0.60 () {54 vars in 961 bytes} [Wed Dec 15 13:30:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:58.285302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1e4c0-4298-4746-b27d-5cd0336127bf None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.285966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1e4c0-4298-4746-b27d-5cd0336127bf None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.286892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1e4c0-4298-4746-b27d-5cd0336127bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.316336 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-d2e1e4c0-4298-4746-b27d-5cd0336127bf None None] MFA Rules not processed for user `d61a8e4d64664e68a5710fdf766e4685`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:58.318813 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d2e1e4c0-4298-4746-b27d-5cd0336127bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:58.319109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-31474071-2a08-4010-a43b-0f1ac4a6b580 None None] MFA Rules not processed for user `df94523ab7c545f2a17a2cafe936d2ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:58.320455 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-31474071-2a08-4010-a43b-0f1ac4a6b580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:58.334135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 816/1626] 10.222.0.60 () {58 vars in 1058 bytes} [Wed Dec 15 13:30:58 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:58.343903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1e4c0-4298-4746-b27d-5cd0336127bf None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:58.359430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1e4c0-4298-4746-b27d-5cd0336127bf None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:58.369120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37916778-1efa-404c-995e-e6bdf69d0947 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:58.370306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37916778-1efa-404c-995e-e6bdf69d0947 service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.370932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37916778-1efa-404c-995e-e6bdf69d0947 service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.371437 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37916778-1efa-404c-995e-e6bdf69d0947 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.387043 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37916778-1efa-404c-995e-e6bdf69d0947 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:58.390014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37916778-1efa-404c-995e-e6bdf69d0947 service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:58.409219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 817/1627] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:58 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:58.471447 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 811/1628] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:58 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:30:58.473584 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66d9d1-8a4c-4e00-a7e0-22c13257a0d9 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.473980 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66d9d1-8a4c-4e00-a7e0-22c13257a0d9 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.474366 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66d9d1-8a4c-4e00-a7e0-22c13257a0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.518573 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-4b66d9d1-8a4c-4e00-a7e0-22c13257a0d9 None None] MFA Rules not processed for user `df94523ab7c545f2a17a2cafe936d2ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:58.522609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-4b66d9d1-8a4c-4e00-a7e0-22c13257a0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:58.557497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 818/1629] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:58 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:58.649779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb816679-eae9-47a1-8c95-01f4e62c4c38 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.650090 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb816679-eae9-47a1-8c95-01f4e62c4c38 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.650363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb816679-eae9-47a1-8c95-01f4e62c4c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.705608 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-cb816679-eae9-47a1-8c95-01f4e62c4c38 None None] MFA Rules not processed for user `07defc49f2774d9e9c7001504aa647ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:58.706877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-cb816679-eae9-47a1-8c95-01f4e62c4c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:58.712446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66d9d1-8a4c-4e00-a7e0-22c13257a0d9 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:58.735204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66d9d1-8a4c-4e00-a7e0-22c13257a0d9 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:58.742177 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d9d7b-23ca-481c-9c34-7f82fc4ad267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:58.743390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d9d7b-23ca-481c-9c34-7f82fc4ad267 service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.743969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d9d7b-23ca-481c-9c34-7f82fc4ad267 service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.744261 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d9d7b-23ca-481c-9c34-7f82fc4ad267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.755760 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d9d7b-23ca-481c-9c34-7f82fc4ad267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:58.757443 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d9d7b-23ca-481c-9c34-7f82fc4ad267 service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:58.794355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 819/1630] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:58 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:58.801265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aa007-57eb-4797-b3d0-458a02575aac None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.801571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aa007-57eb-4797-b3d0-458a02575aac None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.801853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aa007-57eb-4797-b3d0-458a02575aac None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.804247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 820/1631] 10.222.0.60 () {54 vars in 912 bytes} [Wed Dec 15 13:30:58 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:58.811014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332ab5-35fc-4a64-ba12-e729f326c4be None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.811322 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332ab5-35fc-4a64-ba12-e729f326c4be None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.811605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332ab5-35fc-4a64-ba12-e729f326c4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.827713 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 812/1632] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:58 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:58.840737 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e01f2-3936-423e-9cf5-e50fb236c331 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.841679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e01f2-3936-423e-9cf5-e50fb236c331 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.842084 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e01f2-3936-423e-9cf5-e50fb236c331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.856124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-7d332ab5-35fc-4a64-ba12-e729f326c4be None None] MFA Rules not processed for user `d61a8e4d64664e68a5710fdf766e4685`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:58.857928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-7d332ab5-35fc-4a64-ba12-e729f326c4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:58.866758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-967e01f2-3936-423e-9cf5-e50fb236c331 None None] MFA Rules not processed for user `07defc49f2774d9e9c7001504aa647ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:58.868283 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-967e01f2-3936-423e-9cf5-e50fb236c331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:58.880405 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 813/1633] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:30:58 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:58.894245 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 821/1634] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:30:58 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:58.902089 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e01f2-3936-423e-9cf5-e50fb236c331 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:58.952254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036e820-e2c9-4cf4-9a39-613b2c27d3d4 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.952562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036e820-e2c9-4cf4-9a39-613b2c27d3d4 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.952821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036e820-e2c9-4cf4-9a39-613b2c27d3d4 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.954608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 822/1635] 10.222.0.60 () {54 vars in 912 bytes} [Wed Dec 15 13:30:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:30:58.960124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811acf94-b905-4fe2-81a8-d2bded0d23b8 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.960413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811acf94-b905-4fe2-81a8-d2bded0d23b8 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.973315 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811acf94-b905-4fe2-81a8-d2bded0d23b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.993121 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-811acf94-b905-4fe2-81a8-d2bded0d23b8 None None] MFA Rules not processed for user `d61a8e4d64664e68a5710fdf766e4685`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:58.994332 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-811acf94-b905-4fe2-81a8-d2bded0d23b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:58.997083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e01f2-3936-423e-9cf5-e50fb236c331 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:59.001809 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a321875-578f-43f1-86fc-e99ec3b27488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:59.002672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a321875-578f-43f1-86fc-e99ec3b27488 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:59.003152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a321875-578f-43f1-86fc-e99ec3b27488 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:59.003613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a321875-578f-43f1-86fc-e99ec3b27488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:59.015457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 823/1636] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:30:58 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:30:59.024811 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a321875-578f-43f1-86fc-e99ec3b27488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:59.026642 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a321875-578f-43f1-86fc-e99ec3b27488 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:59.032503 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811acf94-b905-4fe2-81a8-d2bded0d23b8 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:59.036679 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-811acf94-b905-4fe2-81a8-d2bded0d23b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:59.041107 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 814/1637] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:59.115385 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811acf94-b905-4fe2-81a8-d2bded0d23b8 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:59.123252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cd158-57cf-48aa-aebd-de51d6a8412e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9aff45fefe408fa1667e5298f8ff6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:59.124271 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cd158-57cf-48aa-aebd-de51d6a8412e service glance] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:59.124825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cd158-57cf-48aa-aebd-de51d6a8412e service glance] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:59.125274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cd158-57cf-48aa-aebd-de51d6a8412e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:59.138993 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cd158-57cf-48aa-aebd-de51d6a8412e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:59.141927 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cd158-57cf-48aa-aebd-de51d6a8412e service glance] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:59.174798 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 824/1638] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:59 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:30:59.646453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a321875-578f-43f1-86fc-e99ec3b27488 service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:59.659688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a321875-578f-43f1-86fc-e99ec3b27488 service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:59.671883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de74c28-4103-481f-91a6-76ff8664690c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:59.672753 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de74c28-4103-481f-91a6-76ff8664690c service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:59.673205 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de74c28-4103-481f-91a6-76ff8664690c service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:59.673630 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de74c28-4103-481f-91a6-76ff8664690c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:59.684814 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de74c28-4103-481f-91a6-76ff8664690c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:59.687987 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de74c28-4103-481f-91a6-76ff8664690c service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:59.706517 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a45d63-08f8-4e84-8bec-055e7d4ec39e None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:59.707095 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a45d63-08f8-4e84-8bec-055e7d4ec39e None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:59.707095 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a45d63-08f8-4e84-8bec-055e7d4ec39e None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:59.709029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 825/1639] 10.222.0.60 () {54 vars in 912 bytes} [Wed Dec 15 13:30:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:59.715651 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c6ed0-a446-43bc-b668-28ae6a5286f2 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:59.716564 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c6ed0-a446-43bc-b668-28ae6a5286f2 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:59.717137 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c6ed0-a446-43bc-b668-28ae6a5286f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:59.719551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 815/1640] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:59 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:59.746743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-873c6ed0-a446-43bc-b668-28ae6a5286f2 None None] MFA Rules not processed for user `c9a44a13e31941b5af9579d8bec345ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:59.749065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-873c6ed0-a446-43bc-b668-28ae6a5286f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:59.763259 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 826/1641] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:30:59 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:30:59.776383 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de74c28-4103-481f-91a6-76ff8664690c service nova] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:59.796994 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de74c28-4103-481f-91a6-76ff8664690c service nova] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:59.801952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440e9c4-c157-45d2-9d2c-e0a4ba622709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:59.802821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440e9c4-c157-45d2-9d2c-e0a4ba622709 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:59.803035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440e9c4-c157-45d2-9d2c-e0a4ba622709 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:59.803394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440e9c4-c157-45d2-9d2c-e0a4ba622709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:59.813758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440e9c4-c157-45d2-9d2c-e0a4ba622709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:59.815531 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440e9c4-c157-45d2-9d2c-e0a4ba622709 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:59.837868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 816/1642] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:00.526120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02fb8-b98d-48b4-904c-759cbf1c297a None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:00.526321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02fb8-b98d-48b4-904c-759cbf1c297a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:00.526599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02fb8-b98d-48b4-904c-759cbf1c297a None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:00.528683 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 827/1643] 10.222.0.60 () {54 vars in 912 bytes} [Wed Dec 15 13:31:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:00.537544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1854a9-57c1-416a-8cce-6aa3541ec96a None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:00.538200 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1854a9-57c1-416a-8cce-6aa3541ec96a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:00.538701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1854a9-57c1-416a-8cce-6aa3541ec96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:00.563081 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-5d1854a9-57c1-416a-8cce-6aa3541ec96a None None] MFA Rules not processed for user `c9a44a13e31941b5af9579d8bec345ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:00.564831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5d1854a9-57c1-416a-8cce-6aa3541ec96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:00.576764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 817/1644] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:31:00 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:00.622146 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc02fb8-b98d-48b4-904c-759cbf1c297a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:00.640058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc02fb8-b98d-48b4-904c-759cbf1c297a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:00.646073 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e78d2a-7e43-4c46-9ab0-a38fbc80accb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:00.649531 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78d2a-7e43-4c46-9ab0-a38fbc80accb service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:00.650438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78d2a-7e43-4c46-9ab0-a38fbc80accb service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:00.651695 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78d2a-7e43-4c46-9ab0-a38fbc80accb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:00.672769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e78d2a-7e43-4c46-9ab0-a38fbc80accb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:00.674969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e78d2a-7e43-4c46-9ab0-a38fbc80accb service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:00.688038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 828/1645] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:00 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:01.129782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1854a9-57c1-416a-8cce-6aa3541ec96a None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:01.291759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1854a9-57c1-416a-8cce-6aa3541ec96a None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:01.313147 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a883bf0-e895-4d08-b911-a50dea376847 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e05695f0d91463bae1f2a67a58cb54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:01.314023 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a883bf0-e895-4d08-b911-a50dea376847 service placement] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:01.314304 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a883bf0-e895-4d08-b911-a50dea376847 service placement] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:01.314587 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a883bf0-e895-4d08-b911-a50dea376847 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:01.323767 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5a883bf0-e895-4d08-b911-a50dea376847 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:01.353053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a883bf0-e895-4d08-b911-a50dea376847 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:01.355148 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a883bf0-e895-4d08-b911-a50dea376847 service placement] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:01.381125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 818/1646] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:01 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:02.440819 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e78d2a-7e43-4c46-9ab0-a38fbc80accb service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:02.456754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e78d2a-7e43-4c46-9ab0-a38fbc80accb service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:02.478113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:02.481353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:02.483210 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:02.483668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] PATH_INFO: `/v3/users/703c0c56be484124acef7c8e2a58e856` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:02.487208 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] RBAC: Authorizing `identity:delete_user(user_id=703c0c56be484124acef7c8e2a58e856)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:02.489237 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: WARNING py.warnings [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:31:02.489237 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: warnings.warn(msg) Dec 15 13:31:02.489237 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: Dec 15 13:31:02.492722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:02.652591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '703c0c56be484124acef7c8e2a58e856'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:02.691666 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '703c0c56be484124acef7c8e2a58e856'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:02.714457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '703c0c56be484124acef7c8e2a58e856'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:02.729003 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '703c0c56be484124acef7c8e2a58e856'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:02.730028 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '703c0c56be484124acef7c8e2a58e856'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:02.747999 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 829/1647] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:02 2021] DELETE /identity/v3/users/703c0c56be484124acef7c8e2a58e856 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:02.749932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2424f4-5c0c-4f79-93ee-a24112a6564c None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:02.750798 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2424f4-5c0c-4f79-93ee-a24112a6564c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:02.751172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2424f4-5c0c-4f79-93ee-a24112a6564c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:02.799435 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-1b2424f4-5c0c-4f79-93ee-a24112a6564c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:02.808246 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-1b2424f4-5c0c-4f79-93ee-a24112a6564c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:02.970078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 819/1648] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:31:02.988189 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:03.004737 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:03.170677 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800722e-fee2-4a1a-a569-96cb99b1806e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:03.182316 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d15640-4773-447d-8270-6ae1a127dc8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:03.183074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d15640-4773-447d-8270-6ae1a127dc8a service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:03.183504 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d15640-4773-447d-8270-6ae1a127dc8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:03.183961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d15640-4773-447d-8270-6ae1a127dc8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:03.199796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d15640-4773-447d-8270-6ae1a127dc8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:03.202219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d15640-4773-447d-8270-6ae1a127dc8a service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:03.218039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 830/1649] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:04.255724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2424f4-5c0c-4f79-93ee-a24112a6564c None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:04.258180 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-1b2424f4-5c0c-4f79-93ee-a24112a6564c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:04.294559 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2424f4-5c0c-4f79-93ee-a24112a6564c None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:04.299521 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed71959-10d7-470c-8590-21b417c4e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:04.300393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed71959-10d7-470c-8590-21b417c4e28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:04.302069 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed71959-10d7-470c-8590-21b417c4e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:04.302373 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed71959-10d7-470c-8590-21b417c4e28e admin admin] PATH_INFO: `/v3/projects/033ccab1688f413d94bbccb97f875699` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:04.305544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed71959-10d7-470c-8590-21b417c4e28e admin admin] RBAC: Authorizing `identity:delete_project(project_id=033ccab1688f413d94bbccb97f875699)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:04.307796 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: WARNING py.warnings [None req-6ed71959-10d7-470c-8590-21b417c4e28e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:31:04.307796 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: warnings.warn(msg) Dec 15 13:31:04.307796 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: Dec 15 13:31:04.309019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed71959-10d7-470c-8590-21b417c4e28e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:04.510931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-6ed71959-10d7-470c-8590-21b417c4e28e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033ccab1688f413d94bbccb97f875699', 'request_id': 'req-6ed71959-10d7-470c-8590-21b417c4e28e'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:04.551854 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-6ed71959-10d7-470c-8590-21b417c4e28e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033ccab1688f413d94bbccb97f875699', 'request_id': 'req-6ed71959-10d7-470c-8590-21b417c4e28e'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:04.598673 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-6ed71959-10d7-470c-8590-21b417c4e28e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033ccab1688f413d94bbccb97f875699', 'request_id': 'req-6ed71959-10d7-470c-8590-21b417c4e28e'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:04.677919 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-6ed71959-10d7-470c-8590-21b417c4e28e admin admin] The token cache is being invalidate because project 033ccab1688f413d94bbccb97f875699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:04.678335 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-6ed71959-10d7-470c-8590-21b417c4e28e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:04.680322 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-6ed71959-10d7-470c-8590-21b417c4e28e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:04.684043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 820/1650] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:04 2021] DELETE /identity/v3/projects/033ccab1688f413d94bbccb97f875699 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:04.689935 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ba184-77dc-43ff-a2f8-96db1137f0e3 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:04.690466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ba184-77dc-43ff-a2f8-96db1137f0e3 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:04.690466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ba184-77dc-43ff-a2f8-96db1137f0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:04.739477 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-a73ba184-77dc-43ff-a2f8-96db1137f0e3 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:04.741481 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a73ba184-77dc-43ff-a2f8-96db1137f0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:04.822757 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 831/1651] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:04.831542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d24d9b-bd1d-492f-a989-1aee59d18aad None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:04.831912 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d24d9b-bd1d-492f-a989-1aee59d18aad None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:04.832289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d24d9b-bd1d-492f-a989-1aee59d18aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:04.878236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-12d24d9b-bd1d-492f-a989-1aee59d18aad None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:04.879551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-12d24d9b-bd1d-492f-a989-1aee59d18aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:04.909162 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 821/1652] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:04.910776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ba184-77dc-43ff-a2f8-96db1137f0e3 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:04.922637 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ba184-77dc-43ff-a2f8-96db1137f0e3 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:04.940239 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843efd-5bdb-4730-b97c-da999f2706f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:04.941169 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843efd-5bdb-4730-b97c-da999f2706f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:04.941640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843efd-5bdb-4730-b97c-da999f2706f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:04.941994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843efd-5bdb-4730-b97c-da999f2706f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:04.942812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59843efd-5bdb-4730-b97c-da999f2706f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:04.943221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59843efd-5bdb-4730-b97c-da999f2706f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:04.947997 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59843efd-5bdb-4730-b97c-da999f2706f0 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:04.969866 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 832/1653] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:31:04.970601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d24d9b-bd1d-492f-a989-1aee59d18aad None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:04.990146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d24d9b-bd1d-492f-a989-1aee59d18aad None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:04.998866 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75bf88-4f55-43bf-9f29-b92f13910096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:05.000160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75bf88-4f55-43bf-9f29-b92f13910096 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:05.000652 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75bf88-4f55-43bf-9f29-b92f13910096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:05.001169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75bf88-4f55-43bf-9f29-b92f13910096 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:05.002273 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75bf88-4f55-43bf-9f29-b92f13910096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:05.005450 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75bf88-4f55-43bf-9f29-b92f13910096 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:05.063249 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843efd-5bdb-4730-b97c-da999f2706f0 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:05.069709 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 822/1654] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:04 2021] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:05.076544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843efd-5bdb-4730-b97c-da999f2706f0 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:05.176549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2b76d-dc12-4e91-9b6d-eb9f66e0f8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:05.179339 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2b76d-dc12-4e91-9b6d-eb9f66e0f8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:05.179851 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2b76d-dc12-4e91-9b6d-eb9f66e0f8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:05.180346 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2b76d-dc12-4e91-9b6d-eb9f66e0f8b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:05.181448 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2b76d-dc12-4e91-9b6d-eb9f66e0f8b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:05.185127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2b76d-dc12-4e91-9b6d-eb9f66e0f8b8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:05.241700 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 833/1655] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:05 2021] POST /identity/v3/users => generated 284 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:05.248406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75bf88-4f55-43bf-9f29-b92f13910096 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:05.272485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75bf88-4f55-43bf-9f29-b92f13910096 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:05.282459 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd862f0-9f73-4377-9e6d-9ee6dbe077d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:05.283181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd862f0-9f73-4377-9e6d-9ee6dbe077d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:05.283468 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd862f0-9f73-4377-9e6d-9ee6dbe077d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:05.283748 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd862f0-9f73-4377-9e6d-9ee6dbe077d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:05.284835 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd862f0-9f73-4377-9e6d-9ee6dbe077d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:05.286476 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd862f0-9f73-4377-9e6d-9ee6dbe077d0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:05.307017 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 823/1656] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:05 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:05.310009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2b76d-dc12-4e91-9b6d-eb9f66e0f8b8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:05.324458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2b76d-dc12-4e91-9b6d-eb9f66e0f8b8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:05.335455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bde06-34fd-4353-9ed0-d3bb4834cf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:05.336309 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bde06-34fd-4353-9ed0-d3bb4834cf93 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:05.336446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bde06-34fd-4353-9ed0-d3bb4834cf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:05.336762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bde06-34fd-4353-9ed0-d3bb4834cf93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:05.337591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bde06-34fd-4353-9ed0-d3bb4834cf93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:05.339532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bde06-34fd-4353-9ed0-d3bb4834cf93 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:05.356145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 834/1657] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:05 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:05.360049 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd862f0-9f73-4377-9e6d-9ee6dbe077d0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:05.373584 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd862f0-9f73-4377-9e6d-9ee6dbe077d0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:05.386646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d42593-4638-4ab9-8e2e-763ca02c19e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:05.387462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d42593-4638-4ab9-8e2e-763ca02c19e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:05.387754 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d42593-4638-4ab9-8e2e-763ca02c19e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:05.388164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d42593-4638-4ab9-8e2e-763ca02c19e2 admin admin] PATH_INFO: `/v3/projects/24789e0592dc44ba9017a685b3f39466/users/a7f721d16d434d1f8dad6ca30399078d/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:05.428785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d42593-4638-4ab9-8e2e-763ca02c19e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24789e0592dc44ba9017a685b3f39466, user_id=a7f721d16d434d1f8dad6ca30399078d, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:05.434261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d42593-4638-4ab9-8e2e-763ca02c19e2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:05.477726 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 824/1658] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:05 2021] PUT /identity/v3/projects/24789e0592dc44ba9017a685b3f39466/users/a7f721d16d434d1f8dad6ca30399078d/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:05.532907 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d01b-627e-4103-bbd1-85d4301d6407 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:05.533564 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d01b-627e-4103-bbd1-85d4301d6407 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:05.533994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d01b-627e-4103-bbd1-85d4301d6407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:05.600056 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-a2d1d01b-627e-4103-bbd1-85d4301d6407 None None] MFA Rules not processed for user `a7f721d16d434d1f8dad6ca30399078d`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:05.601534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a2d1d01b-627e-4103-bbd1-85d4301d6407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:05.701727 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 835/1659] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:05 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:31:05.705536 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d42593-4638-4ab9-8e2e-763ca02c19e2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:05.827068 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d42593-4638-4ab9-8e2e-763ca02c19e2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:05.837652 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727f298-d5e8-450d-aefa-0c749e2c08b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:05.838500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727f298-d5e8-450d-aefa-0c749e2c08b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:05.838788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727f298-d5e8-450d-aefa-0c749e2c08b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:05.839148 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727f298-d5e8-450d-aefa-0c749e2c08b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:05.841071 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727f298-d5e8-450d-aefa-0c749e2c08b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:05.844581 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727f298-d5e8-450d-aefa-0c749e2c08b0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:05.915230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 825/1660] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:05 2021] POST /identity/v3/projects => generated 365 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:05.915597 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1d01b-627e-4103-bbd1-85d4301d6407 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:05.929726 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1d01b-627e-4103-bbd1-85d4301d6407 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:06.024330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67319382-ae07-46cb-94cd-f38497911959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:06.025114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67319382-ae07-46cb-94cd-f38497911959 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:06.025495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67319382-ae07-46cb-94cd-f38497911959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:06.025798 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67319382-ae07-46cb-94cd-f38497911959 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:06.026594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67319382-ae07-46cb-94cd-f38497911959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:06.029078 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67319382-ae07-46cb-94cd-f38497911959 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:06.057735 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 836/1661] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:05 2021] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:06.061293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727f298-d5e8-450d-aefa-0c749e2c08b0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:06.073315 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727f298-d5e8-450d-aefa-0c749e2c08b0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:06.079503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b7673-7a97-428c-8212-5acf47208630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:06.080698 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b7673-7a97-428c-8212-5acf47208630 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:06.081258 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b7673-7a97-428c-8212-5acf47208630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:06.081751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b7673-7a97-428c-8212-5acf47208630 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:06.082956 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b7673-7a97-428c-8212-5acf47208630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:06.085120 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b7673-7a97-428c-8212-5acf47208630 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:06.106414 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 826/1662] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:06 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:31:06.112255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67319382-ae07-46cb-94cd-f38497911959 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:06.122658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67319382-ae07-46cb-94cd-f38497911959 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:06.127644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79912c8f-0ff8-42b3-88af-48b59a7bc416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:06.128548 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912c8f-0ff8-42b3-88af-48b59a7bc416 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:06.128831 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912c8f-0ff8-42b3-88af-48b59a7bc416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:06.129105 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912c8f-0ff8-42b3-88af-48b59a7bc416 admin admin] PATH_INFO: `/v3/projects/d2ce03c44ace47caac05adb32973d0c1/users/1f9f82fd3ff6448da83582e85558098e/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:06.145942 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79912c8f-0ff8-42b3-88af-48b59a7bc416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ce03c44ace47caac05adb32973d0c1, user_id=1f9f82fd3ff6448da83582e85558098e, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:06.149088 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79912c8f-0ff8-42b3-88af-48b59a7bc416 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:06.178734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 837/1663] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:06 2021] PUT /identity/v3/projects/d2ce03c44ace47caac05adb32973d0c1/users/1f9f82fd3ff6448da83582e85558098e/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:06.180400 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b7673-7a97-428c-8212-5acf47208630 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:06.201650 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75d0b3-b2db-4d04-a2cf-3f9fe2dfb273 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:06.201885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75d0b3-b2db-4d04-a2cf-3f9fe2dfb273 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:06.202179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75d0b3-b2db-4d04-a2cf-3f9fe2dfb273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:06.209394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b7673-7a97-428c-8212-5acf47208630 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:06.237801 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-9c75d0b3-b2db-4d04-a2cf-3f9fe2dfb273 None None] MFA Rules not processed for user `58ad05b9c93c48a4bf4d1f086b6d5ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:06.240041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9c75d0b3-b2db-4d04-a2cf-3f9fe2dfb273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:06.313574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c0d27-afdb-484e-9ce5-ecd2e8e7b1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:06.315139 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c0d27-afdb-484e-9ce5-ecd2e8e7b1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:06.315347 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c0d27-afdb-484e-9ce5-ecd2e8e7b1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:06.315725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c0d27-afdb-484e-9ce5-ecd2e8e7b1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:06.316759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c0d27-afdb-484e-9ce5-ecd2e8e7b1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:06.318291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c0d27-afdb-484e-9ce5-ecd2e8e7b1c5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:06.334778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 827/1664] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:06 2021] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:31:06.336035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c0d27-afdb-484e-9ce5-ecd2e8e7b1c5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:06.356925 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c0d27-afdb-484e-9ce5-ecd2e8e7b1c5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:06.368612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 838/1665] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:06 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:31:06.369429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c1e63-998e-42af-8f7f-4b18742e0484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:06.370810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c1e63-998e-42af-8f7f-4b18742e0484 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:06.371493 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c1e63-998e-42af-8f7f-4b18742e0484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:06.371992 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c1e63-998e-42af-8f7f-4b18742e0484 admin admin] PATH_INFO: `/v3/projects/d2ce03c44ace47caac05adb32973d0c1/users/1f9f82fd3ff6448da83582e85558098e/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:06.374395 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c1e63-998e-42af-8f7f-4b18742e0484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ce03c44ace47caac05adb32973d0c1, user_id=1f9f82fd3ff6448da83582e85558098e, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:06.377301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c1e63-998e-42af-8f7f-4b18742e0484 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:06.406551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 828/1666] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:06 2021] PUT /identity/v3/projects/d2ce03c44ace47caac05adb32973d0c1/users/1f9f82fd3ff6448da83582e85558098e/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:06.409306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef666b4-6080-41a5-b9d6-5efdade3943d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:06.410384 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef666b4-6080-41a5-b9d6-5efdade3943d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:06.410987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef666b4-6080-41a5-b9d6-5efdade3943d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:06.413588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c1e63-998e-42af-8f7f-4b18742e0484 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:06.419070 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-268c1e63-998e-42af-8f7f-4b18742e0484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:06.472312 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-5ef666b4-6080-41a5-b9d6-5efdade3943d None None] MFA Rules not processed for user `1f9f82fd3ff6448da83582e85558098e`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:06.473926 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5ef666b4-6080-41a5-b9d6-5efdade3943d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:06.542460 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c1e63-998e-42af-8f7f-4b18742e0484 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:06.567477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50ca16-13e3-4366-bc38-93bc24ef7ef7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:06.568310 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50ca16-13e3-4366-bc38-93bc24ef7ef7 service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:06.568744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50ca16-13e3-4366-bc38-93bc24ef7ef7 service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:06.569132 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50ca16-13e3-4366-bc38-93bc24ef7ef7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:06.612889 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 839/1667] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:06 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:31:06.619921 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef666b4-6080-41a5-b9d6-5efdade3943d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:06.622023 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5ef666b4-6080-41a5-b9d6-5efdade3943d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:06.706237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50ca16-13e3-4366-bc38-93bc24ef7ef7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:06.719334 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef666b4-6080-41a5-b9d6-5efdade3943d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:06.725764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50ca16-13e3-4366-bc38-93bc24ef7ef7 service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:06.733152 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e4bc6-3fb7-4cfc-b9a1-c43ff9c59628 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:06.736313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e4bc6-3fb7-4cfc-b9a1-c43ff9c59628 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:06.736313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e4bc6-3fb7-4cfc-b9a1-c43ff9c59628 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:06.736525 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e4bc6-3fb7-4cfc-b9a1-c43ff9c59628 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:06.745556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 829/1668] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:06 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:06.753124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e4bc6-3fb7-4cfc-b9a1-c43ff9c59628 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:06.754632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e4bc6-3fb7-4cfc-b9a1-c43ff9c59628 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:06.766042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 840/1669] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:06 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:06.843092 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50ca16-13e3-4366-bc38-93bc24ef7ef7 service nova] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:06.854594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50ca16-13e3-4366-bc38-93bc24ef7ef7 service nova] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:06.864116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7819a-16ff-4254-a644-4aa70f85715d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:06.864790 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7819a-16ff-4254-a644-4aa70f85715d service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:06.865078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7819a-16ff-4254-a644-4aa70f85715d service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:06.865362 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7819a-16ff-4254-a644-4aa70f85715d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:06.994861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7819a-16ff-4254-a644-4aa70f85715d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:06.998518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7819a-16ff-4254-a644-4aa70f85715d service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:07.057474 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 830/1670] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:06 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:08.704692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3abb5f-9436-4749-8c58-58ac47cb5883 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:08.705689 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3abb5f-9436-4749-8c58-58ac47cb5883 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:08.706204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3abb5f-9436-4749-8c58-58ac47cb5883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:08.767089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-3c3abb5f-9436-4749-8c58-58ac47cb5883 None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:08.768861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3c3abb5f-9436-4749-8c58-58ac47cb5883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:08.907285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 841/1671] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:31:08 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:31:09.268350 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7819a-16ff-4254-a644-4aa70f85715d service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:09.270221 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-14c7819a-16ff-4254-a644-4aa70f85715d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:09.405370 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7819a-16ff-4254-a644-4aa70f85715d service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:09.425747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76216f19-0413-4cd1-abec-d9f140422473 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:09.426577 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76216f19-0413-4cd1-abec-d9f140422473 service swift] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:09.426927 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76216f19-0413-4cd1-abec-d9f140422473 service swift] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:09.427389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76216f19-0413-4cd1-abec-d9f140422473 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:09.448269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76216f19-0413-4cd1-abec-d9f140422473 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:09.495719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76216f19-0413-4cd1-abec-d9f140422473 service swift] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:09.495719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 831/1672] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:31:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:31:11.507822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f6814-08fe-4764-beb2-4409a934ade4 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:11.508357 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f6814-08fe-4764-beb2-4409a934ade4 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:11.509675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f6814-08fe-4764-beb2-4409a934ade4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:11.586467 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76216f19-0413-4cd1-abec-d9f140422473 service swift] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:11.589795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-76216f19-0413-4cd1-abec-d9f140422473 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:11.592667 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-9b9f6814-08fe-4764-beb2-4409a934ade4 None None] MFA Rules not processed for user `58ad05b9c93c48a4bf4d1f086b6d5ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:11.597230 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9b9f6814-08fe-4764-beb2-4409a934ade4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:11.647054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 842/1673] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:11 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:11.847965 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76216f19-0413-4cd1-abec-d9f140422473 service swift] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:11.856688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b9f0f-fd94-4419-a576-41e449c9bb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:11.858379 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b9f0f-fd94-4419-a576-41e449c9bb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:11.858823 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b9f0f-fd94-4419-a576-41e449c9bb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:11.859286 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b9f0f-fd94-4419-a576-41e449c9bb4b admin admin] PATH_INFO: `/v3/users/78deb70afbc34d8b8c7ea61e43f2b700` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:11.865870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b9f0f-fd94-4419-a576-41e449c9bb4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=78deb70afbc34d8b8c7ea61e43f2b700)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:11.868379 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b9f0f-fd94-4419-a576-41e449c9bb4b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:12.018406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2d6b9f0f-fd94-4419-a576-41e449c9bb4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78deb70afbc34d8b8c7ea61e43f2b700'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:12.055919 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2d6b9f0f-fd94-4419-a576-41e449c9bb4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78deb70afbc34d8b8c7ea61e43f2b700'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:12.087441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2d6b9f0f-fd94-4419-a576-41e449c9bb4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78deb70afbc34d8b8c7ea61e43f2b700'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:12.100361 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2d6b9f0f-fd94-4419-a576-41e449c9bb4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78deb70afbc34d8b8c7ea61e43f2b700'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:12.101499 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2d6b9f0f-fd94-4419-a576-41e449c9bb4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78deb70afbc34d8b8c7ea61e43f2b700'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:12.118165 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 832/1674] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:11 2021] DELETE /identity/v3/users/78deb70afbc34d8b8c7ea61e43f2b700 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:12.123551 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598941ba-57aa-449d-beff-3b778b1cb1ba None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:12.124110 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598941ba-57aa-449d-beff-3b778b1cb1ba None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:12.124586 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598941ba-57aa-449d-beff-3b778b1cb1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:12.166406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b9f0f-fd94-4419-a576-41e449c9bb4b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:12.168328 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-2d6b9f0f-fd94-4419-a576-41e449c9bb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:12.183636 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-598941ba-57aa-449d-beff-3b778b1cb1ba None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:12.190525 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-598941ba-57aa-449d-beff-3b778b1cb1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:12.441199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b9f0f-fd94-4419-a576-41e449c9bb4b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:12.459869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b66ad8-db7e-4eac-89cf-01a69f00f233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:12.460782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b66ad8-db7e-4eac-89cf-01a69f00f233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:12.463553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b66ad8-db7e-4eac-89cf-01a69f00f233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:12.463875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b66ad8-db7e-4eac-89cf-01a69f00f233 admin admin] PATH_INFO: `/v3/users/a7f721d16d434d1f8dad6ca30399078d` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:12.470468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 843/1675] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:12.470650 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b66ad8-db7e-4eac-89cf-01a69f00f233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7f721d16d434d1f8dad6ca30399078d)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:12.475109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b66ad8-db7e-4eac-89cf-01a69f00f233 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:12.525246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598941ba-57aa-449d-beff-3b778b1cb1ba None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:12.528359 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-598941ba-57aa-449d-beff-3b778b1cb1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:12.600199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-47b66ad8-db7e-4eac-89cf-01a69f00f233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7f721d16d434d1f8dad6ca30399078d'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:12.629424 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-47b66ad8-db7e-4eac-89cf-01a69f00f233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7f721d16d434d1f8dad6ca30399078d'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:12.687243 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-47b66ad8-db7e-4eac-89cf-01a69f00f233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7f721d16d434d1f8dad6ca30399078d'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:12.704140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598941ba-57aa-449d-beff-3b778b1cb1ba None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:12.727960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da38a50-3dec-4537-b8c1-801850cebb91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:12.728644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da38a50-3dec-4537-b8c1-801850cebb91 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:12.728928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da38a50-3dec-4537-b8c1-801850cebb91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:12.729208 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da38a50-3dec-4537-b8c1-801850cebb91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:12.730330 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-47b66ad8-db7e-4eac-89cf-01a69f00f233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7f721d16d434d1f8dad6ca30399078d'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:12.731285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-47b66ad8-db7e-4eac-89cf-01a69f00f233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7f721d16d434d1f8dad6ca30399078d'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:12.754079 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 833/1676] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:12 2021] DELETE /identity/v3/users/a7f721d16d434d1f8dad6ca30399078d => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:12.757265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af7390-aaf5-4a2c-9d51-5f3dd8f538a1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:12.765222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af7390-aaf5-4a2c-9d51-5f3dd8f538a1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:12.765993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af7390-aaf5-4a2c-9d51-5f3dd8f538a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:12.771174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da38a50-3dec-4537-b8c1-801850cebb91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:12.775043 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da38a50-3dec-4537-b8c1-801850cebb91 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:12.804852 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 844/1677] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:12.806483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-35af7390-aaf5-4a2c-9d51-5f3dd8f538a1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:12.808322 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-35af7390-aaf5-4a2c-9d51-5f3dd8f538a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:13.011640 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 834/1678] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:13.068084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da38a50-3dec-4537-b8c1-801850cebb91 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:13.101508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da38a50-3dec-4537-b8c1-801850cebb91 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:13.264593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9e14c-9515-40d8-b9ec-213b99826282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:13.265219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9e14c-9515-40d8-b9ec-213b99826282 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:13.265503 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9e14c-9515-40d8-b9ec-213b99826282 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:13.265895 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9e14c-9515-40d8-b9ec-213b99826282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:13.292240 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9e14c-9515-40d8-b9ec-213b99826282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:13.293528 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9e14c-9515-40d8-b9ec-213b99826282 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:13.324094 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 845/1679] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:14.381040 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722596f-2ca2-4dcf-b8d2-9b7b1325898d None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:14.381040 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722596f-2ca2-4dcf-b8d2-9b7b1325898d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:14.381496 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722596f-2ca2-4dcf-b8d2-9b7b1325898d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:14.531795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-8722596f-2ca2-4dcf-b8d2-9b7b1325898d None None] MFA Rules not processed for user `e2f51c315df74089bc6873e889cf80d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:14.533287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-8722596f-2ca2-4dcf-b8d2-9b7b1325898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:14.823490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 835/1680] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:14 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:14.824501 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9e14c-9515-40d8-b9ec-213b99826282 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:14.826645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-11c9e14c-9515-40d8-b9ec-213b99826282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:14.990289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722596f-2ca2-4dcf-b8d2-9b7b1325898d None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:14.993087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-8722596f-2ca2-4dcf-b8d2-9b7b1325898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:15.040570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9e14c-9515-40d8-b9ec-213b99826282 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:15.050543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722596f-2ca2-4dcf-b8d2-9b7b1325898d None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:15.065730 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961ed01-0d6d-4e96-864f-22aaa1f81ccd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:15.066401 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961ed01-0d6d-4e96-864f-22aaa1f81ccd service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:15.066682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961ed01-0d6d-4e96-864f-22aaa1f81ccd service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:15.067032 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961ed01-0d6d-4e96-864f-22aaa1f81ccd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:15.069780 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b562c5-0105-4fca-a78f-b44daa2263d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:15.074078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b562c5-0105-4fca-a78f-b44daa2263d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:15.077203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b562c5-0105-4fca-a78f-b44daa2263d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:15.079554 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b562c5-0105-4fca-a78f-b44daa2263d4 admin admin] PATH_INFO: `/v3/projects/f871ced7f7414d71a91412e723ea54f1` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:15.086084 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b562c5-0105-4fca-a78f-b44daa2263d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f871ced7f7414d71a91412e723ea54f1)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:15.088281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b562c5-0105-4fca-a78f-b44daa2263d4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:15.094398 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961ed01-0d6d-4e96-864f-22aaa1f81ccd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:15.096600 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961ed01-0d6d-4e96-864f-22aaa1f81ccd service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:15.121184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 846/1681] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:14 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:15.247858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-66b562c5-0105-4fca-a78f-b44daa2263d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f871ced7f7414d71a91412e723ea54f1', 'request_id': 'req-66b562c5-0105-4fca-a78f-b44daa2263d4'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:15.262531 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-66b562c5-0105-4fca-a78f-b44daa2263d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f871ced7f7414d71a91412e723ea54f1', 'request_id': 'req-66b562c5-0105-4fca-a78f-b44daa2263d4'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:15.289877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-66b562c5-0105-4fca-a78f-b44daa2263d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f871ced7f7414d71a91412e723ea54f1', 'request_id': 'req-66b562c5-0105-4fca-a78f-b44daa2263d4'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:15.301641 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961ed01-0d6d-4e96-864f-22aaa1f81ccd service nova] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:15.304033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8961ed01-0d6d-4e96-864f-22aaa1f81ccd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:15.334759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-66b562c5-0105-4fca-a78f-b44daa2263d4 admin admin] The token cache is being invalidate because project f871ced7f7414d71a91412e723ea54f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:15.335075 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-66b562c5-0105-4fca-a78f-b44daa2263d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:15.337483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-66b562c5-0105-4fca-a78f-b44daa2263d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:15.359614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961ed01-0d6d-4e96-864f-22aaa1f81ccd service nova] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:15.363868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 836/1682] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:14 2021] DELETE /identity/v3/projects/f871ced7f7414d71a91412e723ea54f1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:15.369526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b596ef-6560-4fdb-a90f-edf2cb163ee5 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:15.369840 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b596ef-6560-4fdb-a90f-edf2cb163ee5 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:15.370593 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b596ef-6560-4fdb-a90f-edf2cb163ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:15.460316 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-13b596ef-6560-4fdb-a90f-edf2cb163ee5 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:15.461585 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-13b596ef-6560-4fdb-a90f-edf2cb163ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:15.570427 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:15.571718 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:15.572161 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:15.572590 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] PATH_INFO: `/v3/projects/24789e0592dc44ba9017a685b3f39466` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:15.589995 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24789e0592dc44ba9017a685b3f39466)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:15.603388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:15.700483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 837/1683] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:15.708861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fd51c-0477-4ed3-9b6c-de7e833032bd None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:15.709157 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fd51c-0477-4ed3-9b6c-de7e833032bd None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:15.709445 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fd51c-0477-4ed3-9b6c-de7e833032bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:15.776848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a35fd51c-0477-4ed3-9b6c-de7e833032bd None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:15.780559 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a35fd51c-0477-4ed3-9b6c-de7e833032bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:15.793532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24789e0592dc44ba9017a685b3f39466', 'request_id': 'req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:15.823690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24789e0592dc44ba9017a685b3f39466', 'request_id': 'req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:15.844516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24789e0592dc44ba9017a685b3f39466', 'request_id': 'req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:15.897112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] The token cache is being invalidate because project 24789e0592dc44ba9017a685b3f39466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:15.898719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:15.899968 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:15.907170 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 847/1684] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:15 2021] DELETE /identity/v3/projects/24789e0592dc44ba9017a685b3f39466 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:15.910820 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:15.914541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:16.054421 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 838/1685] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:16.060632 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fd51c-0477-4ed3-9b6c-de7e833032bd None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:16.092960 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fd51c-0477-4ed3-9b6c-de7e833032bd None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:16.108152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1e5f2-5cf1-4326-afd0-1b9748abd939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:16.109441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1e5f2-5cf1-4326-afd0-1b9748abd939 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:16.111320 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1e5f2-5cf1-4326-afd0-1b9748abd939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:16.111777 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1e5f2-5cf1-4326-afd0-1b9748abd939 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:16.113519 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1e5f2-5cf1-4326-afd0-1b9748abd939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:16.114560 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1e5f2-5cf1-4326-afd0-1b9748abd939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:16.116933 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1e5f2-5cf1-4326-afd0-1b9748abd939 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:16.154920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ccbc-faaf-4b4a-86f8-fd6f8275e3c2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:16.157433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 839/1686] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:31:16.161962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762e7ac-f78d-42da-8bcf-fd85842ca37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:16.163151 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1e5f2-5cf1-4326-afd0-1b9748abd939 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:16.163282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e7ac-f78d-42da-8bcf-fd85842ca37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:16.163632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e7ac-f78d-42da-8bcf-fd85842ca37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:16.163921 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e7ac-f78d-42da-8bcf-fd85842ca37a admin admin] PATH_INFO: `/v3/users/1f9f82fd3ff6448da83582e85558098e` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:16.165422 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762e7ac-f78d-42da-8bcf-fd85842ca37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9f82fd3ff6448da83582e85558098e)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:16.168174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762e7ac-f78d-42da-8bcf-fd85842ca37a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:16.203181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1e5f2-5cf1-4326-afd0-1b9748abd939 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:16.237536 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c65b47-6422-4033-a06e-7009be9f0977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:16.238554 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65b47-6422-4033-a06e-7009be9f0977 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:16.239087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65b47-6422-4033-a06e-7009be9f0977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:16.239663 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65b47-6422-4033-a06e-7009be9f0977 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:16.240742 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c65b47-6422-4033-a06e-7009be9f0977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:16.246975 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c65b47-6422-4033-a06e-7009be9f0977 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:16.262458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4762e7ac-f78d-42da-8bcf-fd85842ca37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9f82fd3ff6448da83582e85558098e'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:16.289474 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4762e7ac-f78d-42da-8bcf-fd85842ca37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9f82fd3ff6448da83582e85558098e'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:16.298833 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4762e7ac-f78d-42da-8bcf-fd85842ca37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9f82fd3ff6448da83582e85558098e'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:16.310763 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4762e7ac-f78d-42da-8bcf-fd85842ca37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9f82fd3ff6448da83582e85558098e'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:16.312296 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4762e7ac-f78d-42da-8bcf-fd85842ca37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9f82fd3ff6448da83582e85558098e'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:16.322633 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 848/1687] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:15 2021] DELETE /identity/v3/users/1f9f82fd3ff6448da83582e85558098e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:16.381616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 840/1688] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:16 2021] POST /identity/v3/projects => generated 365 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:16.382570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762e7ac-f78d-42da-8bcf-fd85842ca37a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:16.388450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-4762e7ac-f78d-42da-8bcf-fd85842ca37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:16.726801 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762e7ac-f78d-42da-8bcf-fd85842ca37a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:16.760790 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf591d7-8b80-4080-bbe1-35277e702dae None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:16.761362 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf591d7-8b80-4080-bbe1-35277e702dae None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:16.761618 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf591d7-8b80-4080-bbe1-35277e702dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:16.843418 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-acf591d7-8b80-4080-bbe1-35277e702dae None None] MFA Rules not processed for user `c9a44a13e31941b5af9579d8bec345ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:16.844703 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-acf591d7-8b80-4080-bbe1-35277e702dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:16.980391 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63974c91-1b64-4b4e-be03-3a377bbadf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:16.982026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63974c91-1b64-4b4e-be03-3a377bbadf6e admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:16.982666 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63974c91-1b64-4b4e-be03-3a377bbadf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:16.983095 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63974c91-1b64-4b4e-be03-3a377bbadf6e admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:16.987163 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63974c91-1b64-4b4e-be03-3a377bbadf6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:16.990745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63974c91-1b64-4b4e-be03-3a377bbadf6e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:17.053125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 849/1689] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:16 2021] POST /identity/v3/users => generated 283 bytes in 671 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:17.054250 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63974c91-1b64-4b4e-be03-3a377bbadf6e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:17.061201 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-63974c91-1b64-4b4e-be03-3a377bbadf6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:17.095397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63974c91-1b64-4b4e-be03-3a377bbadf6e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:17.102205 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 841/1690] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Dec 15 13:31:16 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:17.121149 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf591d7-8b80-4080-bbe1-35277e702dae None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:17.130799 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc24214-ff15-4165-ba4a-b46e89f88c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:17.132043 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc24214-ff15-4165-ba4a-b46e89f88c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:17.132545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc24214-ff15-4165-ba4a-b46e89f88c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:17.133037 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc24214-ff15-4165-ba4a-b46e89f88c12 admin admin] PATH_INFO: `/v3/users/35c998cec2744ee1aa309dd31c6b8b57` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:17.135968 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc24214-ff15-4165-ba4a-b46e89f88c12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c998cec2744ee1aa309dd31c6b8b57)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:17.144025 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc24214-ff15-4165-ba4a-b46e89f88c12 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:17.169190 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf591d7-8b80-4080-bbe1-35277e702dae None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:17.211540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f83d76-dd60-462a-8038-9761703bfe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:17.212448 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f83d76-dd60-462a-8038-9761703bfe89 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:17.213460 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f83d76-dd60-462a-8038-9761703bfe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:17.214712 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f83d76-dd60-462a-8038-9761703bfe89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:17.217740 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f83d76-dd60-462a-8038-9761703bfe89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:17.223870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f83d76-dd60-462a-8038-9761703bfe89 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:17.264760 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 842/1691] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:17 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:17.275272 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f83d76-dd60-462a-8038-9761703bfe89 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:17.279553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-dfc24214-ff15-4165-ba4a-b46e89f88c12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c998cec2744ee1aa309dd31c6b8b57'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:17.310083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f83d76-dd60-462a-8038-9761703bfe89 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:17.319557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-dfc24214-ff15-4165-ba4a-b46e89f88c12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c998cec2744ee1aa309dd31c6b8b57'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:17.326326 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd6bb6-f99e-4f0d-be76-7967edbc4c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:17.327072 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd6bb6-f99e-4f0d-be76-7967edbc4c6e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:17.337744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd6bb6-f99e-4f0d-be76-7967edbc4c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:17.337962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd6bb6-f99e-4f0d-be76-7967edbc4c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:17.343451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd6bb6-f99e-4f0d-be76-7967edbc4c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:17.350549 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd6bb6-f99e-4f0d-be76-7967edbc4c6e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:17.352640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-dfc24214-ff15-4165-ba4a-b46e89f88c12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c998cec2744ee1aa309dd31c6b8b57'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:17.400034 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-dfc24214-ff15-4165-ba4a-b46e89f88c12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c998cec2744ee1aa309dd31c6b8b57'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:17.400034 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-dfc24214-ff15-4165-ba4a-b46e89f88c12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c998cec2744ee1aa309dd31c6b8b57'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:17.403481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 843/1692] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:17 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:17.406197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd6bb6-f99e-4f0d-be76-7967edbc4c6e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:17.416588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 850/1693] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:17 2021] DELETE /identity/v3/users/35c998cec2744ee1aa309dd31c6b8b57 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:17.418923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc24214-ff15-4165-ba4a-b46e89f88c12 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:17.423776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-dfc24214-ff15-4165-ba4a-b46e89f88c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:17.427696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b8cd6bb6-f99e-4f0d-be76-7967edbc4c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:17.461068 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd6bb6-f99e-4f0d-be76-7967edbc4c6e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:17.571761 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534598-a3da-42ba-8c4a-1f9c2597aef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:17.572542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534598-a3da-42ba-8c4a-1f9c2597aef1 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:17.573307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534598-a3da-42ba-8c4a-1f9c2597aef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:17.574257 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534598-a3da-42ba-8c4a-1f9c2597aef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:17.580288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-83534598-a3da-42ba-8c4a-1f9c2597aef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:17.609851 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83534598-a3da-42ba-8c4a-1f9c2597aef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:17.612332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83534598-a3da-42ba-8c4a-1f9c2597aef1 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:17.618536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc24214-ff15-4165-ba4a-b46e89f88c12 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:17.638022 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a52a23-9758-41b9-b713-ca365588411d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:17.639063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a52a23-9758-41b9-b713-ca365588411d service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:17.640050 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a52a23-9758-41b9-b713-ca365588411d service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:17.640530 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a52a23-9758-41b9-b713-ca365588411d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:17.645481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 844/1694] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:17 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:17.647331 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534598-a3da-42ba-8c4a-1f9c2597aef1 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:17.650572 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-83534598-a3da-42ba-8c4a-1f9c2597aef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:17.672352 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a52a23-9758-41b9-b713-ca365588411d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:17.673989 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a52a23-9758-41b9-b713-ca365588411d service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:17.712135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 851/1695] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:17 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:17.718644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d9eba-e188-412d-83cd-50b3fcb19df4 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:17.719128 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d9eba-e188-412d-83cd-50b3fcb19df4 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:17.719494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d9eba-e188-412d-83cd-50b3fcb19df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:17.792449 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-4e6d9eba-e188-412d-83cd-50b3fcb19df4 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:17.800917 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-4e6d9eba-e188-412d-83cd-50b3fcb19df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:17.923418 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534598-a3da-42ba-8c4a-1f9c2597aef1 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:17.935924 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2a125-42cd-44bd-8fcd-41b4152d77e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:17.938347 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a125-42cd-44bd-8fcd-41b4152d77e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:17.939505 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a125-42cd-44bd-8fcd-41b4152d77e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:17.940272 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a125-42cd-44bd-8fcd-41b4152d77e9 admin admin] PATH_INFO: `/v3/projects/4a824af5676f4923a681dd81d2757134/users/ad2d4b5b66ce418aa4f4495820e57d80/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:17.980481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2a125-42cd-44bd-8fcd-41b4152d77e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a824af5676f4923a681dd81d2757134, user_id=ad2d4b5b66ce418aa4f4495820e57d80, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:17.986402 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2a125-42cd-44bd-8fcd-41b4152d77e9 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:17.992130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 852/1696] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:18.028284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 845/1697] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:17 2021] PUT /identity/v3/projects/4a824af5676f4923a681dd81d2757134/users/ad2d4b5b66ce418aa4f4495820e57d80/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:18.050953 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d9eba-e188-412d-83cd-50b3fcb19df4 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:18.068130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d9eba-e188-412d-83cd-50b3fcb19df4 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:18.092445 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383d6de-2c50-4f44-bb7f-79cb3b2441d4 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:18.092836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383d6de-2c50-4f44-bb7f-79cb3b2441d4 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:18.093178 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383d6de-2c50-4f44-bb7f-79cb3b2441d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:18.191746 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e383d6de-2c50-4f44-bb7f-79cb3b2441d4 None None] MFA Rules not processed for user `ad2d4b5b66ce418aa4f4495820e57d80`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:18.195282 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e383d6de-2c50-4f44-bb7f-79cb3b2441d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:18.255268 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3f7a2-26fa-4a7a-9c14-05c8231af93a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:18.256086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3f7a2-26fa-4a7a-9c14-05c8231af93a service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:18.256286 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3f7a2-26fa-4a7a-9c14-05c8231af93a service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:18.256566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3f7a2-26fa-4a7a-9c14-05c8231af93a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:18.329848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 846/1698] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:18 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:18.333971 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383d6de-2c50-4f44-bb7f-79cb3b2441d4 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:18.396545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3f7a2-26fa-4a7a-9c14-05c8231af93a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:18.399484 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3f7a2-26fa-4a7a-9c14-05c8231af93a service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:18.416568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 853/1699] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:18.554450 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383d6de-2c50-4f44-bb7f-79cb3b2441d4 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:18.566765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd39fc5-507f-4399-a266-878584e4ee21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:18.569116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd39fc5-507f-4399-a266-878584e4ee21 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:18.569399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd39fc5-507f-4399-a266-878584e4ee21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:18.569684 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd39fc5-507f-4399-a266-878584e4ee21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:18.571909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd39fc5-507f-4399-a266-878584e4ee21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:18.580677 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd39fc5-507f-4399-a266-878584e4ee21 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:18.653882 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 847/1700] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:18 2021] POST /identity/v3/projects => generated 365 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:18.658109 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3f7a2-26fa-4a7a-9c14-05c8231af93a service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:18.669770 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3f7a2-26fa-4a7a-9c14-05c8231af93a service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:18.824032 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160e96a-5075-4c84-98c7-6b2e624e3439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:18.824956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160e96a-5075-4c84-98c7-6b2e624e3439 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:18.825301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160e96a-5075-4c84-98c7-6b2e624e3439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:18.825645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160e96a-5075-4c84-98c7-6b2e624e3439 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:18.826425 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160e96a-5075-4c84-98c7-6b2e624e3439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:18.832450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160e96a-5075-4c84-98c7-6b2e624e3439 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:18.876225 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 854/1701] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:18 2021] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:18.879981 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd39fc5-507f-4399-a266-878584e4ee21 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:18.909185 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd39fc5-507f-4399-a266-878584e4ee21 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:18.922538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a822a-40c2-4bb8-b7a7-91143fbda259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:18.924850 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a822a-40c2-4bb8-b7a7-91143fbda259 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:18.926093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a822a-40c2-4bb8-b7a7-91143fbda259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:18.927116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a822a-40c2-4bb8-b7a7-91143fbda259 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:18.930938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a822a-40c2-4bb8-b7a7-91143fbda259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:18.935417 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a822a-40c2-4bb8-b7a7-91143fbda259 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:18.964008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 848/1702] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:18 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:31:18.968263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160e96a-5075-4c84-98c7-6b2e624e3439 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:18.981021 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160e96a-5075-4c84-98c7-6b2e624e3439 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:18.989348 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580f83a-408b-4210-87d3-5df21c96f007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:18.993108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580f83a-408b-4210-87d3-5df21c96f007 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:18.994251 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580f83a-408b-4210-87d3-5df21c96f007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:18.994689 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580f83a-408b-4210-87d3-5df21c96f007 admin admin] PATH_INFO: `/v3/projects/a33cdf9013d440b2af0eb5670c1ea64e/users/84cb54276e55470c88a0625b4d950585/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:19.032957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580f83a-408b-4210-87d3-5df21c96f007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33cdf9013d440b2af0eb5670c1ea64e, user_id=84cb54276e55470c88a0625b4d950585, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:19.035969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580f83a-408b-4210-87d3-5df21c96f007 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:19.075390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 855/1703] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:18 2021] PUT /identity/v3/projects/a33cdf9013d440b2af0eb5670c1ea64e/users/84cb54276e55470c88a0625b4d950585/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:19.081281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a822a-40c2-4bb8-b7a7-91143fbda259 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:19.102725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a822a-40c2-4bb8-b7a7-91143fbda259 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:19.296880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6061e4-cedf-46da-ad9b-f8bbd0f9719b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:19.297572 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6061e4-cedf-46da-ad9b-f8bbd0f9719b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:19.297901 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6061e4-cedf-46da-ad9b-f8bbd0f9719b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:19.298138 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6061e4-cedf-46da-ad9b-f8bbd0f9719b admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:19.298931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6061e4-cedf-46da-ad9b-f8bbd0f9719b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:19.300557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6061e4-cedf-46da-ad9b-f8bbd0f9719b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:19.339095 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 849/1704] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:19 2021] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:19.341075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580f83a-408b-4210-87d3-5df21c96f007 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:19.354555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580f83a-408b-4210-87d3-5df21c96f007 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:19.374125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959679b5-dbc4-496b-9585-5715990e1485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:19.375488 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959679b5-dbc4-496b-9585-5715990e1485 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:19.375815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959679b5-dbc4-496b-9585-5715990e1485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:19.376048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959679b5-dbc4-496b-9585-5715990e1485 admin admin] PATH_INFO: `/v3/projects/a33cdf9013d440b2af0eb5670c1ea64e/users/84cb54276e55470c88a0625b4d950585/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:19.379790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959679b5-dbc4-496b-9585-5715990e1485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33cdf9013d440b2af0eb5670c1ea64e, user_id=84cb54276e55470c88a0625b4d950585, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:19.388761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959679b5-dbc4-496b-9585-5715990e1485 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:19.418279 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 856/1705] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:19 2021] PUT /identity/v3/projects/a33cdf9013d440b2af0eb5670c1ea64e/users/84cb54276e55470c88a0625b4d950585/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:19.431659 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a12ce-e272-4891-9e2b-6f4391ca4789 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:19.431960 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a12ce-e272-4891-9e2b-6f4391ca4789 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:19.432238 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a12ce-e272-4891-9e2b-6f4391ca4789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:19.507002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a44a12ce-e272-4891-9e2b-6f4391ca4789 None None] MFA Rules not processed for user `84cb54276e55470c88a0625b4d950585`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:19.508258 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a44a12ce-e272-4891-9e2b-6f4391ca4789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:19.659587 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 850/1706] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:19 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:19.668844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959679b5-dbc4-496b-9585-5715990e1485 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:19.675145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-959679b5-dbc4-496b-9585-5715990e1485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:19.780031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959679b5-dbc4-496b-9585-5715990e1485 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:19.786751 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a7b63-3054-4622-9b0f-84d6e89f18bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:19.788499 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a7b63-3054-4622-9b0f-84d6e89f18bd service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:19.789042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a7b63-3054-4622-9b0f-84d6e89f18bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:19.789689 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a7b63-3054-4622-9b0f-84d6e89f18bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:19.805486 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a7b63-3054-4622-9b0f-84d6e89f18bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:19.810522 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a7b63-3054-4622-9b0f-84d6e89f18bd service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:19.825554 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 857/1707] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:19 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:19.992266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a12ce-e272-4891-9e2b-6f4391ca4789 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:20.008203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a12ce-e272-4891-9e2b-6f4391ca4789 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:20.026616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e9672-0445-46b2-8243-35d5c7ae6d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:20.027468 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e9672-0445-46b2-8243-35d5c7ae6d9c service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:20.027600 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e9672-0445-46b2-8243-35d5c7ae6d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:20.029488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e9672-0445-46b2-8243-35d5c7ae6d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:20.071501 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a7b63-3054-4622-9b0f-84d6e89f18bd service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:20.081224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a12a7b63-3054-4622-9b0f-84d6e89f18bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:20.195113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e9672-0445-46b2-8243-35d5c7ae6d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:20.196608 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e9672-0445-46b2-8243-35d5c7ae6d9c service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:20.239428 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 851/1708] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:19 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:20.264030 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a7b63-3054-4622-9b0f-84d6e89f18bd service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:20.278957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf765e-e41b-44e6-ac74-f70634254594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:20.279844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf765e-e41b-44e6-ac74-f70634254594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:20.280127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf765e-e41b-44e6-ac74-f70634254594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:20.280439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf765e-e41b-44e6-ac74-f70634254594 admin admin] PATH_INFO: `/v3/projects/d2ce03c44ace47caac05adb32973d0c1` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:20.281684 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf765e-e41b-44e6-ac74-f70634254594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ce03c44ace47caac05adb32973d0c1)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:20.284870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf765e-e41b-44e6-ac74-f70634254594 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:20.395974 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f0cf765e-e41b-44e6-ac74-f70634254594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ce03c44ace47caac05adb32973d0c1', 'request_id': 'req-f0cf765e-e41b-44e6-ac74-f70634254594'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:20.413166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f0cf765e-e41b-44e6-ac74-f70634254594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ce03c44ace47caac05adb32973d0c1', 'request_id': 'req-f0cf765e-e41b-44e6-ac74-f70634254594'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:20.423496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f0cf765e-e41b-44e6-ac74-f70634254594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ce03c44ace47caac05adb32973d0c1', 'request_id': 'req-f0cf765e-e41b-44e6-ac74-f70634254594'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:20.478399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f0cf765e-e41b-44e6-ac74-f70634254594 admin admin] The token cache is being invalidate because project d2ce03c44ace47caac05adb32973d0c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:20.483668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f0cf765e-e41b-44e6-ac74-f70634254594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:20.487868 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f0cf765e-e41b-44e6-ac74-f70634254594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:20.495917 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 858/1709] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:20 2021] DELETE /identity/v3/projects/d2ce03c44ace47caac05adb32973d0c1 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:20.504177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de59bd-9ce0-4a6a-b093-753adc6d5194 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:20.504475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de59bd-9ce0-4a6a-b093-753adc6d5194 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:20.504818 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de59bd-9ce0-4a6a-b093-753adc6d5194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:20.553145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-79de59bd-9ce0-4a6a-b093-753adc6d5194 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:20.554576 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-79de59bd-9ce0-4a6a-b093-753adc6d5194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:20.625647 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cf7bc-920e-44e0-819a-eec6df060fd0 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:20.626002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cf7bc-920e-44e0-819a-eec6df060fd0 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:20.626288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cf7bc-920e-44e0-819a-eec6df060fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:20.741671 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-412cf7bc-920e-44e0-819a-eec6df060fd0 None None] MFA Rules not processed for user `a53d77fd836e4abda2cb59d5ed6c370e`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:20.748629 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-412cf7bc-920e-44e0-819a-eec6df060fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:20.839105 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 852/1710] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:20.846653 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0a6de-0885-46de-a4bc-5a0a0d88cd30 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:20.847063 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0a6de-0885-46de-a4bc-5a0a0d88cd30 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:20.847355 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0a6de-0885-46de-a4bc-5a0a0d88cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:20.885565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-dcb0a6de-0885-46de-a4bc-5a0a0d88cd30 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:20.893451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-dcb0a6de-0885-46de-a4bc-5a0a0d88cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:20.909907 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 853/1711] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:20.913746 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0a6de-0885-46de-a4bc-5a0a0d88cd30 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:20.935777 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0a6de-0885-46de-a4bc-5a0a0d88cd30 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:20.952605 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b7bb2-4de0-48a3-a7b3-0ca7931ecda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:20.953352 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b7bb2-4de0-48a3-a7b3-0ca7931ecda8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:20.954027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b7bb2-4de0-48a3-a7b3-0ca7931ecda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:20.954318 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b7bb2-4de0-48a3-a7b3-0ca7931ecda8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:20.955181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b7bb2-4de0-48a3-a7b3-0ca7931ecda8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:20.955547 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b7bb2-4de0-48a3-a7b3-0ca7931ecda8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:20.957686 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b7bb2-4de0-48a3-a7b3-0ca7931ecda8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:20.997259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 854/1712] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:31:21.000753 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b7bb2-4de0-48a3-a7b3-0ca7931ecda8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:21.003433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 859/1713] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:20 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:21.006318 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525a957-fe90-4d9b-9b2b-c69e70ea748b None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:21.007928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525a957-fe90-4d9b-9b2b-c69e70ea748b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:21.008396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525a957-fe90-4d9b-9b2b-c69e70ea748b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:21.027896 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b7bb2-4de0-48a3-a7b3-0ca7931ecda8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:21.053062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-e525a957-fe90-4d9b-9b2b-c69e70ea748b None None] MFA Rules not processed for user `a53d77fd836e4abda2cb59d5ed6c370e`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:21.053401 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebde527-7439-44ac-b399-3acdc23823c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:21.054235 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde527-7439-44ac-b399-3acdc23823c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:21.054924 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde527-7439-44ac-b399-3acdc23823c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:21.055301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde527-7439-44ac-b399-3acdc23823c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:21.056281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e525a957-fe90-4d9b-9b2b-c69e70ea748b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:21.056696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebde527-7439-44ac-b399-3acdc23823c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:21.062000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebde527-7439-44ac-b399-3acdc23823c5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:21.077482 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 860/1714] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:21 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:21.144262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 855/1715] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:20 2021] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:21.146023 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525a957-fe90-4d9b-9b2b-c69e70ea748b None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:21.147784 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e525a957-fe90-4d9b-9b2b-c69e70ea748b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:21.154354 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebde527-7439-44ac-b399-3acdc23823c5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:21.362290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525a957-fe90-4d9b-9b2b-c69e70ea748b None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:21.366441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebde527-7439-44ac-b399-3acdc23823c5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:21.381751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65a4ad-47c4-4bd5-ab19-ba8920931661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:21.382547 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65a4ad-47c4-4bd5-ab19-ba8920931661 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:21.383810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65a4ad-47c4-4bd5-ab19-ba8920931661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:21.384434 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65a4ad-47c4-4bd5-ab19-ba8920931661 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:21.386973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65a4ad-47c4-4bd5-ab19-ba8920931661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:21.395422 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65a4ad-47c4-4bd5-ab19-ba8920931661 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:21.454615 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 856/1716] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:21 2021] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:21.455868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65a4ad-47c4-4bd5-ab19-ba8920931661 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:21.492411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65a4ad-47c4-4bd5-ab19-ba8920931661 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:21.509073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e739f-8795-43ac-82c2-1f38d044ae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:21.513063 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e739f-8795-43ac-82c2-1f38d044ae53 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:21.515624 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e739f-8795-43ac-82c2-1f38d044ae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:21.516517 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e739f-8795-43ac-82c2-1f38d044ae53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:21.519032 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e739f-8795-43ac-82c2-1f38d044ae53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:21.521880 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab68d46-2664-4948-b452-25e31488918d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:21.522555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68d46-2664-4948-b452-25e31488918d service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:21.522838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68d46-2664-4948-b452-25e31488918d service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:21.523994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68d46-2664-4948-b452-25e31488918d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:21.525625 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e739f-8795-43ac-82c2-1f38d044ae53 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:21.553506 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 857/1717] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:21 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:31:21.558153 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e739f-8795-43ac-82c2-1f38d044ae53 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:21.581244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e739f-8795-43ac-82c2-1f38d044ae53 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:21.593031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6daea-4a7e-4c3a-9f01-4d02a452e9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:21.593866 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6daea-4a7e-4c3a-9f01-4d02a452e9ae admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:21.594237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6daea-4a7e-4c3a-9f01-4d02a452e9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:21.594576 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6daea-4a7e-4c3a-9f01-4d02a452e9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:21.595505 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6daea-4a7e-4c3a-9f01-4d02a452e9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:21.597431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6daea-4a7e-4c3a-9f01-4d02a452e9ae admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:21.626504 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 858/1718] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:21 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:31:21.630071 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6daea-4a7e-4c3a-9f01-4d02a452e9ae admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:21.652427 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6daea-4a7e-4c3a-9f01-4d02a452e9ae admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:21.674363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b982407-0a1d-46f0-a134-da39fb119e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:21.676757 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b982407-0a1d-46f0-a134-da39fb119e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:21.677116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b982407-0a1d-46f0-a134-da39fb119e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:21.677469 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b982407-0a1d-46f0-a134-da39fb119e9b admin admin] PATH_INFO: `/v3/projects/0abfa177d9a844588ad57a7d55d7ca4c/users/da39e854ef7745d09325807e8ca34a79/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:21.728704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b982407-0a1d-46f0-a134-da39fb119e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abfa177d9a844588ad57a7d55d7ca4c, user_id=da39e854ef7745d09325807e8ca34a79, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:21.732068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab68d46-2664-4948-b452-25e31488918d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:21.734238 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab68d46-2664-4948-b452-25e31488918d service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:21.737229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b982407-0a1d-46f0-a134-da39fb119e9b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:21.768045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 861/1719] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:21 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:21.787436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 859/1720] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:21 2021] PUT /identity/v3/projects/0abfa177d9a844588ad57a7d55d7ca4c/users/da39e854ef7745d09325807e8ca34a79/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:21.810593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb40c1d-17fd-470a-9f3f-351f72711d2f None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:21.810912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb40c1d-17fd-470a-9f3f-351f72711d2f None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:21.811252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb40c1d-17fd-470a-9f3f-351f72711d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:21.912045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-2eb40c1d-17fd-470a-9f3f-351f72711d2f None None] MFA Rules not processed for user `da39e854ef7745d09325807e8ca34a79`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:21.913304 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2eb40c1d-17fd-470a-9f3f-351f72711d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:22.071671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b982407-0a1d-46f0-a134-da39fb119e9b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:22.083606 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 862/1721] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:21 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:22.198706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b982407-0a1d-46f0-a134-da39fb119e9b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:22.205368 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80875e37-0ba0-4c4f-b21f-730dab811ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:22.206143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80875e37-0ba0-4c4f-b21f-730dab811ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:22.206428 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80875e37-0ba0-4c4f-b21f-730dab811ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:22.206711 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80875e37-0ba0-4c4f-b21f-730dab811ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:22.207554 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80875e37-0ba0-4c4f-b21f-730dab811ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:22.210401 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80875e37-0ba0-4c4f-b21f-730dab811ff2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:22.271821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb40c1d-17fd-470a-9f3f-351f72711d2f None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:22.284865 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 860/1722] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:22 2021] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:22.290180 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb40c1d-17fd-470a-9f3f-351f72711d2f None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:22.320069 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80875e37-0ba0-4c4f-b21f-730dab811ff2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:22.321993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-80875e37-0ba0-4c4f-b21f-730dab811ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:22.477314 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5e22c-0296-4c09-916b-4212e6644cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:22.479490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5e22c-0296-4c09-916b-4212e6644cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:22.479779 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5e22c-0296-4c09-916b-4212e6644cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:22.480060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5e22c-0296-4c09-916b-4212e6644cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:22.480955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5e22c-0296-4c09-916b-4212e6644cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:22.483009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5e22c-0296-4c09-916b-4212e6644cb8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:22.526731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80875e37-0ba0-4c4f-b21f-730dab811ff2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:22.581408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 863/1723] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:22 2021] POST /identity/v3/users => generated 299 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:22.591718 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bf7b9-1326-4225-9a75-33a5b20cc889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:22.594819 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5e22c-0296-4c09-916b-4212e6644cb8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:22.603160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf7b9-1326-4225-9a75-33a5b20cc889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:22.603437 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf7b9-1326-4225-9a75-33a5b20cc889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:22.603847 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf7b9-1326-4225-9a75-33a5b20cc889 admin admin] PATH_INFO: `/v3/projects/4e7a9d4667274ac18c39ea5371d04ae2` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:22.611241 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bf7b9-1326-4225-9a75-33a5b20cc889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7a9d4667274ac18c39ea5371d04ae2)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:22.613323 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bf7b9-1326-4225-9a75-33a5b20cc889 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:22.629821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5e22c-0296-4c09-916b-4212e6644cb8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:22.644669 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117cc01-200e-420d-836f-d837b6143f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:22.645329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117cc01-200e-420d-836f-d837b6143f46 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:22.645687 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117cc01-200e-420d-836f-d837b6143f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:22.646195 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117cc01-200e-420d-836f-d837b6143f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:22.649952 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117cc01-200e-420d-836f-d837b6143f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:22.651863 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117cc01-200e-420d-836f-d837b6143f46 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:22.692930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 864/1724] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:22 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:22.694300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117cc01-200e-420d-836f-d837b6143f46 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:22.721970 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117cc01-200e-420d-836f-d837b6143f46 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:22.740361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3ecce-ed32-47ab-b133-03e6f2dca1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:22.741734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3ecce-ed32-47ab-b133-03e6f2dca1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:22.742354 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3ecce-ed32-47ab-b133-03e6f2dca1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:22.742914 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3ecce-ed32-47ab-b133-03e6f2dca1aa admin admin] PATH_INFO: `/v3/projects/2d88eb8447f14bf29b65f6fcd21bf4c9/users/0553ed6638c84b558f4bd55e3b331c51/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:22.802233 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3ecce-ed32-47ab-b133-03e6f2dca1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d88eb8447f14bf29b65f6fcd21bf4c9, user_id=0553ed6638c84b558f4bd55e3b331c51, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:22.805405 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3ecce-ed32-47ab-b133-03e6f2dca1aa admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:22.834746 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fa4bf7b9-1326-4225-9a75-33a5b20cc889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7a9d4667274ac18c39ea5371d04ae2', 'request_id': 'req-fa4bf7b9-1326-4225-9a75-33a5b20cc889'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:22.846028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fa4bf7b9-1326-4225-9a75-33a5b20cc889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7a9d4667274ac18c39ea5371d04ae2', 'request_id': 'req-fa4bf7b9-1326-4225-9a75-33a5b20cc889'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:22.854067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fa4bf7b9-1326-4225-9a75-33a5b20cc889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7a9d4667274ac18c39ea5371d04ae2', 'request_id': 'req-fa4bf7b9-1326-4225-9a75-33a5b20cc889'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:22.854363 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 865/1725] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:22 2021] PUT /identity/v3/projects/2d88eb8447f14bf29b65f6fcd21bf4c9/users/0553ed6638c84b558f4bd55e3b331c51/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:22.860534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3ecce-ed32-47ab-b133-03e6f2dca1aa admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:22.881044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fa4bf7b9-1326-4225-9a75-33a5b20cc889 admin admin] The token cache is being invalidate because project 4e7a9d4667274ac18c39ea5371d04ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:22.881340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fa4bf7b9-1326-4225-9a75-33a5b20cc889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:22.882733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fa4bf7b9-1326-4225-9a75-33a5b20cc889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:22.884892 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 861/1726] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:22 2021] DELETE /identity/v3/projects/4e7a9d4667274ac18c39ea5371d04ae2 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:22.891056 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383946f0-783d-4b3c-a30d-4decd613ee54 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:22.891351 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383946f0-783d-4b3c-a30d-4decd613ee54 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:22.891637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383946f0-783d-4b3c-a30d-4decd613ee54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:22.955434 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-383946f0-783d-4b3c-a30d-4decd613ee54 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:22.956900 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-383946f0-783d-4b3c-a30d-4decd613ee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:23.071674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3ecce-ed32-47ab-b133-03e6f2dca1aa admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:23.088857 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4299ef-71c1-42b4-8f02-c2023d1c1a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:23.089796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4299ef-71c1-42b4-8f02-c2023d1c1a2c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.090181 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4299ef-71c1-42b4-8f02-c2023d1c1a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.090600 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4299ef-71c1-42b4-8f02-c2023d1c1a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.091572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4299ef-71c1-42b4-8f02-c2023d1c1a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:23.094116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4299ef-71c1-42b4-8f02-c2023d1c1a2c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:23.120966 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 862/1727] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:23.122555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a8874-6a59-449f-b1d8-700f85ea2e55 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.122858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a8874-6a59-449f-b1d8-700f85ea2e55 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.123162 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a8874-6a59-449f-b1d8-700f85ea2e55 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.132644 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 863/1728] 10.222.0.60 () {54 vars in 921 bytes} [Wed Dec 15 13:31:23 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:23.134262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc42e9-9c83-463d-b413-28e2f3b9615f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.134549 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc42e9-9c83-463d-b413-28e2f3b9615f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.134950 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 866/1729] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:22 2021] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:23.138014 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc42e9-9c83-463d-b413-28e2f3b9615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.138997 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4299ef-71c1-42b4-8f02-c2023d1c1a2c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:23.141760 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-6b4299ef-71c1-42b4-8f02-c2023d1c1a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:23.165573 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4299ef-71c1-42b4-8f02-c2023d1c1a2c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:23.190014 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a7bc42e9-9c83-463d-b413-28e2f3b9615f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:23.190014 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a7bc42e9-9c83-463d-b413-28e2f3b9615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:23.192733 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e5c3f-719c-425e-82c5-bcde76fc9996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:23.194196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e5c3f-719c-425e-82c5-bcde76fc9996 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.194402 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e5c3f-719c-425e-82c5-bcde76fc9996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.194823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e5c3f-719c-425e-82c5-bcde76fc9996 admin admin] PATH_INFO: `/v3/projects/2d88eb8447f14bf29b65f6fcd21bf4c9/users/0553ed6638c84b558f4bd55e3b331c51/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.203868 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e5c3f-719c-425e-82c5-bcde76fc9996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d88eb8447f14bf29b65f6fcd21bf4c9, user_id=0553ed6638c84b558f4bd55e3b331c51, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:23.207065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e5c3f-719c-425e-82c5-bcde76fc9996 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:23.210043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 864/1730] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:23.219204 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30725ac5-578a-4304-9ea2-b7d097e115f6 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.219499 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30725ac5-578a-4304-9ea2-b7d097e115f6 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.219793 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30725ac5-578a-4304-9ea2-b7d097e115f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.235164 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 867/1731] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:23 2021] PUT /identity/v3/projects/2d88eb8447f14bf29b65f6fcd21bf4c9/users/0553ed6638c84b558f4bd55e3b331c51/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:23.236540 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e5c3f-719c-425e-82c5-bcde76fc9996 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:23.294678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-30725ac5-578a-4304-9ea2-b7d097e115f6 None None] MFA Rules not processed for user `d61a8e4d64664e68a5710fdf766e4685`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:23.295956 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-30725ac5-578a-4304-9ea2-b7d097e115f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:23.403731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e5c3f-719c-425e-82c5-bcde76fc9996 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:23.421339 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6993af-1554-419b-b527-7f4107fad469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:23.422353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6993af-1554-419b-b527-7f4107fad469 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.423013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6993af-1554-419b-b527-7f4107fad469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.423438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6993af-1554-419b-b527-7f4107fad469 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.424371 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6993af-1554-419b-b527-7f4107fad469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:23.424828 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6993af-1554-419b-b527-7f4107fad469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:23.429112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6993af-1554-419b-b527-7f4107fad469 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:23.459028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 865/1732] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Dec 15 13:31:23 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:23.459028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f484c-ffa5-4a11-9fe1-0216137e48dc None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.459028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f484c-ffa5-4a11-9fe1-0216137e48dc None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.459028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f484c-ffa5-4a11-9fe1-0216137e48dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.460054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 868/1733] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:31:23.461150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6993af-1554-419b-b527-7f4107fad469 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:23.481686 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6993af-1554-419b-b527-7f4107fad469 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:23.503012 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e147dc-a972-4561-be67-829d4d945dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:23.503970 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e147dc-a972-4561-be67-829d4d945dfe admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.504537 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e147dc-a972-4561-be67-829d4d945dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.505086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e147dc-a972-4561-be67-829d4d945dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.506034 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e147dc-a972-4561-be67-829d4d945dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:23.509166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e147dc-a972-4561-be67-829d4d945dfe admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:23.559091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 869/1734] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:23 2021] POST /identity/v3/projects => generated 403 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:23.560588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e147dc-a972-4561-be67-829d4d945dfe admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:23.586214 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-2b4f484c-ffa5-4a11-9fe1-0216137e48dc None None] MFA Rules not processed for user `0553ed6638c84b558f4bd55e3b331c51`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:23.588962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-2b4f484c-ffa5-4a11-9fe1-0216137e48dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:23.673454 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e147dc-a972-4561-be67-829d4d945dfe admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:23.712711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af62985-020b-411d-862e-00b35775a30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:23.716767 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62985-020b-411d-862e-00b35775a30a admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.718725 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62985-020b-411d-862e-00b35775a30a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.719059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62985-020b-411d-862e-00b35775a30a admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.719805 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af62985-020b-411d-862e-00b35775a30a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:23.735437 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af62985-020b-411d-862e-00b35775a30a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:23.802766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 870/1735] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:23 2021] POST /identity/v3/users => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:23.807248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af62985-020b-411d-862e-00b35775a30a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:23.847947 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af62985-020b-411d-862e-00b35775a30a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:23.858395 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 866/1736] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:23 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:23.862817 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef160e-0c76-4536-9da0-306dbd4a40bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:23.873059 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f484c-ffa5-4a11-9fe1-0216137e48dc None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:23.876830 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-2b4f484c-ffa5-4a11-9fe1-0216137e48dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:23.879933 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef160e-0c76-4536-9da0-306dbd4a40bb admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.883343 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef160e-0c76-4536-9da0-306dbd4a40bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.883647 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef160e-0c76-4536-9da0-306dbd4a40bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.884468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef160e-0c76-4536-9da0-306dbd4a40bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:23.894344 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef160e-0c76-4536-9da0-306dbd4a40bb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:23.941697 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 871/1737] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:23 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:23.943756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef160e-0c76-4536-9da0-306dbd4a40bb admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:23.969125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef160e-0c76-4536-9da0-306dbd4a40bb admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:23.991977 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be812e7-cb1a-4863-abf1-b80ed32dfc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:23.992797 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be812e7-cb1a-4863-abf1-b80ed32dfc43 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.993086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be812e7-cb1a-4863-abf1-b80ed32dfc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.993507 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be812e7-cb1a-4863-abf1-b80ed32dfc43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.994402 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be812e7-cb1a-4863-abf1-b80ed32dfc43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:23.998565 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be812e7-cb1a-4863-abf1-b80ed32dfc43 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:24.059240 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 872/1738] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:23 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:24.066599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be812e7-cb1a-4863-abf1-b80ed32dfc43 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:24.076122 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2be812e7-cb1a-4863-abf1-b80ed32dfc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:24.149361 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f484c-ffa5-4a11-9fe1-0216137e48dc None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:24.157889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bd4d3-159d-4469-b615-4b20c783370c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:24.159863 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bd4d3-159d-4469-b615-4b20c783370c service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:24.160161 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bd4d3-159d-4469-b615-4b20c783370c service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:24.160447 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bd4d3-159d-4469-b615-4b20c783370c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:24.219463 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bd4d3-159d-4469-b615-4b20c783370c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:24.223594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bd4d3-159d-4469-b615-4b20c783370c service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:24.262272 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 867/1739] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:23 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:24.263412 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bd4d3-159d-4469-b615-4b20c783370c service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:24.318029 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bd4d3-159d-4469-b615-4b20c783370c service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:24.319431 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be812e7-cb1a-4863-abf1-b80ed32dfc43 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:24.338543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b30f3f-590c-4f19-b89f-706877fda019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:24.340446 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b30f3f-590c-4f19-b89f-706877fda019 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:24.342023 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b30f3f-590c-4f19-b89f-706877fda019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:24.342464 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b30f3f-590c-4f19-b89f-706877fda019 admin admin] PATH_INFO: `/v3/projects/0428899baa1c47edb4be960c2b144788/users/cd56a2db6fd846ba94ff3c9e5e0e2b91/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:24.357773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfb72f-78ec-46d0-a752-eb3a9596ea60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:24.358455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfb72f-78ec-46d0-a752-eb3a9596ea60 service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:24.358941 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfb72f-78ec-46d0-a752-eb3a9596ea60 service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:24.359223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfb72f-78ec-46d0-a752-eb3a9596ea60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:24.409748 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b30f3f-590c-4f19-b89f-706877fda019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0428899baa1c47edb4be960c2b144788, user_id=cd56a2db6fd846ba94ff3c9e5e0e2b91, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:24.417185 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b30f3f-590c-4f19-b89f-706877fda019 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:24.462827 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfb72f-78ec-46d0-a752-eb3a9596ea60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:24.463907 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 868/1740] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:24 2021] PUT /identity/v3/projects/0428899baa1c47edb4be960c2b144788/users/cd56a2db6fd846ba94ff3c9e5e0e2b91/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:24.471294 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b30f3f-590c-4f19-b89f-706877fda019 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:24.485432 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfb72f-78ec-46d0-a752-eb3a9596ea60 service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:24.554350 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 873/1741] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:24.560259 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45013ac2-6c26-4a3b-aa82-21bb0fe86d4c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:24.560556 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45013ac2-6c26-4a3b-aa82-21bb0fe86d4c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:24.577092 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45013ac2-6c26-4a3b-aa82-21bb0fe86d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:24.672116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-45013ac2-6c26-4a3b-aa82-21bb0fe86d4c None None] MFA Rules not processed for user `cd56a2db6fd846ba94ff3c9e5e0e2b91`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:24.673514 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-45013ac2-6c26-4a3b-aa82-21bb0fe86d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:24.725977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b30f3f-590c-4f19-b89f-706877fda019 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:24.746297 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d796b88-089b-403b-a5c9-adb1126f04e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:24.750353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d796b88-089b-403b-a5c9-adb1126f04e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:24.750820 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d796b88-089b-403b-a5c9-adb1126f04e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:24.754090 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d796b88-089b-403b-a5c9-adb1126f04e3 admin admin] PATH_INFO: `/v3/users/da39e854ef7745d09325807e8ca34a79` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:24.758373 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d796b88-089b-403b-a5c9-adb1126f04e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da39e854ef7745d09325807e8ca34a79)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:24.760532 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d796b88-089b-403b-a5c9-adb1126f04e3 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:24.875706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 874/1742] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:24 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:24.882036 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45013ac2-6c26-4a3b-aa82-21bb0fe86d4c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:24.884516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-7d796b88-089b-403b-a5c9-adb1126f04e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da39e854ef7745d09325807e8ca34a79'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:24.910608 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-7d796b88-089b-403b-a5c9-adb1126f04e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da39e854ef7745d09325807e8ca34a79'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:24.923481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-7d796b88-089b-403b-a5c9-adb1126f04e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da39e854ef7745d09325807e8ca34a79'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:24.929796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45013ac2-6c26-4a3b-aa82-21bb0fe86d4c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:24.935744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-7d796b88-089b-403b-a5c9-adb1126f04e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da39e854ef7745d09325807e8ca34a79'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:24.936596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-7d796b88-089b-403b-a5c9-adb1126f04e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da39e854ef7745d09325807e8ca34a79'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:24.952635 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d3c2c-e9bd-479b-9fbf-161ec1cdda93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:24.953398 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3c2c-e9bd-479b-9fbf-161ec1cdda93 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:24.953640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3c2c-e9bd-479b-9fbf-161ec1cdda93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:24.953932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3c2c-e9bd-479b-9fbf-161ec1cdda93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:24.954618 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d3c2c-e9bd-479b-9fbf-161ec1cdda93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:24.954735 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 869/1743] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:24 2021] DELETE /identity/v3/users/da39e854ef7745d09325807e8ca34a79 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:24.959261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8b1d3-aa8d-4ae9-b976-30c0d27dc359 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:24.959573 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8b1d3-aa8d-4ae9-b976-30c0d27dc359 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:24.959819 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8b1d3-aa8d-4ae9-b976-30c0d27dc359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:24.970447 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d3c2c-e9bd-479b-9fbf-161ec1cdda93 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:25.003921 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-9af8b1d3-aa8d-4ae9-b976-30c0d27dc359 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:25.005259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9af8b1d3-aa8d-4ae9-b976-30c0d27dc359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:25.022555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 875/1744] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:24 2021] POST /identity/v3/projects => generated 403 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:25.026806 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d3c2c-e9bd-479b-9fbf-161ec1cdda93 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:25.028789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a58d3c2c-e9bd-479b-9fbf-161ec1cdda93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:25.177677 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 870/1745] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:25.181933 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d3c2c-e9bd-479b-9fbf-161ec1cdda93 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:25.187392 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde69e2-cb15-44cf-8289-c87a3594af72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:25.188320 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde69e2-cb15-44cf-8289-c87a3594af72 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:25.188563 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde69e2-cb15-44cf-8289-c87a3594af72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:25.188915 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde69e2-cb15-44cf-8289-c87a3594af72 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:25.189810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde69e2-cb15-44cf-8289-c87a3594af72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:25.192847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde69e2-cb15-44cf-8289-c87a3594af72 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:25.222904 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 876/1746] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:25 2021] POST /identity/v3/users => generated 308 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:25.232766 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8b1d3-aa8d-4ae9-b976-30c0d27dc359 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:25.246983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde69e2-cb15-44cf-8289-c87a3594af72 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:25.247223 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8b1d3-aa8d-4ae9-b976-30c0d27dc359 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:25.249243 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-efde69e2-cb15-44cf-8289-c87a3594af72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:25.271869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d558ad-3e1e-419f-a5ef-4307e95c2d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:25.273184 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d558ad-3e1e-419f-a5ef-4307e95c2d79 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:25.274056 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d558ad-3e1e-419f-a5ef-4307e95c2d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:25.274493 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d558ad-3e1e-419f-a5ef-4307e95c2d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:25.275393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d558ad-3e1e-419f-a5ef-4307e95c2d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:25.277507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d558ad-3e1e-419f-a5ef-4307e95c2d79 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:25.294097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 871/1747] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:25 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:25.296470 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d558ad-3e1e-419f-a5ef-4307e95c2d79 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:25.317548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d558ad-3e1e-419f-a5ef-4307e95c2d79 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:25.328360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab990e-a0b7-4672-a833-cd48d0b4c007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:25.329745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab990e-a0b7-4672-a833-cd48d0b4c007 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:25.330150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab990e-a0b7-4672-a833-cd48d0b4c007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:25.330919 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab990e-a0b7-4672-a833-cd48d0b4c007 admin admin] PATH_INFO: `/v3/projects/33c6f727d53d46d59aec8cd8291afc91/users/f040c72ffa1c4ee89efe4374bcfdf9ee/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:25.357345 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab990e-a0b7-4672-a833-cd48d0b4c007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c6f727d53d46d59aec8cd8291afc91, user_id=f040c72ffa1c4ee89efe4374bcfdf9ee, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:25.361455 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab990e-a0b7-4672-a833-cd48d0b4c007 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:25.390745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 872/1748] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:25 2021] PUT /identity/v3/projects/33c6f727d53d46d59aec8cd8291afc91/users/f040c72ffa1c4ee89efe4374bcfdf9ee/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:25.392574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab990e-a0b7-4672-a833-cd48d0b4c007 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:25.429900 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde69e2-cb15-44cf-8289-c87a3594af72 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:25.485443 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab990e-a0b7-4672-a833-cd48d0b4c007 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:25.506065 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd25129-3b03-4d7a-9485-46aa64d80f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:25.508218 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd25129-3b03-4d7a-9485-46aa64d80f5f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:25.508727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd25129-3b03-4d7a-9485-46aa64d80f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:25.511023 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd25129-3b03-4d7a-9485-46aa64d80f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:25.511023 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd25129-3b03-4d7a-9485-46aa64d80f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:25.514006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd25129-3b03-4d7a-9485-46aa64d80f5f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:25.549305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 873/1749] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:25 2021] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:25.550534 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd25129-3b03-4d7a-9485-46aa64d80f5f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:25.557675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160db062-748f-4f68-b3d6-165767cad58e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:25.558223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160db062-748f-4f68-b3d6-165767cad58e service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:25.558510 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160db062-748f-4f68-b3d6-165767cad58e service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:25.558791 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160db062-748f-4f68-b3d6-165767cad58e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:25.567507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd25129-3b03-4d7a-9485-46aa64d80f5f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:25.577558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160db062-748f-4f68-b3d6-165767cad58e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:25.583108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160db062-748f-4f68-b3d6-165767cad58e service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:25.586232 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280b857-893d-4221-a396-b172f792c3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:25.587558 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b857-893d-4221-a396-b172f792c3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:25.587849 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b857-893d-4221-a396-b172f792c3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:25.588128 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b857-893d-4221-a396-b172f792c3dd admin admin] PATH_INFO: `/v3/projects/33c6f727d53d46d59aec8cd8291afc91/users/f040c72ffa1c4ee89efe4374bcfdf9ee/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:25.595954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280b857-893d-4221-a396-b172f792c3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c6f727d53d46d59aec8cd8291afc91, user_id=f040c72ffa1c4ee89efe4374bcfdf9ee, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:25.599165 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280b857-893d-4221-a396-b172f792c3dd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:25.609862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 877/1750] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:25.618303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 874/1751] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:25 2021] PUT /identity/v3/projects/33c6f727d53d46d59aec8cd8291afc91/users/f040c72ffa1c4ee89efe4374bcfdf9ee/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:25.641444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18056d-104d-4dd3-b804-a3094291cdc9 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:25.641856 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18056d-104d-4dd3-b804-a3094291cdc9 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:25.642281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18056d-104d-4dd3-b804-a3094291cdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:25.702213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-2a18056d-104d-4dd3-b804-a3094291cdc9 None None] MFA Rules not processed for user `f040c72ffa1c4ee89efe4374bcfdf9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:25.704515 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2a18056d-104d-4dd3-b804-a3094291cdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:25.799564 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 878/1752] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:25 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:25.806667 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280b857-893d-4221-a396-b172f792c3dd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:25.808539 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9280b857-893d-4221-a396-b172f792c3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:25.897986 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280b857-893d-4221-a396-b172f792c3dd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:25.909984 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d2cb4-9b65-4b7e-912a-c8ab0aef3e51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:25.911533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d2cb4-9b65-4b7e-912a-c8ab0aef3e51 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:25.912010 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d2cb4-9b65-4b7e-912a-c8ab0aef3e51 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:25.912229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d2cb4-9b65-4b7e-912a-c8ab0aef3e51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:25.927007 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d2cb4-9b65-4b7e-912a-c8ab0aef3e51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:25.928630 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d2cb4-9b65-4b7e-912a-c8ab0aef3e51 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:25.964902 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063e94b-1369-497a-9864-17ec6c6230a8 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:25.965196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063e94b-1369-497a-9864-17ec6c6230a8 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:25.965480 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063e94b-1369-497a-9864-17ec6c6230a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:25.973445 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 875/1753] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:25 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:26.000762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-4063e94b-1369-497a-9864-17ec6c6230a8 None None] MFA Rules not processed for user `a53d77fd836e4abda2cb59d5ed6c370e`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:26.002343 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-4063e94b-1369-497a-9864-17ec6c6230a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:26.135241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 879/1754] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:25 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:26.315480 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f43e-52fa-4ac4-aab1-a766b2ac69a2 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:26.316043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f43e-52fa-4ac4-aab1-a766b2ac69a2 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:26.316043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f43e-52fa-4ac4-aab1-a766b2ac69a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:26.334682 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-9178f43e-52fa-4ac4-aab1-a766b2ac69a2 None None] MFA Rules not processed for user `e2f51c315df74089bc6873e889cf80d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:26.336101 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9178f43e-52fa-4ac4-aab1-a766b2ac69a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:26.411351 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 876/1755] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:26 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:26.745448 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c460-10d2-4756-8c09-066957f577e0 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:26.746541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c460-10d2-4756-8c09-066957f577e0 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:26.747055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c460-10d2-4756-8c09-066957f577e0 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:26.749113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 880/1756] 10.222.0.60 () {54 vars in 921 bytes} [Wed Dec 15 13:31:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:26.772583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2a413-58e7-43c3-a3e3-4ad8364961d0 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:26.772875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2a413-58e7-43c3-a3e3-4ad8364961d0 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:26.773730 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2a413-58e7-43c3-a3e3-4ad8364961d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:26.803674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c460-10d2-4756-8c09-066957f577e0 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:26.807508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-0033c460-10d2-4756-8c09-066957f577e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:26.818499 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-c2e2a413-58e7-43c3-a3e3-4ad8364961d0 None None] MFA Rules not processed for user `d61a8e4d64664e68a5710fdf766e4685`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:26.832479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c2e2a413-58e7-43c3-a3e3-4ad8364961d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:26.943169 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c460-10d2-4756-8c09-066957f577e0 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:26.948897 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:26.949743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:26.950120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:26.950480 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] PATH_INFO: `/v3/projects/0abfa177d9a844588ad57a7d55d7ca4c` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:26.951818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0abfa177d9a844588ad57a7d55d7ca4c)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:26.954580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:26.957805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 877/1757] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Dec 15 13:31:26 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:27.016190 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0abfa177d9a844588ad57a7d55d7ca4c', 'request_id': 'req-44c5b595-f385-4a08-a15a-3afe4f3c1218'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.024102 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0abfa177d9a844588ad57a7d55d7ca4c', 'request_id': 'req-44c5b595-f385-4a08-a15a-3afe4f3c1218'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.034316 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0abfa177d9a844588ad57a7d55d7ca4c', 'request_id': 'req-44c5b595-f385-4a08-a15a-3afe4f3c1218'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.045255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] The token cache is being invalidate because project 0abfa177d9a844588ad57a7d55d7ca4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:27.045545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.046215 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.047837 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 881/1758] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:26 2021] DELETE /identity/v3/projects/0abfa177d9a844588ad57a7d55d7ca4c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:27.052132 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2a413-58e7-43c3-a3e3-4ad8364961d0 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:27.064630 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2a413-58e7-43c3-a3e3-4ad8364961d0 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:27.120618 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc3d8b-8d05-49d7-bed4-6fd7a4510b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:27.121749 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc3d8b-8d05-49d7-bed4-6fd7a4510b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:27.122027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc3d8b-8d05-49d7-bed4-6fd7a4510b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:27.122301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc3d8b-8d05-49d7-bed4-6fd7a4510b33 admin admin] PATH_INFO: `/v3/users/0553ed6638c84b558f4bd55e3b331c51` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:27.123534 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc3d8b-8d05-49d7-bed4-6fd7a4510b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0553ed6638c84b558f4bd55e3b331c51)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:27.125994 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc3d8b-8d05-49d7-bed4-6fd7a4510b33 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:27.172561 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-26dc3d8b-8d05-49d7-bed4-6fd7a4510b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0553ed6638c84b558f4bd55e3b331c51'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.184445 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-26dc3d8b-8d05-49d7-bed4-6fd7a4510b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0553ed6638c84b558f4bd55e3b331c51'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.192988 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-26dc3d8b-8d05-49d7-bed4-6fd7a4510b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0553ed6638c84b558f4bd55e3b331c51'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.200802 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-26dc3d8b-8d05-49d7-bed4-6fd7a4510b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0553ed6638c84b558f4bd55e3b331c51'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.201271 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-26dc3d8b-8d05-49d7-bed4-6fd7a4510b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0553ed6638c84b558f4bd55e3b331c51'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.207740 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 878/1759] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:27 2021] DELETE /identity/v3/users/0553ed6638c84b558f4bd55e3b331c51 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:27.661092 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:27.663113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:27.720714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5b595-f385-4a08-a15a-3afe4f3c1218 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:27.746193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc3d8b-8d05-49d7-bed4-6fd7a4510b33 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:27.747838 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-26dc3d8b-8d05-49d7-bed4-6fd7a4510b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:27.841468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747cf90-d598-4068-bb97-d32e1d7f7f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:27.843000 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747cf90-d598-4068-bb97-d32e1d7f7f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:27.843965 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747cf90-d598-4068-bb97-d32e1d7f7f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:27.844408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747cf90-d598-4068-bb97-d32e1d7f7f06 admin admin] PATH_INFO: `/v3/projects/2d88eb8447f14bf29b65f6fcd21bf4c9` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:27.846963 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747cf90-d598-4068-bb97-d32e1d7f7f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d88eb8447f14bf29b65f6fcd21bf4c9)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:27.849219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747cf90-d598-4068-bb97-d32e1d7f7f06 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:27.908646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc3d8b-8d05-49d7-bed4-6fd7a4510b33 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:27.923148 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-1747cf90-d598-4068-bb97-d32e1d7f7f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d88eb8447f14bf29b65f6fcd21bf4c9', 'request_id': 'req-1747cf90-d598-4068-bb97-d32e1d7f7f06'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.935246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-1747cf90-d598-4068-bb97-d32e1d7f7f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d88eb8447f14bf29b65f6fcd21bf4c9', 'request_id': 'req-1747cf90-d598-4068-bb97-d32e1d7f7f06'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.944818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-1747cf90-d598-4068-bb97-d32e1d7f7f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d88eb8447f14bf29b65f6fcd21bf4c9', 'request_id': 'req-1747cf90-d598-4068-bb97-d32e1d7f7f06'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.972079 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-1747cf90-d598-4068-bb97-d32e1d7f7f06 admin admin] The token cache is being invalidate because project 2d88eb8447f14bf29b65f6fcd21bf4c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:27.972564 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-1747cf90-d598-4068-bb97-d32e1d7f7f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.975261 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-1747cf90-d598-4068-bb97-d32e1d7f7f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:27.977101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 882/1760] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:27 2021] DELETE /identity/v3/projects/2d88eb8447f14bf29b65f6fcd21bf4c9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:27.985935 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a573a-1f57-4921-900d-e8d6b19e7534 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:27.986194 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a573a-1f57-4921-900d-e8d6b19e7534 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:27.986625 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a573a-1f57-4921-900d-e8d6b19e7534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.009227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-311a573a-1f57-4921-900d-e8d6b19e7534 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:28.010462 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-311a573a-1f57-4921-900d-e8d6b19e7534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:28.012542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86805f-349a-4f28-8770-804c1d9cd0f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.013604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86805f-349a-4f28-8770-804c1d9cd0f5 service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.014260 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86805f-349a-4f28-8770-804c1d9cd0f5 service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.014927 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86805f-349a-4f28-8770-804c1d9cd0f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.018084 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9b86805f-349a-4f28-8770-804c1d9cd0f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:28.039510 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86805f-349a-4f28-8770-804c1d9cd0f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:28.046009 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86805f-349a-4f28-8770-804c1d9cd0f5 service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:28.067293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 879/1761] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:27 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:28.091247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 883/1762] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:28.099483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef65403-ce9b-4cd3-82d2-19a6b6a93262 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.100016 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef65403-ce9b-4cd3-82d2-19a6b6a93262 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.100510 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef65403-ce9b-4cd3-82d2-19a6b6a93262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.122657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-4ef65403-ce9b-4cd3-82d2-19a6b6a93262 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:28.123931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4ef65403-ce9b-4cd3-82d2-19a6b6a93262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:28.134885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 880/1763] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:28.137391 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a573a-1f57-4921-900d-e8d6b19e7534 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:28.148374 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a573a-1f57-4921-900d-e8d6b19e7534 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:28.153023 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a4d1a-5884-420d-aaa0-df6541b4135e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.153711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a4d1a-5884-420d-aaa0-df6541b4135e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.153998 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a4d1a-5884-420d-aaa0-df6541b4135e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.154303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a4d1a-5884-420d-aaa0-df6541b4135e admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.155089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a4d1a-5884-420d-aaa0-df6541b4135e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:28.155423 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a4d1a-5884-420d-aaa0-df6541b4135e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:28.157872 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a4d1a-5884-420d-aaa0-df6541b4135e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:28.170064 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 884/1764] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:31:28.174720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef65403-ce9b-4cd3-82d2-19a6b6a93262 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:28.184451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef65403-ce9b-4cd3-82d2-19a6b6a93262 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:28.189518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f5980-5250-454d-8de6-8d3b0256a81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.190186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f5980-5250-454d-8de6-8d3b0256a81e admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.190473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f5980-5250-454d-8de6-8d3b0256a81e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.190778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f5980-5250-454d-8de6-8d3b0256a81e admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.191522 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f5980-5250-454d-8de6-8d3b0256a81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:28.193431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f5980-5250-454d-8de6-8d3b0256a81e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:28.220746 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 881/1765] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:28 2021] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:28.224881 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a4d1a-5884-420d-aaa0-df6541b4135e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:28.234509 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a4d1a-5884-420d-aaa0-df6541b4135e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:28.287276 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373564c-1424-4baa-9d03-2b4aba07b190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.287932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373564c-1424-4baa-9d03-2b4aba07b190 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.288226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373564c-1424-4baa-9d03-2b4aba07b190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.288503 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373564c-1424-4baa-9d03-2b4aba07b190 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.289197 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373564c-1424-4baa-9d03-2b4aba07b190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:28.291162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373564c-1424-4baa-9d03-2b4aba07b190 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:28.310315 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 885/1766] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:28 2021] POST /identity/v3/users => generated 283 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:28.315720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f5980-5250-454d-8de6-8d3b0256a81e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:28.325829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f5980-5250-454d-8de6-8d3b0256a81e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:28.330873 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4048315-0794-4a94-9489-4694946b1f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.331528 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4048315-0794-4a94-9489-4694946b1f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.331806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4048315-0794-4a94-9489-4694946b1f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.332082 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4048315-0794-4a94-9489-4694946b1f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.332821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4048315-0794-4a94-9489-4694946b1f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:28.334422 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4048315-0794-4a94-9489-4694946b1f44 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:28.344790 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 882/1767] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:28.349842 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373564c-1424-4baa-9d03-2b4aba07b190 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:28.362826 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373564c-1424-4baa-9d03-2b4aba07b190 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:28.367386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bc0a4-fbf1-4ee9-b150-3d26801c2271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.368038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bc0a4-fbf1-4ee9-b150-3d26801c2271 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.368345 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bc0a4-fbf1-4ee9-b150-3d26801c2271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.368577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bc0a4-fbf1-4ee9-b150-3d26801c2271 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.369375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bc0a4-fbf1-4ee9-b150-3d26801c2271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:28.371018 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bc0a4-fbf1-4ee9-b150-3d26801c2271 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:28.381401 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 886/1768] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:28 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:31:28.386702 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4048315-0794-4a94-9489-4694946b1f44 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:28.398181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4048315-0794-4a94-9489-4694946b1f44 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:28.402786 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a94c6-b839-42a4-bb0a-f6abd99998e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.403695 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a94c6-b839-42a4-bb0a-f6abd99998e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.403969 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a94c6-b839-42a4-bb0a-f6abd99998e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.404240 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a94c6-b839-42a4-bb0a-f6abd99998e8 admin admin] PATH_INFO: `/v3/projects/a5486b44a6984b56bf8849039d56f6d1/users/dabc46dbef2f4436af389136d33306a5/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.418997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a94c6-b839-42a4-bb0a-f6abd99998e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5486b44a6984b56bf8849039d56f6d1, user_id=dabc46dbef2f4436af389136d33306a5, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:28.421701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a94c6-b839-42a4-bb0a-f6abd99998e8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:28.434186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 883/1769] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:28 2021] PUT /identity/v3/projects/a5486b44a6984b56bf8849039d56f6d1/users/dabc46dbef2f4436af389136d33306a5/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:28.444163 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03939063-94f0-40a9-bfdb-8681736c06b7 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.444455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03939063-94f0-40a9-bfdb-8681736c06b7 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.444737 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03939063-94f0-40a9-bfdb-8681736c06b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.454357 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a94c6-b839-42a4-bb0a-f6abd99998e8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:28.456069 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-eb5a94c6-b839-42a4-bb0a-f6abd99998e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:28.473127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-03939063-94f0-40a9-bfdb-8681736c06b7 None None] MFA Rules not processed for user `dabc46dbef2f4436af389136d33306a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:28.474395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-03939063-94f0-40a9-bfdb-8681736c06b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:28.527968 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a94c6-b839-42a4-bb0a-f6abd99998e8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:28.532738 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11218a9b-063f-4c21-8843-9a62a9ad16e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.533600 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11218a9b-063f-4c21-8843-9a62a9ad16e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.533883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11218a9b-063f-4c21-8843-9a62a9ad16e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.534159 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11218a9b-063f-4c21-8843-9a62a9ad16e7 admin admin] PATH_INFO: `/v3/users/cd56a2db6fd846ba94ff3c9e5e0e2b91` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.535359 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11218a9b-063f-4c21-8843-9a62a9ad16e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd56a2db6fd846ba94ff3c9e5e0e2b91)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:28.537270 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11218a9b-063f-4c21-8843-9a62a9ad16e7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:28.545044 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 887/1770] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:28 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:28.549772 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03939063-94f0-40a9-bfdb-8681736c06b7 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:28.561394 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03939063-94f0-40a9-bfdb-8681736c06b7 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:28.567875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240ed66-1a40-4b87-890e-3a0d2ef5d6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.568790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240ed66-1a40-4b87-890e-3a0d2ef5d6af admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.569023 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240ed66-1a40-4b87-890e-3a0d2ef5d6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.569098 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240ed66-1a40-4b87-890e-3a0d2ef5d6af admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.569825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240ed66-1a40-4b87-890e-3a0d2ef5d6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:28.571785 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240ed66-1a40-4b87-890e-3a0d2ef5d6af admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:28.587773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-11218a9b-063f-4c21-8843-9a62a9ad16e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd56a2db6fd846ba94ff3c9e5e0e2b91'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:28.602731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 888/1771] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:28 2021] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:28.602943 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-11218a9b-063f-4c21-8843-9a62a9ad16e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd56a2db6fd846ba94ff3c9e5e0e2b91'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:28.604731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240ed66-1a40-4b87-890e-3a0d2ef5d6af admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:28.608204 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-11218a9b-063f-4c21-8843-9a62a9ad16e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd56a2db6fd846ba94ff3c9e5e0e2b91'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:28.616036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-11218a9b-063f-4c21-8843-9a62a9ad16e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd56a2db6fd846ba94ff3c9e5e0e2b91'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:28.619711 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-11218a9b-063f-4c21-8843-9a62a9ad16e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd56a2db6fd846ba94ff3c9e5e0e2b91'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:28.626599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 884/1772] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:28 2021] DELETE /identity/v3/users/cd56a2db6fd846ba94ff3c9e5e0e2b91 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:28.631436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472cdfc-0b8e-4f88-b0a9-ee9bcbf4ac60 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.631804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472cdfc-0b8e-4f88-b0a9-ee9bcbf4ac60 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.632158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472cdfc-0b8e-4f88-b0a9-ee9bcbf4ac60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.658065 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a472cdfc-0b8e-4f88-b0a9-ee9bcbf4ac60 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:28.659332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a472cdfc-0b8e-4f88-b0a9-ee9bcbf4ac60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:28.704251 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240ed66-1a40-4b87-890e-3a0d2ef5d6af admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:28.730367 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 885/1773] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:31:28.757762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472cdfc-0b8e-4f88-b0a9-ee9bcbf4ac60 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:28.759364 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a472cdfc-0b8e-4f88-b0a9-ee9bcbf4ac60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:28.777610 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d5b45-e016-4002-a9e3-0a1850c55326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.778461 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d5b45-e016-4002-a9e3-0a1850c55326 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.778757 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d5b45-e016-4002-a9e3-0a1850c55326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.779937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d5b45-e016-4002-a9e3-0a1850c55326 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.779937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d5b45-e016-4002-a9e3-0a1850c55326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:28.782946 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d5b45-e016-4002-a9e3-0a1850c55326 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:28.815046 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 889/1774] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:28 2021] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:28.818967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d5b45-e016-4002-a9e3-0a1850c55326 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:28.820845 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-152d5b45-e016-4002-a9e3-0a1850c55326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:28.833249 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d5b45-e016-4002-a9e3-0a1850c55326 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:28.838366 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c423c2-e6e6-4812-ac49-32ceefc50843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.839075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c423c2-e6e6-4812-ac49-32ceefc50843 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.839364 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c423c2-e6e6-4812-ac49-32ceefc50843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.839647 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c423c2-e6e6-4812-ac49-32ceefc50843 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.839750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472cdfc-0b8e-4f88-b0a9-ee9bcbf4ac60 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:28.840402 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c423c2-e6e6-4812-ac49-32ceefc50843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:28.842002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c423c2-e6e6-4812-ac49-32ceefc50843 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:28.846101 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0e9ae-daf9-484d-9bcf-0bc5d9265e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.846789 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0e9ae-daf9-484d-9bcf-0bc5d9265e38 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.847140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0e9ae-daf9-484d-9bcf-0bc5d9265e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.847392 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0e9ae-daf9-484d-9bcf-0bc5d9265e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.852467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 890/1775] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:28 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:31:28.856842 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c423c2-e6e6-4812-ac49-32ceefc50843 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:28.857028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0e9ae-daf9-484d-9bcf-0bc5d9265e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:28.858641 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0e9ae-daf9-484d-9bcf-0bc5d9265e38 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:28.867167 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c423c2-e6e6-4812-ac49-32ceefc50843 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:28.869537 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 886/1776] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:28.872258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05a70f-5dc0-4169-9c2c-81d01d10fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.873146 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05a70f-5dc0-4169-9c2c-81d01d10fb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.873495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05a70f-5dc0-4169-9c2c-81d01d10fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.873779 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05a70f-5dc0-4169-9c2c-81d01d10fb65 admin admin] PATH_INFO: `/v3/projects/6cea6d1158cf4580a7e96deb27ff30ee/users/afb2a6fed6364c4bab075a6c7d37a63c/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.891206 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05a70f-5dc0-4169-9c2c-81d01d10fb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cea6d1158cf4580a7e96deb27ff30ee, user_id=afb2a6fed6364c4bab075a6c7d37a63c, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:28.893876 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05a70f-5dc0-4169-9c2c-81d01d10fb65 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:28.909516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 891/1777] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:28 2021] PUT /identity/v3/projects/6cea6d1158cf4580a7e96deb27ff30ee/users/afb2a6fed6364c4bab075a6c7d37a63c/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:28.913789 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0e9ae-daf9-484d-9bcf-0bc5d9265e38 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:28.925669 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0e9ae-daf9-484d-9bcf-0bc5d9265e38 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:28.995883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b465d2-1815-41ca-8b36-a0d7efaddc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.996567 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b465d2-1815-41ca-8b36-a0d7efaddc84 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.996849 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b465d2-1815-41ca-8b36-a0d7efaddc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.997128 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b465d2-1815-41ca-8b36-a0d7efaddc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.998069 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b465d2-1815-41ca-8b36-a0d7efaddc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:29.000879 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b465d2-1815-41ca-8b36-a0d7efaddc84 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:29.014898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 887/1778] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:28 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:29.019399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05a70f-5dc0-4169-9c2c-81d01d10fb65 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:29.033145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05a70f-5dc0-4169-9c2c-81d01d10fb65 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:29.038040 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163867e-823a-40dc-bcad-1030a279616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:29.039038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163867e-823a-40dc-bcad-1030a279616c admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:29.039349 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163867e-823a-40dc-bcad-1030a279616c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:29.039634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163867e-823a-40dc-bcad-1030a279616c admin admin] PATH_INFO: `/v3/projects/6cea6d1158cf4580a7e96deb27ff30ee/users/afb2a6fed6364c4bab075a6c7d37a63c/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:29.041620 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163867e-823a-40dc-bcad-1030a279616c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cea6d1158cf4580a7e96deb27ff30ee, user_id=afb2a6fed6364c4bab075a6c7d37a63c, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:29.044328 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163867e-823a-40dc-bcad-1030a279616c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:29.064458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 892/1779] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:29 2021] PUT /identity/v3/projects/6cea6d1158cf4580a7e96deb27ff30ee/users/afb2a6fed6364c4bab075a6c7d37a63c/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:29.066548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265143ea-87d1-4ebf-8e4a-9019607d7a11 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:29.066815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265143ea-87d1-4ebf-8e4a-9019607d7a11 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:29.071305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265143ea-87d1-4ebf-8e4a-9019607d7a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:29.098987 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-265143ea-87d1-4ebf-8e4a-9019607d7a11 None None] MFA Rules not processed for user `afb2a6fed6364c4bab075a6c7d37a63c`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:29.100226 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-265143ea-87d1-4ebf-8e4a-9019607d7a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:29.192712 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 888/1780] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:29 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:29.204415 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163867e-823a-40dc-bcad-1030a279616c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:29.207054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d163867e-823a-40dc-bcad-1030a279616c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:29.277560 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163867e-823a-40dc-bcad-1030a279616c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:29.281988 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8ff60-94ad-4dca-bc13-6454c4deaf3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:29.282724 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8ff60-94ad-4dca-bc13-6454c4deaf3c service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:29.283044 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8ff60-94ad-4dca-bc13-6454c4deaf3c service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:29.283973 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8ff60-94ad-4dca-bc13-6454c4deaf3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:29.303891 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265143ea-87d1-4ebf-8e4a-9019607d7a11 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:29.305356 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-265143ea-87d1-4ebf-8e4a-9019607d7a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:29.314825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8ff60-94ad-4dca-bc13-6454c4deaf3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:29.317467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8ff60-94ad-4dca-bc13-6454c4deaf3c service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:29.329399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 893/1781] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:29 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:29.383914 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265143ea-87d1-4ebf-8e4a-9019607d7a11 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:29.389201 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:29.390064 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:29.390375 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:29.390648 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] PATH_INFO: `/v3/projects/0428899baa1c47edb4be960c2b144788` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:29.391911 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0428899baa1c47edb4be960c2b144788)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:29.393844 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:29.412369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8ff60-94ad-4dca-bc13-6454c4deaf3c service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:29.421139 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8ff60-94ad-4dca-bc13-6454c4deaf3c service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:29.425767 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948130-235d-4ffc-bdd1-0cab95113168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:29.426607 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948130-235d-4ffc-bdd1-0cab95113168 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:29.426918 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948130-235d-4ffc-bdd1-0cab95113168 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:29.427200 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948130-235d-4ffc-bdd1-0cab95113168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:29.429297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-4a948130-235d-4ffc-bdd1-0cab95113168 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:29.444502 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0428899baa1c47edb4be960c2b144788', 'request_id': 'req-f234e966-0ef1-4bb0-8282-e5e973d32ed2'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:29.451381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0428899baa1c47edb4be960c2b144788', 'request_id': 'req-f234e966-0ef1-4bb0-8282-e5e973d32ed2'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:29.458476 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0428899baa1c47edb4be960c2b144788', 'request_id': 'req-f234e966-0ef1-4bb0-8282-e5e973d32ed2'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:29.470296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] The token cache is being invalidate because project 0428899baa1c47edb4be960c2b144788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:29.470590 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:29.471246 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:29.472771 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 889/1782] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:29 2021] DELETE /identity/v3/projects/0428899baa1c47edb4be960c2b144788 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:29.476722 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:29.478023 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:29.488761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a948130-235d-4ffc-bdd1-0cab95113168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:29.490196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a948130-235d-4ffc-bdd1-0cab95113168 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:29.499032 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 894/1783] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:29 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:29.539981 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234e966-0ef1-4bb0-8282-e5e973d32ed2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:29.544618 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ae9f4-5c1e-4910-9f08-fd81fc9380a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:29.545475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ae9f4-5c1e-4910-9f08-fd81fc9380a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:29.545756 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ae9f4-5c1e-4910-9f08-fd81fc9380a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:29.546028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ae9f4-5c1e-4910-9f08-fd81fc9380a1 admin admin] PATH_INFO: `/v3/users/f040c72ffa1c4ee89efe4374bcfdf9ee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:29.549411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ae9f4-5c1e-4910-9f08-fd81fc9380a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f040c72ffa1c4ee89efe4374bcfdf9ee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:29.551031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ae9f4-5c1e-4910-9f08-fd81fc9380a1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:29.604647 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-517ae9f4-5c1e-4910-9f08-fd81fc9380a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f040c72ffa1c4ee89efe4374bcfdf9ee'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:29.618443 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-517ae9f4-5c1e-4910-9f08-fd81fc9380a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f040c72ffa1c4ee89efe4374bcfdf9ee'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:29.626386 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-517ae9f4-5c1e-4910-9f08-fd81fc9380a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f040c72ffa1c4ee89efe4374bcfdf9ee'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:29.633684 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-517ae9f4-5c1e-4910-9f08-fd81fc9380a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f040c72ffa1c4ee89efe4374bcfdf9ee'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:29.634372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-517ae9f4-5c1e-4910-9f08-fd81fc9380a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f040c72ffa1c4ee89efe4374bcfdf9ee'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:29.641739 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 890/1784] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:29 2021] DELETE /identity/v3/users/f040c72ffa1c4ee89efe4374bcfdf9ee => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:29.921046 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948130-235d-4ffc-bdd1-0cab95113168 service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:29.932409 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948130-235d-4ffc-bdd1-0cab95113168 service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:29.988669 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:29.990396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:29.990396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:29.990396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3 admin admin] PATH_INFO: `/v3/projects/33c6f727d53d46d59aec8cd8291afc91` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:29.991495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33c6f727d53d46d59aec8cd8291afc91)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:29.993408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:30.046299 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c6f727d53d46d59aec8cd8291afc91', 'request_id': 'req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:30.053861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c6f727d53d46d59aec8cd8291afc91', 'request_id': 'req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:30.060197 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c6f727d53d46d59aec8cd8291afc91', 'request_id': 'req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:30.070644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3 admin admin] The token cache is being invalidate because project 33c6f727d53d46d59aec8cd8291afc91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:30.070966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:30.071622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c4cc0d0c-f691-4ce0-8119-fd8f782637b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:30.073164 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 895/1785] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:29 2021] DELETE /identity/v3/projects/33c6f727d53d46d59aec8cd8291afc91 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:30.079837 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3ca6d-4bdc-407f-b042-7702cc46f581 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:30.080290 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3ca6d-4bdc-407f-b042-7702cc46f581 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:30.080381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3ca6d-4bdc-407f-b042-7702cc46f581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:30.098736 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-d9b3ca6d-4bdc-407f-b042-7702cc46f581 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:30.099911 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-d9b3ca6d-4bdc-407f-b042-7702cc46f581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:30.165134 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 891/1786] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:31:30.173042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4128116-ae19-45e1-b561-2e3f20a7aecf None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:30.173334 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4128116-ae19-45e1-b561-2e3f20a7aecf None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:30.173636 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4128116-ae19-45e1-b561-2e3f20a7aecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:30.198278 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-d4128116-ae19-45e1-b561-2e3f20a7aecf None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:30.200038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d4128116-ae19-45e1-b561-2e3f20a7aecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:30.211313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 896/1787] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:30.215179 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3ca6d-4bdc-407f-b042-7702cc46f581 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:30.225042 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3ca6d-4bdc-407f-b042-7702cc46f581 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:30.245487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5c0a5-9e82-4b7d-8100-7e1bb8311e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:30.247308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5c0a5-9e82-4b7d-8100-7e1bb8311e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:30.248027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5c0a5-9e82-4b7d-8100-7e1bb8311e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:30.248710 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5c0a5-9e82-4b7d-8100-7e1bb8311e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:30.251157 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5c0a5-9e82-4b7d-8100-7e1bb8311e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:30.251595 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5c0a5-9e82-4b7d-8100-7e1bb8311e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:30.255232 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5c0a5-9e82-4b7d-8100-7e1bb8311e99 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:30.276604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 892/1788] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:31:30.280903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4128116-ae19-45e1-b561-2e3f20a7aecf None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:30.293835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4128116-ae19-45e1-b561-2e3f20a7aecf None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:30.301136 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682defc-428a-45ac-8592-5250732cfe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:30.301817 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682defc-428a-45ac-8592-5250732cfe3c admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:30.302108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682defc-428a-45ac-8592-5250732cfe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:30.302419 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682defc-428a-45ac-8592-5250732cfe3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:30.303191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682defc-428a-45ac-8592-5250732cfe3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:30.305106 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682defc-428a-45ac-8592-5250732cfe3c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:30.369806 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 897/1789] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:30 2021] POST /identity/v3/projects => generated 405 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:30.370962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5c0a5-9e82-4b7d-8100-7e1bb8311e99 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:30.387582 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5c0a5-9e82-4b7d-8100-7e1bb8311e99 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:30.475102 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2f454-b5ed-4150-a81f-4ffcc0af474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:30.476009 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2f454-b5ed-4150-a81f-4ffcc0af474c admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:30.476445 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2f454-b5ed-4150-a81f-4ffcc0af474c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:30.476892 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2f454-b5ed-4150-a81f-4ffcc0af474c admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:30.477899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2f454-b5ed-4150-a81f-4ffcc0af474c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:30.480306 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2f454-b5ed-4150-a81f-4ffcc0af474c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:30.509041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682defc-428a-45ac-8592-5250732cfe3c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:30.515800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 893/1790] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:30 2021] POST /identity/v3/users => generated 303 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:30.520483 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682defc-428a-45ac-8592-5250732cfe3c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:30.527192 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38518add-308e-4dbc-8989-2aa4cfed3f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:30.528013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38518add-308e-4dbc-8989-2aa4cfed3f5b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:30.528381 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38518add-308e-4dbc-8989-2aa4cfed3f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:30.528729 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38518add-308e-4dbc-8989-2aa4cfed3f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:30.529570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38518add-308e-4dbc-8989-2aa4cfed3f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:30.531512 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38518add-308e-4dbc-8989-2aa4cfed3f5b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:30.547847 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2f454-b5ed-4150-a81f-4ffcc0af474c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:30.554544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 898/1791] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:30 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:30.558230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2f454-b5ed-4150-a81f-4ffcc0af474c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:30.563897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b1767-6bfb-497d-9070-7c0e7e5db7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:30.564581 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b1767-6bfb-497d-9070-7c0e7e5db7fb admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:30.564874 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b1767-6bfb-497d-9070-7c0e7e5db7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:30.565160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b1767-6bfb-497d-9070-7c0e7e5db7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:30.565926 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b1767-6bfb-497d-9070-7c0e7e5db7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:30.567604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b1767-6bfb-497d-9070-7c0e7e5db7fb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:30.579346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 894/1792] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:30 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:30.583459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38518add-308e-4dbc-8989-2aa4cfed3f5b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:30.594927 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38518add-308e-4dbc-8989-2aa4cfed3f5b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:30.603767 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00443e-9348-4e38-870e-68604b4d443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:30.604686 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00443e-9348-4e38-870e-68604b4d443d admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:30.604976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00443e-9348-4e38-870e-68604b4d443d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:30.605256 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00443e-9348-4e38-870e-68604b4d443d admin admin] PATH_INFO: `/v3/projects/2eca06c9f13e4bd4ba60e90004b92c21/users/cbd242c480d64904957d2ea6bdb75a90/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:30.623592 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00443e-9348-4e38-870e-68604b4d443d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eca06c9f13e4bd4ba60e90004b92c21, user_id=cbd242c480d64904957d2ea6bdb75a90, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:30.626588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00443e-9348-4e38-870e-68604b4d443d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:30.641966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 899/1793] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:30 2021] PUT /identity/v3/projects/2eca06c9f13e4bd4ba60e90004b92c21/users/cbd242c480d64904957d2ea6bdb75a90/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:30.647258 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f4257-31bc-46bb-8ebe-e46c91c03423 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:30.647623 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f4257-31bc-46bb-8ebe-e46c91c03423 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:30.647817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f4257-31bc-46bb-8ebe-e46c91c03423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:30.667454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-746f4257-31bc-46bb-8ebe-e46c91c03423 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:30.668693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-746f4257-31bc-46bb-8ebe-e46c91c03423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:30.735614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 895/1794] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:30.790197 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00443e-9348-4e38-870e-68604b4d443d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:30.795166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-dd00443e-9348-4e38-870e-68604b4d443d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:30.931454 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00443e-9348-4e38-870e-68604b4d443d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:30.937046 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b64084-fdf9-4226-b25c-8b6aef26d8c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:30.938005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b64084-fdf9-4226-b25c-8b6aef26d8c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:30.938124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b64084-fdf9-4226-b25c-8b6aef26d8c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:30.938449 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b64084-fdf9-4226-b25c-8b6aef26d8c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:30.951162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b64084-fdf9-4226-b25c-8b6aef26d8c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:30.953694 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b64084-fdf9-4226-b25c-8b6aef26d8c5 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:30.964719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 900/1795] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:33.407806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b623d4f-11ec-494a-8bf7-60bed218feda None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:33.408337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b623d4f-11ec-494a-8bf7-60bed218feda None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:33.408434 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b623d4f-11ec-494a-8bf7-60bed218feda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:33.471909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-2b623d4f-11ec-494a-8bf7-60bed218feda None None] MFA Rules not processed for user `cbd242c480d64904957d2ea6bdb75a90`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:33.473169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-2b623d4f-11ec-494a-8bf7-60bed218feda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:33.592886 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 896/1796] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:33 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:33.603489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b64084-fdf9-4226-b25c-8b6aef26d8c5 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:33.615158 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b64084-fdf9-4226-b25c-8b6aef26d8c5 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:33.629676 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13f26c-b579-446b-ae42-1caeb3b9e1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:33.630658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13f26c-b579-446b-ae42-1caeb3b9e1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:33.631243 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13f26c-b579-446b-ae42-1caeb3b9e1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:33.632314 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13f26c-b579-446b-ae42-1caeb3b9e1f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:33.633380 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13f26c-b579-446b-ae42-1caeb3b9e1f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:33.636701 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13f26c-b579-446b-ae42-1caeb3b9e1f6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:33.704938 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 901/1797] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:33 2021] POST /identity/v3/projects => generated 405 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:33.709636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b623d4f-11ec-494a-8bf7-60bed218feda None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:33.727544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b623d4f-11ec-494a-8bf7-60bed218feda None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:33.862033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08458d2b-ac3c-453d-9496-622d4a15309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:33.862725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08458d2b-ac3c-453d-9496-622d4a15309d admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:33.863318 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08458d2b-ac3c-453d-9496-622d4a15309d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:33.863491 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08458d2b-ac3c-453d-9496-622d4a15309d admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:33.864444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08458d2b-ac3c-453d-9496-622d4a15309d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:33.867223 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08458d2b-ac3c-453d-9496-622d4a15309d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:33.934333 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 897/1798] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:33 2021] POST /identity/v3/users => generated 309 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:33.935358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13f26c-b579-446b-ae42-1caeb3b9e1f6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:33.950617 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13f26c-b579-446b-ae42-1caeb3b9e1f6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:33.969822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206aa1b-bd97-4a2c-a1cd-bd9660435bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:33.973518 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206aa1b-bd97-4a2c-a1cd-bd9660435bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:33.974016 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206aa1b-bd97-4a2c-a1cd-bd9660435bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:33.975294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206aa1b-bd97-4a2c-a1cd-bd9660435bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:33.976610 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206aa1b-bd97-4a2c-a1cd-bd9660435bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:33.979959 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206aa1b-bd97-4a2c-a1cd-bd9660435bd2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:34.002155 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 902/1799] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:33 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:34.006043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08458d2b-ac3c-453d-9496-622d4a15309d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:34.018767 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08458d2b-ac3c-453d-9496-622d4a15309d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:34.025915 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59288ac1-adc8-4783-8d90-02b441acccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:34.027091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59288ac1-adc8-4783-8d90-02b441acccb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:34.027432 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59288ac1-adc8-4783-8d90-02b441acccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:34.028165 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59288ac1-adc8-4783-8d90-02b441acccb1 admin admin] PATH_INFO: `/v3/projects/528a7d5896d94969ac948585d646bcd5/users/3b02831b460d49388b0bca066e7bf61a/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:34.049853 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59288ac1-adc8-4783-8d90-02b441acccb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=528a7d5896d94969ac948585d646bcd5, user_id=3b02831b460d49388b0bca066e7bf61a, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:34.052808 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59288ac1-adc8-4783-8d90-02b441acccb1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:34.088258 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 898/1800] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:34 2021] PUT /identity/v3/projects/528a7d5896d94969ac948585d646bcd5/users/3b02831b460d49388b0bca066e7bf61a/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:34.093682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206aa1b-bd97-4a2c-a1cd-bd9660435bd2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:34.114987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206aa1b-bd97-4a2c-a1cd-bd9660435bd2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:34.255862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc1fb6-ad56-44a4-9bff-aeb1d9d42325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:34.255862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc1fb6-ad56-44a4-9bff-aeb1d9d42325 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:34.255862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc1fb6-ad56-44a4-9bff-aeb1d9d42325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:34.256340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc1fb6-ad56-44a4-9bff-aeb1d9d42325 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:34.257440 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc1fb6-ad56-44a4-9bff-aeb1d9d42325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:34.259381 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc1fb6-ad56-44a4-9bff-aeb1d9d42325 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:34.272693 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 903/1801] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:34 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:31:34.277388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59288ac1-adc8-4783-8d90-02b441acccb1 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:34.296128 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59288ac1-adc8-4783-8d90-02b441acccb1 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:34.311676 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5547cd-8935-4c02-b320-b1776013c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:34.314012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5547cd-8935-4c02-b320-b1776013c2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:34.314012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5547cd-8935-4c02-b320-b1776013c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:34.314012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5547cd-8935-4c02-b320-b1776013c2cc admin admin] PATH_INFO: `/v3/projects/528a7d5896d94969ac948585d646bcd5/users/3b02831b460d49388b0bca066e7bf61a/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:34.317315 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5547cd-8935-4c02-b320-b1776013c2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=528a7d5896d94969ac948585d646bcd5, user_id=3b02831b460d49388b0bca066e7bf61a, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:34.320047 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5547cd-8935-4c02-b320-b1776013c2cc admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:34.340899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 899/1802] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:34 2021] PUT /identity/v3/projects/528a7d5896d94969ac948585d646bcd5/users/3b02831b460d49388b0bca066e7bf61a/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:35.446348 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc1fb6-ad56-44a4-9bff-aeb1d9d42325 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:35.448178 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-23bc1fb6-ad56-44a4-9bff-aeb1d9d42325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:35.463479 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc1fb6-ad56-44a4-9bff-aeb1d9d42325 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:35.533620 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806bc3c-1124-496d-a2d3-168bc2748483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:35.534980 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806bc3c-1124-496d-a2d3-168bc2748483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:35.535471 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806bc3c-1124-496d-a2d3-168bc2748483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:35.535967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806bc3c-1124-496d-a2d3-168bc2748483 admin admin] PATH_INFO: `/v3/users/ad2d4b5b66ce418aa4f4495820e57d80` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:35.537659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806bc3c-1124-496d-a2d3-168bc2748483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2d4b5b66ce418aa4f4495820e57d80)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:35.540091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806bc3c-1124-496d-a2d3-168bc2748483 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:35.607289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7806bc3c-1124-496d-a2d3-168bc2748483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2d4b5b66ce418aa4f4495820e57d80'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:35.631191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7806bc3c-1124-496d-a2d3-168bc2748483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2d4b5b66ce418aa4f4495820e57d80'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:35.642878 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7806bc3c-1124-496d-a2d3-168bc2748483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2d4b5b66ce418aa4f4495820e57d80'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:35.653241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7806bc3c-1124-496d-a2d3-168bc2748483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2d4b5b66ce418aa4f4495820e57d80'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:35.658713 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7806bc3c-1124-496d-a2d3-168bc2748483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2d4b5b66ce418aa4f4495820e57d80'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:35.679875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 904/1803] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:35 2021] DELETE /identity/v3/users/ad2d4b5b66ce418aa4f4495820e57d80 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:35.680568 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d95a45-cb02-47d8-9fbe-08ecb2e92f3f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:35.681037 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d95a45-cb02-47d8-9fbe-08ecb2e92f3f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:35.681145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d95a45-cb02-47d8-9fbe-08ecb2e92f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:35.704246 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a8d95a45-cb02-47d8-9fbe-08ecb2e92f3f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:35.705551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a8d95a45-cb02-47d8-9fbe-08ecb2e92f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:35.860725 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea649d3e-b842-4db7-b517-c2deea9f3e52 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:35.861034 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea649d3e-b842-4db7-b517-c2deea9f3e52 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:35.861319 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea649d3e-b842-4db7-b517-c2deea9f3e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:35.883633 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 900/1804] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:31:35.910626 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d95a45-cb02-47d8-9fbe-08ecb2e92f3f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:35.912189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a8d95a45-cb02-47d8-9fbe-08ecb2e92f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:35.915344 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-ea649d3e-b842-4db7-b517-c2deea9f3e52 None None] MFA Rules not processed for user `3b02831b460d49388b0bca066e7bf61a`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:35.916660 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-ea649d3e-b842-4db7-b517-c2deea9f3e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:36.115100 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d95a45-cb02-47d8-9fbe-08ecb2e92f3f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:36.124102 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e24a8-581b-45b1-8a81-bb0a1d855592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:36.124762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e24a8-581b-45b1-8a81-bb0a1d855592 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:36.125692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e24a8-581b-45b1-8a81-bb0a1d855592 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:36.125692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e24a8-581b-45b1-8a81-bb0a1d855592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:36.154544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 905/1805] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:35 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:36.158930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e24a8-581b-45b1-8a81-bb0a1d855592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:36.162244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e24a8-581b-45b1-8a81-bb0a1d855592 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:36.178172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 901/1806] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:36.207902 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea649d3e-b842-4db7-b517-c2deea9f3e52 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:36.209159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-ea649d3e-b842-4db7-b517-c2deea9f3e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:36.223382 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea649d3e-b842-4db7-b517-c2deea9f3e52 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:36.233181 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e7d97-79bf-4ee8-8af0-0485c03a2cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:36.234285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e7d97-79bf-4ee8-8af0-0485c03a2cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:36.235403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e7d97-79bf-4ee8-8af0-0485c03a2cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:36.236068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e7d97-79bf-4ee8-8af0-0485c03a2cd0 admin admin] PATH_INFO: `/v3/users/dabc46dbef2f4436af389136d33306a5` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:36.245680 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e7d97-79bf-4ee8-8af0-0485c03a2cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabc46dbef2f4436af389136d33306a5)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:36.247776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e7d97-79bf-4ee8-8af0-0485c03a2cd0 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:36.353986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-289e7d97-79bf-4ee8-8af0-0485c03a2cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabc46dbef2f4436af389136d33306a5'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:36.371217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-289e7d97-79bf-4ee8-8af0-0485c03a2cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabc46dbef2f4436af389136d33306a5'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:36.396619 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-289e7d97-79bf-4ee8-8af0-0485c03a2cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabc46dbef2f4436af389136d33306a5'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:36.434955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-289e7d97-79bf-4ee8-8af0-0485c03a2cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabc46dbef2f4436af389136d33306a5'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:36.436991 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-289e7d97-79bf-4ee8-8af0-0485c03a2cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabc46dbef2f4436af389136d33306a5'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:36.457057 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 906/1807] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:36 2021] DELETE /identity/v3/users/dabc46dbef2f4436af389136d33306a5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:36.459303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717722f-1ea0-4efc-8742-fc73fc098981 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:36.459757 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717722f-1ea0-4efc-8742-fc73fc098981 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:36.460196 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717722f-1ea0-4efc-8742-fc73fc098981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:36.491914 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-d717722f-1ea0-4efc-8742-fc73fc098981 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:36.493391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-d717722f-1ea0-4efc-8742-fc73fc098981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:36.590479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 902/1808] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:36.661599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e7d97-79bf-4ee8-8af0-0485c03a2cd0 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:36.663562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-289e7d97-79bf-4ee8-8af0-0485c03a2cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:36.770221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e7d97-79bf-4ee8-8af0-0485c03a2cd0 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:36.776067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1be7c2-9b45-48e3-8346-3fed01279414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:36.776754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1be7c2-9b45-48e3-8346-3fed01279414 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:36.777115 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1be7c2-9b45-48e3-8346-3fed01279414 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:36.777895 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1be7c2-9b45-48e3-8346-3fed01279414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:36.789628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1be7c2-9b45-48e3-8346-3fed01279414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:36.791371 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1be7c2-9b45-48e3-8346-3fed01279414 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:36.806717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 907/1809] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:37.762348 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468cbe3-0466-439a-9bd2-c2463481a168 None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:37.763094 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468cbe3-0466-439a-9bd2-c2463481a168 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:37.763566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468cbe3-0466-439a-9bd2-c2463481a168 None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:37.765783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 903/1810] 10.222.0.60 () {54 vars in 921 bytes} [Wed Dec 15 13:31:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:37.780249 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229b26c-4afe-4f14-8e4c-3b2f1a970b47 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:37.780850 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229b26c-4afe-4f14-8e4c-3b2f1a970b47 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:37.780850 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229b26c-4afe-4f14-8e4c-3b2f1a970b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:37.813836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-e229b26c-4afe-4f14-8e4c-3b2f1a970b47 None None] MFA Rules not processed for user `d61a8e4d64664e68a5710fdf766e4685`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:37.819035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e229b26c-4afe-4f14-8e4c-3b2f1a970b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:37.864080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468cbe3-0466-439a-9bd2-c2463481a168 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:37.866709 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c468cbe3-0466-439a-9bd2-c2463481a168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:37.898550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468cbe3-0466-439a-9bd2-c2463481a168 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:37.914488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:37.915716 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:37.916006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:37.916286 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] PATH_INFO: `/v3/projects/4a824af5676f4923a681dd81d2757134` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:37.922041 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a824af5676f4923a681dd81d2757134)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:37.924468 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:38.017043 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 908/1811] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Dec 15 13:31:37 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:38.019471 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229b26c-4afe-4f14-8e4c-3b2f1a970b47 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:38.021502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e229b26c-4afe-4f14-8e4c-3b2f1a970b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:38.052589 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a824af5676f4923a681dd81d2757134', 'request_id': 'req-67feb46c-3735-49b6-b3e3-aab0713db56f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.061476 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229b26c-4afe-4f14-8e4c-3b2f1a970b47 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:38.065395 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a824af5676f4923a681dd81d2757134', 'request_id': 'req-67feb46c-3735-49b6-b3e3-aab0713db56f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.073498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a824af5676f4923a681dd81d2757134', 'request_id': 'req-67feb46c-3735-49b6-b3e3-aab0713db56f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.090628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] The token cache is being invalidate because project 4a824af5676f4923a681dd81d2757134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:38.091671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.091800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.096794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 904/1812] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:37 2021] DELETE /identity/v3/projects/4a824af5676f4923a681dd81d2757134 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:38.096794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:38.099065 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:38.167728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:38.169826 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:38.170213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:38.170739 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] PATH_INFO: `/v3/projects/a5486b44a6984b56bf8849039d56f6d1` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:38.172191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5486b44a6984b56bf8849039d56f6d1)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:38.174303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:38.235597 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5486b44a6984b56bf8849039d56f6d1', 'request_id': 'req-85696de7-a1b4-495a-bd69-76472edc3508'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.246738 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5486b44a6984b56bf8849039d56f6d1', 'request_id': 'req-85696de7-a1b4-495a-bd69-76472edc3508'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.256165 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5486b44a6984b56bf8849039d56f6d1', 'request_id': 'req-85696de7-a1b4-495a-bd69-76472edc3508'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.259904 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feb46c-3735-49b6-b3e3-aab0713db56f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:38.270649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] The token cache is being invalidate because project a5486b44a6984b56bf8849039d56f6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:38.270649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.271824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.275364 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 909/1813] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:38 2021] DELETE /identity/v3/projects/a5486b44a6984b56bf8849039d56f6d1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:38.276404 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:38.278095 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:38.393808 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85696de7-a1b4-495a-bd69-76472edc3508 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:38.399549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01274d5-2816-43a8-8c42-3e1170419658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:38.401640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01274d5-2816-43a8-8c42-3e1170419658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:38.401640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01274d5-2816-43a8-8c42-3e1170419658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:38.401640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01274d5-2816-43a8-8c42-3e1170419658 admin admin] PATH_INFO: `/v3/users/84cb54276e55470c88a0625b4d950585` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:38.403282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01274d5-2816-43a8-8c42-3e1170419658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84cb54276e55470c88a0625b4d950585)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:38.405361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01274d5-2816-43a8-8c42-3e1170419658 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:38.419946 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cecc25-250b-416a-9dd0-8bbe9e46bf8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:38.420622 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cecc25-250b-416a-9dd0-8bbe9e46bf8d service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:38.420911 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cecc25-250b-416a-9dd0-8bbe9e46bf8d service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:38.421193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cecc25-250b-416a-9dd0-8bbe9e46bf8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:38.427747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-10cecc25-250b-416a-9dd0-8bbe9e46bf8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:38.452706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cecc25-250b-416a-9dd0-8bbe9e46bf8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:38.458303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cecc25-250b-416a-9dd0-8bbe9e46bf8d service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:38.474201 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b01274d5-2816-43a8-8c42-3e1170419658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84cb54276e55470c88a0625b4d950585'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.481369 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 905/1814] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:38.482271 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cecc25-250b-416a-9dd0-8bbe9e46bf8d service nova] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:38.485345 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-10cecc25-250b-416a-9dd0-8bbe9e46bf8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:38.518285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cecc25-250b-416a-9dd0-8bbe9e46bf8d service nova] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:38.523597 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b01274d5-2816-43a8-8c42-3e1170419658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84cb54276e55470c88a0625b4d950585'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.526111 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0480bd-7be2-4f82-9332-94a29adc03e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:38.526766 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0480bd-7be2-4f82-9332-94a29adc03e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:38.527093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0480bd-7be2-4f82-9332-94a29adc03e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:38.527478 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0480bd-7be2-4f82-9332-94a29adc03e4 admin admin] PATH_INFO: `/v3/users/afb2a6fed6364c4bab075a6c7d37a63c` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:38.529038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0480bd-7be2-4f82-9332-94a29adc03e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb2a6fed6364c4bab075a6c7d37a63c)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:38.532283 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0480bd-7be2-4f82-9332-94a29adc03e4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:38.536413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b01274d5-2816-43a8-8c42-3e1170419658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84cb54276e55470c88a0625b4d950585'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.555701 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b01274d5-2816-43a8-8c42-3e1170419658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84cb54276e55470c88a0625b4d950585'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.557265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b01274d5-2816-43a8-8c42-3e1170419658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84cb54276e55470c88a0625b4d950585'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.589129 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 910/1815] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:38 2021] DELETE /identity/v3/users/84cb54276e55470c88a0625b4d950585 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:38.601137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4f0480bd-7be2-4f82-9332-94a29adc03e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb2a6fed6364c4bab075a6c7d37a63c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.634062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01274d5-2816-43a8-8c42-3e1170419658 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:38.636340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b01274d5-2816-43a8-8c42-3e1170419658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:38.643523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4f0480bd-7be2-4f82-9332-94a29adc03e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb2a6fed6364c4bab075a6c7d37a63c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.659276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4f0480bd-7be2-4f82-9332-94a29adc03e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb2a6fed6364c4bab075a6c7d37a63c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.675907 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4f0480bd-7be2-4f82-9332-94a29adc03e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb2a6fed6364c4bab075a6c7d37a63c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.676672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4f0480bd-7be2-4f82-9332-94a29adc03e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb2a6fed6364c4bab075a6c7d37a63c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.692948 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 906/1816] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:38 2021] DELETE /identity/v3/users/afb2a6fed6364c4bab075a6c7d37a63c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:38.793196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01274d5-2816-43a8-8c42-3e1170419658 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:38.862992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537a81d-c08d-407d-8e25-2ae0f29aa0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:38.863981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537a81d-c08d-407d-8e25-2ae0f29aa0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:38.864281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537a81d-c08d-407d-8e25-2ae0f29aa0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:38.864585 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537a81d-c08d-407d-8e25-2ae0f29aa0ca admin admin] PATH_INFO: `/v3/users/cbd242c480d64904957d2ea6bdb75a90` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:38.865873 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537a81d-c08d-407d-8e25-2ae0f29aa0ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd242c480d64904957d2ea6bdb75a90)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:38.867941 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537a81d-c08d-407d-8e25-2ae0f29aa0ca admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:38.928149 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7537a81d-c08d-407d-8e25-2ae0f29aa0ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd242c480d64904957d2ea6bdb75a90'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.948581 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7537a81d-c08d-407d-8e25-2ae0f29aa0ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd242c480d64904957d2ea6bdb75a90'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.960559 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7537a81d-c08d-407d-8e25-2ae0f29aa0ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd242c480d64904957d2ea6bdb75a90'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.976497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7537a81d-c08d-407d-8e25-2ae0f29aa0ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd242c480d64904957d2ea6bdb75a90'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.980768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7537a81d-c08d-407d-8e25-2ae0f29aa0ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd242c480d64904957d2ea6bdb75a90'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:38.989250 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 911/1817] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:38 2021] DELETE /identity/v3/users/cbd242c480d64904957d2ea6bdb75a90 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:39.550168 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0480bd-7be2-4f82-9332-94a29adc03e4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:39.552631 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4f0480bd-7be2-4f82-9332-94a29adc03e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:39.568863 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0480bd-7be2-4f82-9332-94a29adc03e4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:39.669340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:39.672524 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:39.673307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:39.673823 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] PATH_INFO: `/v3/projects/2eca06c9f13e4bd4ba60e90004b92c21` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:39.676010 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eca06c9f13e4bd4ba60e90004b92c21)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:39.678207 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:39.735316 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eca06c9f13e4bd4ba60e90004b92c21', 'request_id': 'req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.743188 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eca06c9f13e4bd4ba60e90004b92c21', 'request_id': 'req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.748897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eca06c9f13e4bd4ba60e90004b92c21', 'request_id': 'req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.760680 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] The token cache is being invalidate because project 2eca06c9f13e4bd4ba60e90004b92c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:39.760967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.761660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.763394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 907/1818] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:39 2021] DELETE /identity/v3/projects/2eca06c9f13e4bd4ba60e90004b92c21 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:39.767933 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537a81d-c08d-407d-8e25-2ae0f29aa0ca admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:39.769365 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-7537a81d-c08d-407d-8e25-2ae0f29aa0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:39.782012 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537a81d-c08d-407d-8e25-2ae0f29aa0ca admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:39.794197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:39.795861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:39.845578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e151b-73af-437f-a9c8-baecee34b14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:39.846692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e151b-73af-437f-a9c8-baecee34b14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:39.847162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e151b-73af-437f-a9c8-baecee34b14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:39.847541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e151b-73af-437f-a9c8-baecee34b14e admin admin] PATH_INFO: `/v3/users/3b02831b460d49388b0bca066e7bf61a` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:39.848742 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e151b-73af-437f-a9c8-baecee34b14e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b02831b460d49388b0bca066e7bf61a)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:39.850768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e151b-73af-437f-a9c8-baecee34b14e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:39.874304 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb2b8b-dff6-49bd-82c2-2ff1c47761de admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:39.881973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f1931-49ab-4ec9-b797-7e365987fc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:39.884125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f1931-49ab-4ec9-b797-7e365987fc6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:39.884549 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f1931-49ab-4ec9-b797-7e365987fc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:39.884956 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f1931-49ab-4ec9-b797-7e365987fc6c admin admin] PATH_INFO: `/v3/projects/6cea6d1158cf4580a7e96deb27ff30ee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:39.886580 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f1931-49ab-4ec9-b797-7e365987fc6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cea6d1158cf4580a7e96deb27ff30ee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:39.889004 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f1931-49ab-4ec9-b797-7e365987fc6c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:39.918102 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f71e151b-73af-437f-a9c8-baecee34b14e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b02831b460d49388b0bca066e7bf61a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.930200 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f71e151b-73af-437f-a9c8-baecee34b14e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b02831b460d49388b0bca066e7bf61a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.937922 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f71e151b-73af-437f-a9c8-baecee34b14e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b02831b460d49388b0bca066e7bf61a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.941638 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-be8f1931-49ab-4ec9-b797-7e365987fc6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cea6d1158cf4580a7e96deb27ff30ee', 'request_id': 'req-be8f1931-49ab-4ec9-b797-7e365987fc6c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.946610 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f71e151b-73af-437f-a9c8-baecee34b14e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b02831b460d49388b0bca066e7bf61a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.947396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f71e151b-73af-437f-a9c8-baecee34b14e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b02831b460d49388b0bca066e7bf61a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.948289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-be8f1931-49ab-4ec9-b797-7e365987fc6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cea6d1158cf4580a7e96deb27ff30ee', 'request_id': 'req-be8f1931-49ab-4ec9-b797-7e365987fc6c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.954826 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-be8f1931-49ab-4ec9-b797-7e365987fc6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cea6d1158cf4580a7e96deb27ff30ee', 'request_id': 'req-be8f1931-49ab-4ec9-b797-7e365987fc6c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.956390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 912/1819] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:39 2021] DELETE /identity/v3/users/3b02831b460d49388b0bca066e7bf61a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:39.957373 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e151b-73af-437f-a9c8-baecee34b14e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:39.958589 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-f71e151b-73af-437f-a9c8-baecee34b14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:39.975166 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-be8f1931-49ab-4ec9-b797-7e365987fc6c admin admin] The token cache is being invalidate because project 6cea6d1158cf4580a7e96deb27ff30ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:39.975462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-be8f1931-49ab-4ec9-b797-7e365987fc6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.976142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-be8f1931-49ab-4ec9-b797-7e365987fc6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:39.978169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 908/1820] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:39 2021] DELETE /identity/v3/projects/6cea6d1158cf4580a7e96deb27ff30ee => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:39.983884 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d60e-ddb2-4d77-9afd-bb30e376b58e None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:39.984181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d60e-ddb2-4d77-9afd-bb30e376b58e None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:39.984470 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d60e-ddb2-4d77-9afd-bb30e376b58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.003881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-0fe5d60e-ddb2-4d77-9afd-bb30e376b58e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:40.005087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0fe5d60e-ddb2-4d77-9afd-bb30e376b58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:40.035425 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e151b-73af-437f-a9c8-baecee34b14e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.040576 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89601b-664d-494f-b30f-c351e96a8e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.041651 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89601b-664d-494f-b30f-c351e96a8e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.042205 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89601b-664d-494f-b30f-c351e96a8e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.042508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89601b-664d-494f-b30f-c351e96a8e19 admin admin] PATH_INFO: `/v3/projects/a33cdf9013d440b2af0eb5670c1ea64e` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.044009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89601b-664d-494f-b30f-c351e96a8e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a33cdf9013d440b2af0eb5670c1ea64e)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:40.046508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89601b-664d-494f-b30f-c351e96a8e19 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:40.095175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 909/1821] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:40.104560 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2e46-46f2-440a-af2a-ff291be45c3f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.104880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2e46-46f2-440a-af2a-ff291be45c3f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.105137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2e46-46f2-440a-af2a-ff291be45c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.108214 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5a89601b-664d-494f-b30f-c351e96a8e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a33cdf9013d440b2af0eb5670c1ea64e', 'request_id': 'req-5a89601b-664d-494f-b30f-c351e96a8e19'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:40.128253 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5a89601b-664d-494f-b30f-c351e96a8e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a33cdf9013d440b2af0eb5670c1ea64e', 'request_id': 'req-5a89601b-664d-494f-b30f-c351e96a8e19'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:40.135593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5a89601b-664d-494f-b30f-c351e96a8e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a33cdf9013d440b2af0eb5670c1ea64e', 'request_id': 'req-5a89601b-664d-494f-b30f-c351e96a8e19'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:40.138069 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-fbeb2e46-46f2-440a-af2a-ff291be45c3f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:40.139508 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-fbeb2e46-46f2-440a-af2a-ff291be45c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:40.147505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5a89601b-664d-494f-b30f-c351e96a8e19 admin admin] The token cache is being invalidate because project a33cdf9013d440b2af0eb5670c1ea64e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:40.148426 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5a89601b-664d-494f-b30f-c351e96a8e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:40.149136 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5a89601b-664d-494f-b30f-c351e96a8e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:40.155745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 913/1822] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:39 2021] DELETE /identity/v3/projects/a33cdf9013d440b2af0eb5670c1ea64e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:40.157311 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9a1f2-6287-413c-82cb-e4a5b5fe61e8 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.157604 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9a1f2-6287-413c-82cb-e4a5b5fe61e8 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.157885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9a1f2-6287-413c-82cb-e4a5b5fe61e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.177839 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b5b9a1f2-6287-413c-82cb-e4a5b5fe61e8 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:40.179139 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b5b9a1f2-6287-413c-82cb-e4a5b5fe61e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:40.214582 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 910/1823] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:31:40.218483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2e46-46f2-440a-af2a-ff291be45c3f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:40.230614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2e46-46f2-440a-af2a-ff291be45c3f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.237990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180c334-b45f-4b42-8bf9-e8ffcfb396b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.238750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180c334-b45f-4b42-8bf9-e8ffcfb396b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.239135 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180c334-b45f-4b42-8bf9-e8ffcfb396b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.239489 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180c334-b45f-4b42-8bf9-e8ffcfb396b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.240487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180c334-b45f-4b42-8bf9-e8ffcfb396b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:40.240874 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180c334-b45f-4b42-8bf9-e8ffcfb396b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:40.242584 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180c334-b45f-4b42-8bf9-e8ffcfb396b6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:40.256809 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 914/1824] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:40.262319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 911/1825] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:31:40.271595 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9a1f2-6287-413c-82cb-e4a5b5fe61e8 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:40.275769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508183eb-fdcd-4e79-a580-83bb866c5295 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.278161 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508183eb-fdcd-4e79-a580-83bb866c5295 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.280519 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508183eb-fdcd-4e79-a580-83bb866c5295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.290245 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9a1f2-6287-413c-82cb-e4a5b5fe61e8 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.295875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767975f5-3d5e-4198-a0fc-6b481331afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.296809 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767975f5-3d5e-4198-a0fc-6b481331afdb admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.297198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767975f5-3d5e-4198-a0fc-6b481331afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.298137 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767975f5-3d5e-4198-a0fc-6b481331afdb admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.299071 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767975f5-3d5e-4198-a0fc-6b481331afdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:40.301139 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767975f5-3d5e-4198-a0fc-6b481331afdb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:40.309332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-508183eb-fdcd-4e79-a580-83bb866c5295 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:40.311203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-508183eb-fdcd-4e79-a580-83bb866c5295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:40.328444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 912/1826] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:40.329750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508183eb-fdcd-4e79-a580-83bb866c5295 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:40.334127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 915/1827] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:40 2021] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:40.340462 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767975f5-3d5e-4198-a0fc-6b481331afdb admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:40.345751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508183eb-fdcd-4e79-a580-83bb866c5295 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.433446 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e153f0-23dd-4f6b-9246-8277a713120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.434380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e153f0-23dd-4f6b-9246-8277a713120b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.434380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e153f0-23dd-4f6b-9246-8277a713120b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.434655 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e153f0-23dd-4f6b-9246-8277a713120b admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.435446 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e153f0-23dd-4f6b-9246-8277a713120b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:40.435849 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e153f0-23dd-4f6b-9246-8277a713120b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:40.438174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e153f0-23dd-4f6b-9246-8277a713120b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:40.438879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767975f5-3d5e-4198-a0fc-6b481331afdb admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.448796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92704bac-7e40-4844-a58f-7d01240634d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.449850 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704bac-7e40-4844-a58f-7d01240634d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.450138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704bac-7e40-4844-a58f-7d01240634d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.450417 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704bac-7e40-4844-a58f-7d01240634d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.451985 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92704bac-7e40-4844-a58f-7d01240634d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:40.452698 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 913/1828] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:31:40.453566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e153f0-23dd-4f6b-9246-8277a713120b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:40.459082 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92704bac-7e40-4844-a58f-7d01240634d1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:40.459253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-49e153f0-23dd-4f6b-9246-8277a713120b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:40.473230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e153f0-23dd-4f6b-9246-8277a713120b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.482066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.483025 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.483313 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.483594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] PATH_INFO: `/v3/projects/528a7d5896d94969ac948585d646bcd5` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.485350 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=528a7d5896d94969ac948585d646bcd5)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:40.486913 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:40.496858 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 916/1829] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:40 2021] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:40.497743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92704bac-7e40-4844-a58f-7d01240634d1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:40.528110 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92704bac-7e40-4844-a58f-7d01240634d1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.544279 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea243889-5369-4589-97f1-7b4fd6ce4ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.545267 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea243889-5369-4589-97f1-7b4fd6ce4ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.545729 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea243889-5369-4589-97f1-7b4fd6ce4ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.546154 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea243889-5369-4589-97f1-7b4fd6ce4ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.547157 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea243889-5369-4589-97f1-7b4fd6ce4ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:40.549594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea243889-5369-4589-97f1-7b4fd6ce4ec1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:40.556191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '528a7d5896d94969ac948585d646bcd5', 'request_id': 'req-573e2c47-6446-42b3-bb5e-fc2978203357'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:40.567257 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '528a7d5896d94969ac948585d646bcd5', 'request_id': 'req-573e2c47-6446-42b3-bb5e-fc2978203357'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:40.575074 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '528a7d5896d94969ac948585d646bcd5', 'request_id': 'req-573e2c47-6446-42b3-bb5e-fc2978203357'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:40.593150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] The token cache is being invalidate because project 528a7d5896d94969ac948585d646bcd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:40.593676 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:40.594693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:40.601183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 914/1830] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:40 2021] DELETE /identity/v3/projects/528a7d5896d94969ac948585d646bcd5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:40.608198 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:40.608659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 917/1831] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:40 2021] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:40.610976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b26b6-b0dc-4773-8d09-f907511c73bf None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.611450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b26b6-b0dc-4773-8d09-f907511c73bf None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.611907 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b26b6-b0dc-4773-8d09-f907511c73bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.614176 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:40.646581 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-651b26b6-b0dc-4773-8d09-f907511c73bf None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:40.648175 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-651b26b6-b0dc-4773-8d09-f907511c73bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:40.712343 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e2c47-6446-42b3-bb5e-fc2978203357 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.753570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 918/1832] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:40.754523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b26b6-b0dc-4773-8d09-f907511c73bf None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:40.755919 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-651b26b6-b0dc-4773-8d09-f907511c73bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:40.769126 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b26b6-b0dc-4773-8d09-f907511c73bf None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.775213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69137eff-a3f3-4cec-87d1-cabd4549f0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.775976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69137eff-a3f3-4cec-87d1-cabd4549f0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.776300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69137eff-a3f3-4cec-87d1-cabd4549f0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.777038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69137eff-a3f3-4cec-87d1-cabd4549f0c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.777288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69137eff-a3f3-4cec-87d1-cabd4549f0c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:40.779377 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69137eff-a3f3-4cec-87d1-cabd4549f0c9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:40.800334 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f633c-8c7d-43fb-941f-d6eb42300232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.801479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f633c-8c7d-43fb-941f-d6eb42300232 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.801969 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f633c-8c7d-43fb-941f-d6eb42300232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.802565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f633c-8c7d-43fb-941f-d6eb42300232 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.803613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f633c-8c7d-43fb-941f-d6eb42300232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:40.804125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 919/1833] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:40 2021] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:40.805711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ecf2f-feb1-4214-884a-40c6811da6c9 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.805914 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f633c-8c7d-43fb-941f-d6eb42300232 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:40.806025 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ecf2f-feb1-4214-884a-40c6811da6c9 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.806281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ecf2f-feb1-4214-884a-40c6811da6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.819532 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 915/1834] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:40 2021] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:40.820818 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f633c-8c7d-43fb-941f-d6eb42300232 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:40.832443 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-5b8ecf2f-feb1-4214-884a-40c6811da6c9 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:40.833307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f633c-8c7d-43fb-941f-d6eb42300232 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.834247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5b8ecf2f-feb1-4214-884a-40c6811da6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:40.839342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dde34-d430-42c0-b3f2-731540f677a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.840264 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dde34-d430-42c0-b3f2-731540f677a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.840890 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dde34-d430-42c0-b3f2-731540f677a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.841696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dde34-d430-42c0-b3f2-731540f677a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.842708 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530dde34-d430-42c0-b3f2-731540f677a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:40.843884 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 920/1835] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:40.844846 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ecf2f-feb1-4214-884a-40c6811da6c9 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:40.845458 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530dde34-d430-42c0-b3f2-731540f677a4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:40.857181 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ecf2f-feb1-4214-884a-40c6811da6c9 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.859437 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 916/1836] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:40 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:40.860751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dde34-d430-42c0-b3f2-731540f677a4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:40.864368 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9959185-7a72-4733-8fbc-0473ac7ce05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.865184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9959185-7a72-4733-8fbc-0473ac7ce05c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.865557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9959185-7a72-4733-8fbc-0473ac7ce05c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.865911 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9959185-7a72-4733-8fbc-0473ac7ce05c admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.866840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9959185-7a72-4733-8fbc-0473ac7ce05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:40.868821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9959185-7a72-4733-8fbc-0473ac7ce05c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:40.874583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dde34-d430-42c0-b3f2-731540f677a4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.884130 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb50b7-e1fc-4148-bf00-c34c1fb9189f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.885209 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb50b7-e1fc-4148-bf00-c34c1fb9189f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.885875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb50b7-e1fc-4148-bf00-c34c1fb9189f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.886465 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb50b7-e1fc-4148-bf00-c34c1fb9189f admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.889450 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb50b7-e1fc-4148-bf00-c34c1fb9189f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:40.890123 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb50b7-e1fc-4148-bf00-c34c1fb9189f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:40.894491 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb50b7-e1fc-4148-bf00-c34c1fb9189f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:40.895306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 921/1837] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:40 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:40.896186 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9959185-7a72-4733-8fbc-0473ac7ce05c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:40.917049 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9959185-7a72-4733-8fbc-0473ac7ce05c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.925081 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 917/1838] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:31:40.925081 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb50b7-e1fc-4148-bf00-c34c1fb9189f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:40.933476 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175aabe-fa00-4f23-8adf-797491cc9b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.934319 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175aabe-fa00-4f23-8adf-797491cc9b3e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.934891 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175aabe-fa00-4f23-8adf-797491cc9b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.936932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175aabe-fa00-4f23-8adf-797491cc9b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.937778 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175aabe-fa00-4f23-8adf-797491cc9b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:40.940571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175aabe-fa00-4f23-8adf-797491cc9b3e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:40.949226 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb50b7-e1fc-4148-bf00-c34c1fb9189f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.959943 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c762de-9eba-47ae-9eed-2a7998107be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.962093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c762de-9eba-47ae-9eed-2a7998107be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.963807 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c762de-9eba-47ae-9eed-2a7998107be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.964180 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c762de-9eba-47ae-9eed-2a7998107be3 admin admin] PATH_INFO: `/v3/projects/972e572ef76e4996b44d638a4591cefd/users/0ebf53ae3152491097f130e2862f03a5/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.965563 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 922/1839] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:40 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:40.966668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175aabe-fa00-4f23-8adf-797491cc9b3e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:40.986434 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175aabe-fa00-4f23-8adf-797491cc9b3e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:40.992547 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194cc4-d786-481e-9066-950b654fc0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:40.993314 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194cc4-d786-481e-9066-950b654fc0ca admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:40.993667 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194cc4-d786-481e-9066-950b654fc0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:40.994033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194cc4-d786-481e-9066-950b654fc0ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:40.995488 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f194cc4-d786-481e-9066-950b654fc0ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:40.997496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f194cc4-d786-481e-9066-950b654fc0ca admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:40.997821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c762de-9eba-47ae-9eed-2a7998107be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972e572ef76e4996b44d638a4591cefd, user_id=0ebf53ae3152491097f130e2862f03a5, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.005260 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c762de-9eba-47ae-9eed-2a7998107be3 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.029907 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 923/1841] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:40 2021] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:41.030923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194cc4-d786-481e-9066-950b654fc0ca admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.038277 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 918/1841] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:40 2021] PUT /identity/v3/projects/972e572ef76e4996b44d638a4591cefd/users/0ebf53ae3152491097f130e2862f03a5/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:41.040091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c762de-9eba-47ae-9eed-2a7998107be3 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.116159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194cc4-d786-481e-9066-950b654fc0ca admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.120917 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ae891-690a-4b34-839b-e3f51f4871cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.121804 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ae891-690a-4b34-839b-e3f51f4871cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.122080 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ae891-690a-4b34-839b-e3f51f4871cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.122352 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ae891-690a-4b34-839b-e3f51f4871cb admin admin] PATH_INFO: `/v3/projects/b14ce8dcc8fc4757bfa656801a3408bc/users/87270b3140734af785c48b0f68295dc6/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.129813 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c762de-9eba-47ae-9eed-2a7998107be3 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.135361 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bace0-3d1d-4873-bc3c-04360e1bc9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.136294 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bace0-3d1d-4873-bc3c-04360e1bc9bb admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.136294 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bace0-3d1d-4873-bc3c-04360e1bc9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.136590 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bace0-3d1d-4873-bc3c-04360e1bc9bb admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.137273 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bace0-3d1d-4873-bc3c-04360e1bc9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.138699 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ae891-690a-4b34-839b-e3f51f4871cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14ce8dcc8fc4757bfa656801a3408bc, user_id=87270b3140734af785c48b0f68295dc6, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.139237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bace0-3d1d-4873-bc3c-04360e1bc9bb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.141825 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ae891-690a-4b34-839b-e3f51f4871cb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.157549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 924/1842] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:41 2021] PUT /identity/v3/projects/b14ce8dcc8fc4757bfa656801a3408bc/users/87270b3140734af785c48b0f68295dc6/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:41.159100 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae45a5-6cf4-4ad6-812b-68430a3cb37c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.159392 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae45a5-6cf4-4ad6-812b-68430a3cb37c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.159673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae45a5-6cf4-4ad6-812b-68430a3cb37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.172184 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 919/1843] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:41 2021] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:41.174774 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f716c-c211-4ef6-9a97-fe3ad6a89476 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.175096 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f716c-c211-4ef6-9a97-fe3ad6a89476 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.175375 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f716c-c211-4ef6-9a97-fe3ad6a89476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.193946 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b3ae45a5-6cf4-4ad6-812b-68430a3cb37c None None] MFA Rules not processed for user `0ebf53ae3152491097f130e2862f03a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:41.195302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b3ae45a5-6cf4-4ad6-812b-68430a3cb37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:41.202681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ad7f716c-c211-4ef6-9a97-fe3ad6a89476 None None] MFA Rules not processed for user `87270b3140734af785c48b0f68295dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:41.204086 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ad7f716c-c211-4ef6-9a97-fe3ad6a89476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:41.264342 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 925/1844] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:41 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:41.268050 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae45a5-6cf4-4ad6-812b-68430a3cb37c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.283870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 920/1845] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:41 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:41.283870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f716c-c211-4ef6-9a97-fe3ad6a89476 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.351956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae45a5-6cf4-4ad6-812b-68430a3cb37c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.356974 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a82bfd-59a5-4699-9fa3-73e3c59513ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.357647 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a82bfd-59a5-4699-9fa3-73e3c59513ad admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.357934 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a82bfd-59a5-4699-9fa3-73e3c59513ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.358241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a82bfd-59a5-4699-9fa3-73e3c59513ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.359029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a82bfd-59a5-4699-9fa3-73e3c59513ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.361425 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a82bfd-59a5-4699-9fa3-73e3c59513ad admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.373837 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f716c-c211-4ef6-9a97-fe3ad6a89476 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.376356 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 926/1846] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:41.377282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a82bfd-59a5-4699-9fa3-73e3c59513ad admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.381902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61e3f2-ffcd-439a-a9d7-4ec471808180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.382572 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61e3f2-ffcd-439a-a9d7-4ec471808180 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.382888 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61e3f2-ffcd-439a-a9d7-4ec471808180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.383251 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61e3f2-ffcd-439a-a9d7-4ec471808180 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.384217 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61e3f2-ffcd-439a-a9d7-4ec471808180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.387573 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61e3f2-ffcd-439a-a9d7-4ec471808180 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.389566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a82bfd-59a5-4699-9fa3-73e3c59513ad admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.396031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a8b63-d148-4314-86a8-b686b175686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.396937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8b63-d148-4314-86a8-b686b175686e admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.397782 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8b63-d148-4314-86a8-b686b175686e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.398473 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8b63-d148-4314-86a8-b686b175686e admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.400098 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a8b63-d148-4314-86a8-b686b175686e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.402590 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a8b63-d148-4314-86a8-b686b175686e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.416909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 921/1847] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:41 2021] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:41.417985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61e3f2-ffcd-439a-a9d7-4ec471808180 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.448698 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 927/1848] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:41 2021] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:41.452955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a8b63-d148-4314-86a8-b686b175686e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.489748 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61e3f2-ffcd-439a-a9d7-4ec471808180 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.520388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a8b63-d148-4314-86a8-b686b175686e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.526295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce7101-eda5-4cf0-99ed-3ad361ecc87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.527006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce7101-eda5-4cf0-99ed-3ad361ecc87a admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.527298 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce7101-eda5-4cf0-99ed-3ad361ecc87a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.527582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce7101-eda5-4cf0-99ed-3ad361ecc87a admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.528308 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce7101-eda5-4cf0-99ed-3ad361ecc87a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.530672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce7101-eda5-4cf0-99ed-3ad361ecc87a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.550970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df61ae8-bcbe-4454-84a8-741d7936c69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.552303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df61ae8-bcbe-4454-84a8-741d7936c69a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.552700 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df61ae8-bcbe-4454-84a8-741d7936c69a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.552989 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df61ae8-bcbe-4454-84a8-741d7936c69a admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.553812 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df61ae8-bcbe-4454-84a8-741d7936c69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.555568 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df61ae8-bcbe-4454-84a8-741d7936c69a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.558676 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 928/1849] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:41 2021] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:41.563305 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce7101-eda5-4cf0-99ed-3ad361ecc87a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.569810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 922/1850] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:41.569810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df61ae8-bcbe-4454-84a8-741d7936c69a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.579103 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce7101-eda5-4cf0-99ed-3ad361ecc87a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.582500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df61ae8-bcbe-4454-84a8-741d7936c69a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.586361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648268b6-ced0-4b23-a2bf-ae297eb19724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.587383 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648268b6-ced0-4b23-a2bf-ae297eb19724 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.587798 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648268b6-ced0-4b23-a2bf-ae297eb19724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.588154 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648268b6-ced0-4b23-a2bf-ae297eb19724 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.588588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e21e2-1eb2-4779-9074-a1bd7c823dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.589034 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648268b6-ced0-4b23-a2bf-ae297eb19724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.589478 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e21e2-1eb2-4779-9074-a1bd7c823dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.589770 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e21e2-1eb2-4779-9074-a1bd7c823dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.590058 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e21e2-1eb2-4779-9074-a1bd7c823dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.591173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e21e2-1eb2-4779-9074-a1bd7c823dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.592057 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648268b6-ced0-4b23-a2bf-ae297eb19724 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.593156 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e21e2-1eb2-4779-9074-a1bd7c823dc1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.604858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 923/1851] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:41.605840 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e21e2-1eb2-4779-9074-a1bd7c823dc1 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.619939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e21e2-1eb2-4779-9074-a1bd7c823dc1 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.626237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7ced0-4a6a-489c-b4c7-fc41da9781b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.627187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7ced0-4a6a-489c-b4c7-fc41da9781b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.627477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7ced0-4a6a-489c-b4c7-fc41da9781b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.627757 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7ced0-4a6a-489c-b4c7-fc41da9781b1 admin admin] PATH_INFO: `/v3/projects/4fd4361ff4344f6680eba04bf2138689/users/cffd18d0171243858b1ab9a6da36fe23/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.632383 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 929/1852] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:41 2021] POST /identity/v3/users => generated 300 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:41.633599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648268b6-ced0-4b23-a2bf-ae297eb19724 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.645550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7ced0-4a6a-489c-b4c7-fc41da9781b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd4361ff4344f6680eba04bf2138689, user_id=cffd18d0171243858b1ab9a6da36fe23, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.647273 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648268b6-ced0-4b23-a2bf-ae297eb19724 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.648276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7ced0-4a6a-489c-b4c7-fc41da9781b1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.654673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d437433-7d73-4ae5-9e01-58e1302aca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.656108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d437433-7d73-4ae5-9e01-58e1302aca63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.656545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d437433-7d73-4ae5-9e01-58e1302aca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.657627 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d437433-7d73-4ae5-9e01-58e1302aca63 admin admin] PATH_INFO: `/v3/projects/3db779b5982444efad706af3d33f2775/users/5f295cdc5e1a449c90ae98348ffd1818/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.671276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 924/1853] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:41 2021] PUT /identity/v3/projects/4fd4361ff4344f6680eba04bf2138689/users/cffd18d0171243858b1ab9a6da36fe23/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:41.671559 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7ced0-4a6a-489c-b4c7-fc41da9781b1 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.687539 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d437433-7d73-4ae5-9e01-58e1302aca63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db779b5982444efad706af3d33f2775, user_id=5f295cdc5e1a449c90ae98348ffd1818, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.690571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d437433-7d73-4ae5-9e01-58e1302aca63 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.708089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 930/1854] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:41 2021] PUT /identity/v3/projects/3db779b5982444efad706af3d33f2775/users/5f295cdc5e1a449c90ae98348ffd1818/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:41.709522 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c6dbf-0d18-4002-94e8-0decab88c23d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.709812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c6dbf-0d18-4002-94e8-0decab88c23d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.710091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c6dbf-0d18-4002-94e8-0decab88c23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.761675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-190c6dbf-0d18-4002-94e8-0decab88c23d None None] MFA Rules not processed for user `cffd18d0171243858b1ab9a6da36fe23`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:41.763047 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7ced0-4a6a-489c-b4c7-fc41da9781b1 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.766120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-190c6dbf-0d18-4002-94e8-0decab88c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:41.849477 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 931/1855] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:41 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:41.850422 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c6dbf-0d18-4002-94e8-0decab88c23d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.851119 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54796399-05b4-4dbd-84f3-d3175962edb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.852214 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54796399-05b4-4dbd-84f3-d3175962edb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.852931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54796399-05b4-4dbd-84f3-d3175962edb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.853592 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54796399-05b4-4dbd-84f3-d3175962edb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.854563 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54796399-05b4-4dbd-84f3-d3175962edb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.856460 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54796399-05b4-4dbd-84f3-d3175962edb4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.869836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 925/1856] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:41.871199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54796399-05b4-4dbd-84f3-d3175962edb4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.882280 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54796399-05b4-4dbd-84f3-d3175962edb4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.884544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c6dbf-0d18-4002-94e8-0decab88c23d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.889494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb3046-afc6-4a0c-b163-c89f817f46f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.890194 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb3046-afc6-4a0c-b163-c89f817f46f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.890479 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb3046-afc6-4a0c-b163-c89f817f46f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.890760 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb3046-afc6-4a0c-b163-c89f817f46f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.894341 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d541ec1-6b15-4514-a039-73b7310bd69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.894504 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb3046-afc6-4a0c-b163-c89f817f46f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.895072 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d541ec1-6b15-4514-a039-73b7310bd69f admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.895460 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d541ec1-6b15-4514-a039-73b7310bd69f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.895747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d541ec1-6b15-4514-a039-73b7310bd69f admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.896116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb3046-afc6-4a0c-b163-c89f817f46f2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.896566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d541ec1-6b15-4514-a039-73b7310bd69f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.899164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d541ec1-6b15-4514-a039-73b7310bd69f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.910822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 932/1857] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:41.911897 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb3046-afc6-4a0c-b163-c89f817f46f2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.926285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb3046-afc6-4a0c-b163-c89f817f46f2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:41.931348 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8313f-22d8-477d-9be3-ff92e821c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:41.932248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8313f-22d8-477d-9be3-ff92e821c8df admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:41.932530 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8313f-22d8-477d-9be3-ff92e821c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:41.932821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8313f-22d8-477d-9be3-ff92e821c8df admin admin] PATH_INFO: `/v3/projects/410a57c5610a4c88921c89c3d8434970/users/d7c39542099e416d9c5e33194634b4b4/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:41.935036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 926/1858] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:41 2021] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:41.936172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d541ec1-6b15-4514-a039-73b7310bd69f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:41.951462 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8313f-22d8-477d-9be3-ff92e821c8df admin admin] RBAC: Authorizing `identity:create_grant(project_id=410a57c5610a4c88921c89c3d8434970, user_id=d7c39542099e416d9c5e33194634b4b4, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:41.955114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8313f-22d8-477d-9be3-ff92e821c8df admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:41.991928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 933/1859] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:41 2021] PUT /identity/v3/projects/410a57c5610a4c88921c89c3d8434970/users/d7c39542099e416d9c5e33194634b4b4/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:41.996229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8313f-22d8-477d-9be3-ff92e821c8df admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:42.027265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d541ec1-6b15-4514-a039-73b7310bd69f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:42.065930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8313f-22d8-477d-9be3-ff92e821c8df admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:42.071003 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc488a6-1c1c-475c-84df-fa88d60df551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:42.071673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc488a6-1c1c-475c-84df-fa88d60df551 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.071954 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc488a6-1c1c-475c-84df-fa88d60df551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.072229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc488a6-1c1c-475c-84df-fa88d60df551 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.072938 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc488a6-1c1c-475c-84df-fa88d60df551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:42.074901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc488a6-1c1c-475c-84df-fa88d60df551 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:42.085433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb38c9b-31ab-4007-8b4b-819d3c3fb023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:42.086699 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb38c9b-31ab-4007-8b4b-819d3c3fb023 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.087056 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb38c9b-31ab-4007-8b4b-819d3c3fb023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.087390 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb38c9b-31ab-4007-8b4b-819d3c3fb023 admin admin] PATH_INFO: `/v3/projects/3db779b5982444efad706af3d33f2775/users/5f295cdc5e1a449c90ae98348ffd1818/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.089635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb38c9b-31ab-4007-8b4b-819d3c3fb023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db779b5982444efad706af3d33f2775, user_id=5f295cdc5e1a449c90ae98348ffd1818, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:42.092375 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb38c9b-31ab-4007-8b4b-819d3c3fb023 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:42.098306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 934/1860] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:41 2021] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:42.099031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc488a6-1c1c-475c-84df-fa88d60df551 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:42.109940 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc488a6-1c1c-475c-84df-fa88d60df551 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:42.123705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 927/1861] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:41 2021] PUT /identity/v3/projects/3db779b5982444efad706af3d33f2775/users/5f295cdc5e1a449c90ae98348ffd1818/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:42.124650 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb38c9b-31ab-4007-8b4b-819d3c3fb023 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:42.190984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721f4b9-d144-4425-9b93-2787dede8fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:42.191826 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721f4b9-d144-4425-9b93-2787dede8fec admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.192592 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721f4b9-d144-4425-9b93-2787dede8fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.192885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721f4b9-d144-4425-9b93-2787dede8fec admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.193708 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721f4b9-d144-4425-9b93-2787dede8fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:42.195320 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721f4b9-d144-4425-9b93-2787dede8fec admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:42.205126 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb38c9b-31ab-4007-8b4b-819d3c3fb023 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:42.210732 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a42680-4544-455c-a893-9ece2347decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:42.214174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 935/1862] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:42 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:42.215237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a42680-4544-455c-a893-9ece2347decd admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.215692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c6ad6-360e-419a-8bd3-697c2c53bee1 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.215828 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a42680-4544-455c-a893-9ece2347decd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.216016 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c6ad6-360e-419a-8bd3-697c2c53bee1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.216131 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a42680-4544-455c-a893-9ece2347decd admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.216510 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c6ad6-360e-419a-8bd3-697c2c53bee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.216899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a42680-4544-455c-a893-9ece2347decd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:42.218884 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a42680-4544-455c-a893-9ece2347decd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:42.231130 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 928/1863] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:42 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:42.232129 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a42680-4544-455c-a893-9ece2347decd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:42.247862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a42680-4544-455c-a893-9ece2347decd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:42.248796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-d98c6ad6-360e-419a-8bd3-697c2c53bee1 None None] MFA Rules not processed for user `5f295cdc5e1a449c90ae98348ffd1818`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:42.250050 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d98c6ad6-360e-419a-8bd3-697c2c53bee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:42.255102 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1d2ac-bef9-4f57-bd1d-8976cc444a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:42.256095 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1d2ac-bef9-4f57-bd1d-8976cc444a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.256389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1d2ac-bef9-4f57-bd1d-8976cc444a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.256674 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1d2ac-bef9-4f57-bd1d-8976cc444a0a admin admin] PATH_INFO: `/v3/projects/410a57c5610a4c88921c89c3d8434970/users/d7c39542099e416d9c5e33194634b4b4/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.258686 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1d2ac-bef9-4f57-bd1d-8976cc444a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=410a57c5610a4c88921c89c3d8434970, user_id=d7c39542099e416d9c5e33194634b4b4, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:42.261365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1d2ac-bef9-4f57-bd1d-8976cc444a0a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:42.274890 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 929/1864] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:42 2021] PUT /identity/v3/projects/410a57c5610a4c88921c89c3d8434970/users/d7c39542099e416d9c5e33194634b4b4/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:42.275775 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1d2ac-bef9-4f57-bd1d-8976cc444a0a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:42.322225 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 936/1865] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:42 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:42.323566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8702f-ffb6-4458-83f6-9978a8eae6ac None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.323863 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8702f-ffb6-4458-83f6-9978a8eae6ac None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.324144 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8702f-ffb6-4458-83f6-9978a8eae6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.338950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1d2ac-bef9-4f57-bd1d-8976cc444a0a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:42.343857 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc3864-baf1-4c85-bf02-aee68f1eeb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:42.344777 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc3864-baf1-4c85-bf02-aee68f1eeb97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.345062 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc3864-baf1-4c85-bf02-aee68f1eeb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.345336 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc3864-baf1-4c85-bf02-aee68f1eeb97 admin admin] PATH_INFO: `/v3/projects/214f015e67c44a38aa3548aa452d0d93/users/a67f52f48c7c421e9ae4e040a3dafbc1/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.356452 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-26f8702f-ffb6-4458-83f6-9978a8eae6ac None None] MFA Rules not processed for user `d7c39542099e416d9c5e33194634b4b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:42.357869 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-26f8702f-ffb6-4458-83f6-9978a8eae6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:42.360688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc3864-baf1-4c85-bf02-aee68f1eeb97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=214f015e67c44a38aa3548aa452d0d93, user_id=a67f52f48c7c421e9ae4e040a3dafbc1, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:42.363319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc3864-baf1-4c85-bf02-aee68f1eeb97 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:42.377663 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 930/1866] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:42 2021] PUT /identity/v3/projects/214f015e67c44a38aa3548aa452d0d93/users/a67f52f48c7c421e9ae4e040a3dafbc1/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:42.380316 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc3864-baf1-4c85-bf02-aee68f1eeb97 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:42.383315 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-43dc3864-baf1-4c85-bf02-aee68f1eeb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:42.444998 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 937/1867] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:42 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:42.445938 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8702f-ffb6-4458-83f6-9978a8eae6ac None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:42.455857 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc3864-baf1-4c85-bf02-aee68f1eeb97 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:42.457265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8702f-ffb6-4458-83f6-9978a8eae6ac None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:42.460742 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718b5e3-2003-4724-8977-746446e629c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:42.461616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718b5e3-2003-4724-8977-746446e629c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.461898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718b5e3-2003-4724-8977-746446e629c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.462669 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718b5e3-2003-4724-8977-746446e629c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.515850 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d166c-4f90-4800-8e67-43b1d9cb3401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:42.517039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d166c-4f90-4800-8e67-43b1d9cb3401 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.517322 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d166c-4f90-4800-8e67-43b1d9cb3401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.517598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d166c-4f90-4800-8e67-43b1d9cb3401 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.518332 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d166c-4f90-4800-8e67-43b1d9cb3401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:42.519960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d166c-4f90-4800-8e67-43b1d9cb3401 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:42.522436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718b5e3-2003-4724-8977-746446e629c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:42.523938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718b5e3-2003-4724-8977-746446e629c3 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:42.533405 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 938/1868] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:42 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:42.533405 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d166c-4f90-4800-8e67-43b1d9cb3401 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:42.533405 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e73d166c-4f90-4800-8e67-43b1d9cb3401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:42.537278 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 931/1869] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:42 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:42.538061 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718b5e3-2003-4724-8977-746446e629c3 service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:42.545259 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d166c-4f90-4800-8e67-43b1d9cb3401 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:42.547964 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718b5e3-2003-4724-8977-746446e629c3 service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:42.550053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140fa2b-47d0-40fd-8722-8e036551fbbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:42.550682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140fa2b-47d0-40fd-8722-8e036551fbbd service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.551007 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140fa2b-47d0-40fd-8722-8e036551fbbd service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.551290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140fa2b-47d0-40fd-8722-8e036551fbbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.553046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5831231-f17c-45d7-a66e-a399de33e274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:42.554260 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831231-f17c-45d7-a66e-a399de33e274 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.554378 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831231-f17c-45d7-a66e-a399de33e274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.554616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831231-f17c-45d7-a66e-a399de33e274 admin admin] PATH_INFO: `/v3/projects/214f015e67c44a38aa3548aa452d0d93/users/a67f52f48c7c421e9ae4e040a3dafbc1/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.556855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5831231-f17c-45d7-a66e-a399de33e274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=214f015e67c44a38aa3548aa452d0d93, user_id=a67f52f48c7c421e9ae4e040a3dafbc1, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:42.559549 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5831231-f17c-45d7-a66e-a399de33e274 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:42.581633 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 932/1870] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:42 2021] PUT /identity/v3/projects/214f015e67c44a38aa3548aa452d0d93/users/a67f52f48c7c421e9ae4e040a3dafbc1/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:42.588276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e85bdf-53d4-4bd3-a750-d606e2900e9c None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.588576 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e85bdf-53d4-4bd3-a750-d606e2900e9c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.588862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e85bdf-53d4-4bd3-a750-d606e2900e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.619672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-31e85bdf-53d4-4bd3-a750-d606e2900e9c None None] MFA Rules not processed for user `a67f52f48c7c421e9ae4e040a3dafbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:42.620802 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-31e85bdf-53d4-4bd3-a750-d606e2900e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:42.676576 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140fa2b-47d0-40fd-8722-8e036551fbbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:42.678103 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140fa2b-47d0-40fd-8722-8e036551fbbd service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:42.689092 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 939/1871] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:42 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:42.737747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 933/1872] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:42 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:42.760109 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140fa2b-47d0-40fd-8722-8e036551fbbd service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:42.771205 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140fa2b-47d0-40fd-8722-8e036551fbbd service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:42.826001 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661513be-a740-4b71-9642-d07b576a0547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:42.831685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661513be-a740-4b71-9642-d07b576a0547 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.831685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661513be-a740-4b71-9642-d07b576a0547 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.831685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661513be-a740-4b71-9642-d07b576a0547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.840954 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661513be-a740-4b71-9642-d07b576a0547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:42.843846 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661513be-a740-4b71-9642-d07b576a0547 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:42.853090 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 940/1873] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:42 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:42.895133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e85bdf-53d4-4bd3-a750-d606e2900e9c None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:42.964351 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e85bdf-53d4-4bd3-a750-d606e2900e9c None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:42.970189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e355c7a-0a80-425f-a897-e2dbde5d1712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:42.971359 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e355c7a-0a80-425f-a897-e2dbde5d1712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:42.971794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e355c7a-0a80-425f-a897-e2dbde5d1712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:42.972276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e355c7a-0a80-425f-a897-e2dbde5d1712 admin admin] PATH_INFO: `/v3/users/cffd18d0171243858b1ab9a6da36fe23` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:42.973525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e355c7a-0a80-425f-a897-e2dbde5d1712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cffd18d0171243858b1ab9a6da36fe23)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:42.975523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e355c7a-0a80-425f-a897-e2dbde5d1712 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:43.071717 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8e355c7a-0a80-425f-a897-e2dbde5d1712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cffd18d0171243858b1ab9a6da36fe23'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.091928 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8e355c7a-0a80-425f-a897-e2dbde5d1712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cffd18d0171243858b1ab9a6da36fe23'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.103022 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8e355c7a-0a80-425f-a897-e2dbde5d1712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cffd18d0171243858b1ab9a6da36fe23'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.122467 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8e355c7a-0a80-425f-a897-e2dbde5d1712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cffd18d0171243858b1ab9a6da36fe23'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.123924 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8e355c7a-0a80-425f-a897-e2dbde5d1712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cffd18d0171243858b1ab9a6da36fe23'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.137600 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 934/1874] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:42 2021] DELETE /identity/v3/users/cffd18d0171243858b1ab9a6da36fe23 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:43.142499 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f07a6-cdde-4dec-bc48-a1254f92d983 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:43.143010 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f07a6-cdde-4dec-bc48-a1254f92d983 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:43.143083 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f07a6-cdde-4dec-bc48-a1254f92d983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:43.151853 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e355c7a-0a80-425f-a897-e2dbde5d1712 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:43.160530 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-8e355c7a-0a80-425f-a897-e2dbde5d1712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:43.173220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-127f07a6-cdde-4dec-bc48-a1254f92d983 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:43.173220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-127f07a6-cdde-4dec-bc48-a1254f92d983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:43.260297 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e355c7a-0a80-425f-a897-e2dbde5d1712 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:43.267123 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121e762-4fb0-4222-99f1-4f52e051c865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:43.268195 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121e762-4fb0-4222-99f1-4f52e051c865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:43.268593 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121e762-4fb0-4222-99f1-4f52e051c865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:43.268962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121e762-4fb0-4222-99f1-4f52e051c865 admin admin] PATH_INFO: `/v3/users/0ebf53ae3152491097f130e2862f03a5` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:43.285613 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 941/1875] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:31:43.285765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121e762-4fb0-4222-99f1-4f52e051c865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ebf53ae3152491097f130e2862f03a5)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:43.288510 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121e762-4fb0-4222-99f1-4f52e051c865 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:43.297126 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f07a6-cdde-4dec-bc48-a1254f92d983 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:43.299593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-127f07a6-cdde-4dec-bc48-a1254f92d983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:43.405952 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f07a6-cdde-4dec-bc48-a1254f92d983 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:43.416268 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646805bc-d1a1-48d0-a2dd-d90923892eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:43.416490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646805bc-d1a1-48d0-a2dd-d90923892eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:43.416701 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646805bc-d1a1-48d0-a2dd-d90923892eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:43.417065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646805bc-d1a1-48d0-a2dd-d90923892eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:43.451527 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646805bc-d1a1-48d0-a2dd-d90923892eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:43.453516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646805bc-d1a1-48d0-a2dd-d90923892eb0 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:43.470438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 942/1876] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:43.471341 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646805bc-d1a1-48d0-a2dd-d90923892eb0 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:43.476493 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-646805bc-d1a1-48d0-a2dd-d90923892eb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:43.492684 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646805bc-d1a1-48d0-a2dd-d90923892eb0 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:43.498546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1392df1-045a-41ba-88ff-628be641cb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:43.499593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1392df1-045a-41ba-88ff-628be641cb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:43.499942 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1392df1-045a-41ba-88ff-628be641cb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:43.500419 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1392df1-045a-41ba-88ff-628be641cb4c admin admin] PATH_INFO: `/v3/users/87270b3140734af785c48b0f68295dc6` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:43.502372 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1392df1-045a-41ba-88ff-628be641cb4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=87270b3140734af785c48b0f68295dc6)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:43.504500 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1392df1-045a-41ba-88ff-628be641cb4c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:43.587278 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d121e762-4fb0-4222-99f1-4f52e051c865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ebf53ae3152491097f130e2862f03a5'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.588186 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e1392df1-045a-41ba-88ff-628be641cb4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87270b3140734af785c48b0f68295dc6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.620342 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e1392df1-045a-41ba-88ff-628be641cb4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87270b3140734af785c48b0f68295dc6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.624098 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d121e762-4fb0-4222-99f1-4f52e051c865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ebf53ae3152491097f130e2862f03a5'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.636012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d121e762-4fb0-4222-99f1-4f52e051c865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ebf53ae3152491097f130e2862f03a5'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.640786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e1392df1-045a-41ba-88ff-628be641cb4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87270b3140734af785c48b0f68295dc6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.650884 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d121e762-4fb0-4222-99f1-4f52e051c865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ebf53ae3152491097f130e2862f03a5'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.656429 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e1392df1-045a-41ba-88ff-628be641cb4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87270b3140734af785c48b0f68295dc6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.656696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d121e762-4fb0-4222-99f1-4f52e051c865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ebf53ae3152491097f130e2862f03a5'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.658780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e1392df1-045a-41ba-88ff-628be641cb4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87270b3140734af785c48b0f68295dc6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:43.666298 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 935/1877] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:43 2021] DELETE /identity/v3/users/0ebf53ae3152491097f130e2862f03a5 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:43.670383 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 943/1878] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:43 2021] DELETE /identity/v3/users/87270b3140734af785c48b0f68295dc6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:43.671238 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26033f2-c0f5-445a-97ad-92f553a11d23 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:43.674919 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26033f2-c0f5-445a-97ad-92f553a11d23 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:43.675234 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26033f2-c0f5-445a-97ad-92f553a11d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:43.676859 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774c01-af99-4270-b165-419b7d9da72f None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:43.677156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774c01-af99-4270-b165-419b7d9da72f None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:43.677566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774c01-af99-4270-b165-419b7d9da72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:43.696345 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-b26033f2-c0f5-445a-97ad-92f553a11d23 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:43.697734 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b26033f2-c0f5-445a-97ad-92f553a11d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:43.715684 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-a2774c01-af99-4270-b165-419b7d9da72f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:43.717008 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a2774c01-af99-4270-b165-419b7d9da72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:43.819968 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 936/1879] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:43.830287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26033f2-c0f5-445a-97ad-92f553a11d23 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:43.832456 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b26033f2-c0f5-445a-97ad-92f553a11d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:43.833586 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 944/1880] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:43.848667 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2774c01-af99-4270-b165-419b7d9da72f None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:43.852469 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a2774c01-af99-4270-b165-419b7d9da72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:43.956902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26033f2-c0f5-445a-97ad-92f553a11d23 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:43.961106 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f5f7e-2b24-42aa-a577-63b8843e9541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:43.961953 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f5f7e-2b24-42aa-a577-63b8843e9541 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:43.962435 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f5f7e-2b24-42aa-a577-63b8843e9541 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:43.963296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f5f7e-2b24-42aa-a577-63b8843e9541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:43.974527 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f5f7e-2b24-42aa-a577-63b8843e9541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:43.974719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2774c01-af99-4270-b165-419b7d9da72f None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:43.979276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f5f7e-2b24-42aa-a577-63b8843e9541 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:43.983542 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9204-801c-407b-bcf6-80f7fe6699c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:43.984536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9204-801c-407b-bcf6-80f7fe6699c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:43.984536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9204-801c-407b-bcf6-80f7fe6699c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:43.985363 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9204-801c-407b-bcf6-80f7fe6699c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:43.997443 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 937/1881] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:44.017235 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e9204-801c-407b-bcf6-80f7fe6699c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:44.018961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e9204-801c-407b-bcf6-80f7fe6699c5 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:44.040349 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 945/1882] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:44.472840 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f5f7e-2b24-42aa-a577-63b8843e9541 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:44.475138 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5e2f5f7e-2b24-42aa-a577-63b8843e9541 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:44.494636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f5f7e-2b24-42aa-a577-63b8843e9541 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:44.509431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:44.514142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:44.514255 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:44.514503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] PATH_INFO: `/v3/projects/972e572ef76e4996b44d638a4591cefd` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:44.518412 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] RBAC: Authorizing `identity:delete_project(project_id=972e572ef76e4996b44d638a4591cefd)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:44.520485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:44.586339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972e572ef76e4996b44d638a4591cefd', 'request_id': 'req-59b6d34a-624e-43e8-8fef-c06df923d80a'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.596230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972e572ef76e4996b44d638a4591cefd', 'request_id': 'req-59b6d34a-624e-43e8-8fef-c06df923d80a'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.601706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9204-801c-407b-bcf6-80f7fe6699c5 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:44.603862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972e572ef76e4996b44d638a4591cefd', 'request_id': 'req-59b6d34a-624e-43e8-8fef-c06df923d80a'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.604708 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-453e9204-801c-407b-bcf6-80f7fe6699c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:44.615910 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] The token cache is being invalidate because project 972e572ef76e4996b44d638a4591cefd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:44.616199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.617392 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.618608 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 938/1883] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:44 2021] DELETE /identity/v3/projects/972e572ef76e4996b44d638a4591cefd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:44.622607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:44.624437 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:44.629574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9204-801c-407b-bcf6-80f7fe6699c5 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:44.715466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:44.716597 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:44.716983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:44.717730 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] PATH_INFO: `/v3/projects/b14ce8dcc8fc4757bfa656801a3408bc` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:44.718789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14ce8dcc8fc4757bfa656801a3408bc)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:44.721495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:44.725823 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6d34a-624e-43e8-8fef-c06df923d80a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:44.740036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc96770-dba5-46b9-a049-7d8edc52a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:44.740036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc96770-dba5-46b9-a049-7d8edc52a241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:44.740036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc96770-dba5-46b9-a049-7d8edc52a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:44.740036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc96770-dba5-46b9-a049-7d8edc52a241 admin admin] PATH_INFO: `/v3/users/5f295cdc5e1a449c90ae98348ffd1818` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:44.740553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc96770-dba5-46b9-a049-7d8edc52a241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f295cdc5e1a449c90ae98348ffd1818)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:44.740553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc96770-dba5-46b9-a049-7d8edc52a241 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:44.814122 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14ce8dcc8fc4757bfa656801a3408bc', 'request_id': 'req-970c5b03-dea2-4eae-8e41-440657a62df0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.826202 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14ce8dcc8fc4757bfa656801a3408bc', 'request_id': 'req-970c5b03-dea2-4eae-8e41-440657a62df0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.839150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14ce8dcc8fc4757bfa656801a3408bc', 'request_id': 'req-970c5b03-dea2-4eae-8e41-440657a62df0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.852041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] The token cache is being invalidate because project b14ce8dcc8fc4757bfa656801a3408bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:44.852440 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.853287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.856012 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 946/1884] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:44 2021] DELETE /identity/v3/projects/b14ce8dcc8fc4757bfa656801a3408bc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:44.856913 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:44.862561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:44.867372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1fc96770-dba5-46b9-a049-7d8edc52a241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f295cdc5e1a449c90ae98348ffd1818'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.903182 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1fc96770-dba5-46b9-a049-7d8edc52a241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f295cdc5e1a449c90ae98348ffd1818'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.924406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1fc96770-dba5-46b9-a049-7d8edc52a241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f295cdc5e1a449c90ae98348ffd1818'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.934980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1fc96770-dba5-46b9-a049-7d8edc52a241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f295cdc5e1a449c90ae98348ffd1818'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.935783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1fc96770-dba5-46b9-a049-7d8edc52a241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f295cdc5e1a449c90ae98348ffd1818'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:44.946954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 939/1885] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:44 2021] DELETE /identity/v3/users/5f295cdc5e1a449c90ae98348ffd1818 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:44.949332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc96770-dba5-46b9-a049-7d8edc52a241 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:44.953096 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-1fc96770-dba5-46b9-a049-7d8edc52a241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:44.968087 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c5b03-dea2-4eae-8e41-440657a62df0 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:45.056093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc96770-dba5-46b9-a049-7d8edc52a241 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:45.063577 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bd1c1-d34a-411f-aacb-19b62c00dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:45.065220 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bd1c1-d34a-411f-aacb-19b62c00dba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:45.067078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bd1c1-d34a-411f-aacb-19b62c00dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:45.067368 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bd1c1-d34a-411f-aacb-19b62c00dba4 admin admin] PATH_INFO: `/v3/users/d7c39542099e416d9c5e33194634b4b4` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:45.069358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bd1c1-d34a-411f-aacb-19b62c00dba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c39542099e416d9c5e33194634b4b4)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:45.071463 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bd1c1-d34a-411f-aacb-19b62c00dba4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:45.106498 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:45.107531 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:45.107929 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:45.108176 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] PATH_INFO: `/v3/projects/4fd4361ff4344f6680eba04bf2138689` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:45.116544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd4361ff4344f6680eba04bf2138689)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:45.118620 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:45.165464 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ff6bd1c1-d34a-411f-aacb-19b62c00dba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c39542099e416d9c5e33194634b4b4'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.195414 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd4361ff4344f6680eba04bf2138689', 'request_id': 'req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.205677 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd4361ff4344f6680eba04bf2138689', 'request_id': 'req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.208250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ff6bd1c1-d34a-411f-aacb-19b62c00dba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c39542099e416d9c5e33194634b4b4'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.215787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd4361ff4344f6680eba04bf2138689', 'request_id': 'req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.224958 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ff6bd1c1-d34a-411f-aacb-19b62c00dba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c39542099e416d9c5e33194634b4b4'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.236003 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] The token cache is being invalidate because project 4fd4361ff4344f6680eba04bf2138689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:45.236634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.237645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.238107 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ff6bd1c1-d34a-411f-aacb-19b62c00dba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c39542099e416d9c5e33194634b4b4'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.239030 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ff6bd1c1-d34a-411f-aacb-19b62c00dba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c39542099e416d9c5e33194634b4b4'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.240660 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 947/1886] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:44 2021] DELETE /identity/v3/projects/4fd4361ff4344f6680eba04bf2138689 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:45.245254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:45.248436 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:45.262561 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 940/1887] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:44 2021] DELETE /identity/v3/users/d7c39542099e416d9c5e33194634b4b4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:45.331856 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfcb6b-cab7-4341-91b9-850ebe211c6a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:45.431008 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816b485-b60c-48c9-a9ea-8193c6c13b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:45.432030 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816b485-b60c-48c9-a9ea-8193c6c13b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:45.432382 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816b485-b60c-48c9-a9ea-8193c6c13b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:45.433284 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816b485-b60c-48c9-a9ea-8193c6c13b10 admin admin] PATH_INFO: `/v3/users/a67f52f48c7c421e9ae4e040a3dafbc1` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:45.434717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816b485-b60c-48c9-a9ea-8193c6c13b10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67f52f48c7c421e9ae4e040a3dafbc1)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:45.437580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816b485-b60c-48c9-a9ea-8193c6c13b10 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:45.529206 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bd1c1-d34a-411f-aacb-19b62c00dba4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:45.531360 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e816b485-b60c-48c9-a9ea-8193c6c13b10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67f52f48c7c421e9ae4e040a3dafbc1'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.533140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ff6bd1c1-d34a-411f-aacb-19b62c00dba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:45.550834 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bd1c1-d34a-411f-aacb-19b62c00dba4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:45.555582 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:45.556441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:45.556722 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:45.557152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f admin admin] PATH_INFO: `/v3/projects/3db779b5982444efad706af3d33f2775` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:45.558389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db779b5982444efad706af3d33f2775)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:45.560557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:45.569136 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e816b485-b60c-48c9-a9ea-8193c6c13b10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67f52f48c7c421e9ae4e040a3dafbc1'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.593490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e816b485-b60c-48c9-a9ea-8193c6c13b10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67f52f48c7c421e9ae4e040a3dafbc1'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.604609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e816b485-b60c-48c9-a9ea-8193c6c13b10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67f52f48c7c421e9ae4e040a3dafbc1'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.605808 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e816b485-b60c-48c9-a9ea-8193c6c13b10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67f52f48c7c421e9ae4e040a3dafbc1'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.619358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 948/1888] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:45 2021] DELETE /identity/v3/users/a67f52f48c7c421e9ae4e040a3dafbc1 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:45.672197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db779b5982444efad706af3d33f2775', 'request_id': 'req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.695457 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db779b5982444efad706af3d33f2775', 'request_id': 'req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.703646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db779b5982444efad706af3d33f2775', 'request_id': 'req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.725007 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f admin admin] The token cache is being invalidate because project 3db779b5982444efad706af3d33f2775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:45.725307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.726058 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2aadf3d5-2b5c-4ca3-94a1-d49eff069a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:45.737598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 941/1889] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:45 2021] DELETE /identity/v3/projects/3db779b5982444efad706af3d33f2775 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:45.742205 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f246a3-f94e-4f72-b5c3-a925a4937a56 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:45.742602 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f246a3-f94e-4f72-b5c3-a925a4937a56 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:45.744895 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f246a3-f94e-4f72-b5c3-a925a4937a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:45.773295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-f5f246a3-f94e-4f72-b5c3-a925a4937a56 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:45.775596 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-f5f246a3-f94e-4f72-b5c3-a925a4937a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:45.874643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 949/1890] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:45.883663 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2db94-6ebe-4f66-9d31-0e497bd8ac28 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:45.883870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2db94-6ebe-4f66-9d31-0e497bd8ac28 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:45.884158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2db94-6ebe-4f66-9d31-0e497bd8ac28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:45.920219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e0b2db94-6ebe-4f66-9d31-0e497bd8ac28 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:45.930198 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e0b2db94-6ebe-4f66-9d31-0e497bd8ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:45.997445 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 942/1891] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:46.003779 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f246a3-f94e-4f72-b5c3-a925a4937a56 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:46.016313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f246a3-f94e-4f72-b5c3-a925a4937a56 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:46.023552 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bcebd-2eba-4369-8437-d184139916dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:46.024230 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bcebd-2eba-4369-8437-d184139916dc admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.024512 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bcebd-2eba-4369-8437-d184139916dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.024841 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bcebd-2eba-4369-8437-d184139916dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.025590 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bcebd-2eba-4369-8437-d184139916dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:46.025905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bcebd-2eba-4369-8437-d184139916dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:46.027608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bcebd-2eba-4369-8437-d184139916dc admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:46.058570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 950/1892] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:31:46.059814 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2db94-6ebe-4f66-9d31-0e497bd8ac28 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:46.081719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2db94-6ebe-4f66-9d31-0e497bd8ac28 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:46.089616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d4be3-b343-4796-a07c-9eba674867ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:46.095433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d4be3-b343-4796-a07c-9eba674867ab admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.096044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d4be3-b343-4796-a07c-9eba674867ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.096339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d4be3-b343-4796-a07c-9eba674867ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.097762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d4be3-b343-4796-a07c-9eba674867ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:46.100199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d4be3-b343-4796-a07c-9eba674867ab admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:46.116749 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bcebd-2eba-4369-8437-d184139916dc admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:46.122531 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-547bcebd-2eba-4369-8437-d184139916dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:46.144460 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bcebd-2eba-4369-8437-d184139916dc admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:46.165179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:46.166820 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.167066 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.167358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] PATH_INFO: `/v3/projects/214f015e67c44a38aa3548aa452d0d93` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.168637 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=214f015e67c44a38aa3548aa452d0d93)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:46.170709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:46.179589 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 943/1893] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:46 2021] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:46.180609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d4be3-b343-4796-a07c-9eba674867ab admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:46.185245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-445d4be3-b343-4796-a07c-9eba674867ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:46.277322 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214f015e67c44a38aa3548aa452d0d93', 'request_id': 'req-21e44d46-d083-4525-9355-d2223bae34f4'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:46.289930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214f015e67c44a38aa3548aa452d0d93', 'request_id': 'req-21e44d46-d083-4525-9355-d2223bae34f4'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:46.301245 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214f015e67c44a38aa3548aa452d0d93', 'request_id': 'req-21e44d46-d083-4525-9355-d2223bae34f4'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:46.308167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d4be3-b343-4796-a07c-9eba674867ab admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:46.327971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] The token cache is being invalidate because project 214f015e67c44a38aa3548aa452d0d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:46.328331 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:46.329935 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:46.334972 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 951/1894] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:46 2021] DELETE /identity/v3/projects/214f015e67c44a38aa3548aa452d0d93 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:46.335942 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:46.339917 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:46.426461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:46.427299 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.427598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.427864 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c admin admin] PATH_INFO: `/v3/projects/410a57c5610a4c88921c89c3d8434970` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.429899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=410a57c5610a4c88921c89c3d8434970)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:46.432103 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:46.484384 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e44d46-d083-4525-9355-d2223bae34f4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:46.509049 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410a57c5610a4c88921c89c3d8434970', 'request_id': 'req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:46.520472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410a57c5610a4c88921c89c3d8434970', 'request_id': 'req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:46.536478 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410a57c5610a4c88921c89c3d8434970', 'request_id': 'req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:46.550442 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c admin admin] The token cache is being invalidate because project 410a57c5610a4c88921c89c3d8434970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:46.550741 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:46.551468 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-7bb00755-d48f-4c62-8f8a-8b7838a2bf5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:46.553653 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 944/1895] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:46 2021] DELETE /identity/v3/projects/410a57c5610a4c88921c89c3d8434970 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:46.555084 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6ed4f-ca2e-41cb-9730-9133ed1c32f5 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.556006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6ed4f-ca2e-41cb-9730-9133ed1c32f5 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.556296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6ed4f-ca2e-41cb-9730-9133ed1c32f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.564243 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe45c2-6f8a-43ee-9658-6536c38c1e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:46.565223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe45c2-6f8a-43ee-9658-6536c38c1e92 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.566365 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe45c2-6f8a-43ee-9658-6536c38c1e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.566942 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe45c2-6f8a-43ee-9658-6536c38c1e92 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.567841 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe45c2-6f8a-43ee-9658-6536c38c1e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:46.570386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe45c2-6f8a-43ee-9658-6536c38c1e92 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:46.581131 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-f3e6ed4f-ca2e-41cb-9730-9133ed1c32f5 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:46.582342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f3e6ed4f-ca2e-41cb-9730-9133ed1c32f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:46.591997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 945/1896] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:46.593676 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4abd58-12c3-4f28-b708-70172e1cc308 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.594120 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4abd58-12c3-4f28-b708-70172e1cc308 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.594398 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4abd58-12c3-4f28-b708-70172e1cc308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.614813 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 952/1897] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:46 2021] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:46.616257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6c513-fce4-44a7-a730-83727581817b None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.616553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6c513-fce4-44a7-a730-83727581817b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.616900 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6c513-fce4-44a7-a730-83727581817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.628678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-9b4abd58-12c3-4f28-b708-70172e1cc308 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:46.631465 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9b4abd58-12c3-4f28-b708-70172e1cc308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:46.638536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b2e6c513-fce4-44a7-a730-83727581817b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:46.639814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b2e6c513-fce4-44a7-a730-83727581817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:46.642909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 946/1898] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:46.644037 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4abd58-12c3-4f28-b708-70172e1cc308 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:46.645292 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9b4abd58-12c3-4f28-b708-70172e1cc308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:46.661403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 953/1899] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:46.666739 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db709d8f-8d9d-447f-a488-ed83044cae1a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.667156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db709d8f-8d9d-447f-a488-ed83044cae1a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.667572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db709d8f-8d9d-447f-a488-ed83044cae1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.667774 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4abd58-12c3-4f28-b708-70172e1cc308 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:46.673621 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e1604-9e81-4655-9584-c5af02dd6c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:46.674380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e1604-9e81-4655-9584-c5af02dd6c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.674711 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e1604-9e81-4655-9584-c5af02dd6c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.675035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e1604-9e81-4655-9584-c5af02dd6c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.676529 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e1604-9e81-4655-9584-c5af02dd6c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:46.678173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e1604-9e81-4655-9584-c5af02dd6c0c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:46.688177 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-db709d8f-8d9d-447f-a488-ed83044cae1a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:46.690280 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-db709d8f-8d9d-447f-a488-ed83044cae1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:46.698712 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 947/1900] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:46 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:46.699671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e1604-9e81-4655-9584-c5af02dd6c0c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:46.705013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 954/1901] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:46.710879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db709d8f-8d9d-447f-a488-ed83044cae1a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:46.713078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e1604-9e81-4655-9584-c5af02dd6c0c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:46.720416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fa193-9a5e-4637-8ad2-e1b6a7721571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:46.721324 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa193-9a5e-4637-8ad2-e1b6a7721571 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.721604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa193-9a5e-4637-8ad2-e1b6a7721571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.721878 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa193-9a5e-4637-8ad2-e1b6a7721571 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.722907 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fa193-9a5e-4637-8ad2-e1b6a7721571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:46.723216 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fa193-9a5e-4637-8ad2-e1b6a7721571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:46.724825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fa193-9a5e-4637-8ad2-e1b6a7721571 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:46.728629 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db709d8f-8d9d-447f-a488-ed83044cae1a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:46.734400 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8ee3c-6b0a-4b75-a99e-a3a2c9205de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:46.735233 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8ee3c-6b0a-4b75-a99e-a3a2c9205de7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.735566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8ee3c-6b0a-4b75-a99e-a3a2c9205de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.735968 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8ee3c-6b0a-4b75-a99e-a3a2c9205de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.736897 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8ee3c-6b0a-4b75-a99e-a3a2c9205de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:46.738691 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8ee3c-6b0a-4b75-a99e-a3a2c9205de7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:46.748172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 948/1902] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:31:46.751668 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fa193-9a5e-4637-8ad2-e1b6a7721571 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:46.751803 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 955/1903] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:46 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:46.755955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8ee3c-6b0a-4b75-a99e-a3a2c9205de7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:46.768151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8ee3c-6b0a-4b75-a99e-a3a2c9205de7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:46.770196 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fa193-9a5e-4637-8ad2-e1b6a7721571 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:46.774101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540e5ff-e21e-4ed0-b295-5d97d8c3e9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:46.776075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540e5ff-e21e-4ed0-b295-5d97d8c3e9ac admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.776444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540e5ff-e21e-4ed0-b295-5d97d8c3e9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.776731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540e5ff-e21e-4ed0-b295-5d97d8c3e9ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.777516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540e5ff-e21e-4ed0-b295-5d97d8c3e9ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:46.778271 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9c476-74a0-4509-b0c6-3039c7ea0aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:46.779236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9c476-74a0-4509-b0c6-3039c7ea0aad admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.779565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9c476-74a0-4509-b0c6-3039c7ea0aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.779679 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540e5ff-e21e-4ed0-b295-5d97d8c3e9ac admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:46.779863 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9c476-74a0-4509-b0c6-3039c7ea0aad admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.780803 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9c476-74a0-4509-b0c6-3039c7ea0aad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:46.781605 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9c476-74a0-4509-b0c6-3039c7ea0aad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:46.783548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9c476-74a0-4509-b0c6-3039c7ea0aad admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:46.799317 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 949/1904] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:31:46.804319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9c476-74a0-4509-b0c6-3039c7ea0aad admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:46.815924 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 956/1905] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:46 2021] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:46.817214 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540e5ff-e21e-4ed0-b295-5d97d8c3e9ac admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:46.820314 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9c476-74a0-4509-b0c6-3039c7ea0aad admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:46.942383 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540dcbb-551d-4e3f-8177-ec9a251bea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:46.943614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540dcbb-551d-4e3f-8177-ec9a251bea87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:46.944069 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540dcbb-551d-4e3f-8177-ec9a251bea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:46.944503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540dcbb-551d-4e3f-8177-ec9a251bea87 admin admin] PATH_INFO: `/v3/projects/d05f015fa1434a6d91c8e12f1bf2cda0/users/78497342c65f488b95e7e37ed7d65e4c/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:46.964621 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540dcbb-551d-4e3f-8177-ec9a251bea87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05f015fa1434a6d91c8e12f1bf2cda0, user_id=78497342c65f488b95e7e37ed7d65e4c, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:46.967749 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540dcbb-551d-4e3f-8177-ec9a251bea87 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:46.992921 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540e5ff-e21e-4ed0-b295-5d97d8c3e9ac admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:46.998411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 950/1906] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:46 2021] PUT /identity/v3/projects/d05f015fa1434a6d91c8e12f1bf2cda0/users/78497342c65f488b95e7e37ed7d65e4c/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:47.002463 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540dcbb-551d-4e3f-8177-ec9a251bea87 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:47.111275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540dcbb-551d-4e3f-8177-ec9a251bea87 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:47.112414 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941739c-d076-4abd-8640-743ff8f09b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:47.113205 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941739c-d076-4abd-8640-743ff8f09b56 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:47.113493 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941739c-d076-4abd-8640-743ff8f09b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:47.113783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941739c-d076-4abd-8640-743ff8f09b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:47.114480 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941739c-d076-4abd-8640-743ff8f09b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:47.116495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941739c-d076-4abd-8640-743ff8f09b56 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:47.118115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7ccbe-db27-40fa-b653-944fe8964c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:47.119453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7ccbe-db27-40fa-b653-944fe8964c0e admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:47.119747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7ccbe-db27-40fa-b653-944fe8964c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:47.120043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7ccbe-db27-40fa-b653-944fe8964c0e admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:47.120894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7ccbe-db27-40fa-b653-944fe8964c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:47.123104 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7ccbe-db27-40fa-b653-944fe8964c0e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:47.156567 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 951/1907] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:46 2021] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:47.157989 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4161-4e38-420a-8641-4c954472589c None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:47.158284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4161-4e38-420a-8641-4c954472589c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:47.158567 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4161-4e38-420a-8641-4c954472589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:47.161942 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 957/1908] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:46 2021] POST /identity/v3/projects => generated 371 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:47.163091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941739c-d076-4abd-8640-743ff8f09b56 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:47.197122 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-99ce4161-4e38-420a-8641-4c954472589c None None] MFA Rules not processed for user `78497342c65f488b95e7e37ed7d65e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:47.198937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-99ce4161-4e38-420a-8641-4c954472589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:47.288108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941739c-d076-4abd-8640-743ff8f09b56 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:47.295211 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384cbe2-4557-487f-b91b-5862efe78256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:47.296470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384cbe2-4557-487f-b91b-5862efe78256 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:47.296828 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384cbe2-4557-487f-b91b-5862efe78256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:47.297227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384cbe2-4557-487f-b91b-5862efe78256 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:47.299193 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384cbe2-4557-487f-b91b-5862efe78256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:47.300885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384cbe2-4557-487f-b91b-5862efe78256 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:47.334690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 958/1909] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:47 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:47.334690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384cbe2-4557-487f-b91b-5862efe78256 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:47.355701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 952/1910] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:47 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:47.360299 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce4161-4e38-420a-8641-4c954472589c None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:47.362719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384cbe2-4557-487f-b91b-5862efe78256 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:47.372365 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c36de-c409-4c7e-a1ff-41b02ed4c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:47.373323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c36de-c409-4c7e-a1ff-41b02ed4c7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:47.373674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c36de-c409-4c7e-a1ff-41b02ed4c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:47.373970 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c36de-c409-4c7e-a1ff-41b02ed4c7d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:47.374721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c36de-c409-4c7e-a1ff-41b02ed4c7d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:47.378006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c36de-c409-4c7e-a1ff-41b02ed4c7d8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:47.398291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce4161-4e38-420a-8641-4c954472589c None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:47.414403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25680d7-4de6-402b-b3b9-8c7a28eea555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:47.415203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25680d7-4de6-402b-b3b9-8c7a28eea555 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:47.415474 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25680d7-4de6-402b-b3b9-8c7a28eea555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:47.415780 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25680d7-4de6-402b-b3b9-8c7a28eea555 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:47.416802 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25680d7-4de6-402b-b3b9-8c7a28eea555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:47.426188 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25680d7-4de6-402b-b3b9-8c7a28eea555 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:47.443653 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 953/1912] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:47 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:47.443899 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 959/1912] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:47 2021] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:47.444568 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25680d7-4de6-402b-b3b9-8c7a28eea555 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:47.446554 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e25680d7-4de6-402b-b3b9-8c7a28eea555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:47.448247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c36de-c409-4c7e-a1ff-41b02ed4c7d8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:47.480304 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c36de-c409-4c7e-a1ff-41b02ed4c7d8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:47.495209 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623268e-8677-4d55-b601-8aae80c87396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:47.496323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623268e-8677-4d55-b601-8aae80c87396 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:47.498161 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623268e-8677-4d55-b601-8aae80c87396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:47.498604 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623268e-8677-4d55-b601-8aae80c87396 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:47.500562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623268e-8677-4d55-b601-8aae80c87396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:47.504247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623268e-8677-4d55-b601-8aae80c87396 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:47.538211 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 960/1913] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:47 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:47.539267 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623268e-8677-4d55-b601-8aae80c87396 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:47.570627 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623268e-8677-4d55-b601-8aae80c87396 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:47.589626 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c640f-2c67-4115-80a7-ab112dff7415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:47.590667 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c640f-2c67-4115-80a7-ab112dff7415 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:47.592730 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c640f-2c67-4115-80a7-ab112dff7415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:47.593122 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c640f-2c67-4115-80a7-ab112dff7415 admin admin] PATH_INFO: `/v3/projects/ee2d427e4a504b0aaa9ea82addcbd389/users/3f583c4362634235b16379035526bf84/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:47.619819 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25680d7-4de6-402b-b3b9-8c7a28eea555 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:47.623945 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafef6b-6c3e-49c7-bef0-b3fd0141670c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:47.624933 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafef6b-6c3e-49c7-bef0-b3fd0141670c service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:47.625329 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafef6b-6c3e-49c7-bef0-b3fd0141670c service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:47.625702 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafef6b-6c3e-49c7-bef0-b3fd0141670c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:47.660126 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c640f-2c67-4115-80a7-ab112dff7415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee2d427e4a504b0aaa9ea82addcbd389, user_id=3f583c4362634235b16379035526bf84, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:47.662613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafef6b-6c3e-49c7-bef0-b3fd0141670c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:47.664341 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafef6b-6c3e-49c7-bef0-b3fd0141670c service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:47.675558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c640f-2c67-4115-80a7-ab112dff7415 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:47.685532 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 954/1914] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:47 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:47.687237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafef6b-6c3e-49c7-bef0-b3fd0141670c service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:47.702247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 961/1915] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:47 2021] PUT /identity/v3/projects/ee2d427e4a504b0aaa9ea82addcbd389/users/3f583c4362634235b16379035526bf84/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:47.714589 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78d1f5-fae7-43a5-928b-d7f7522dea78 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:47.715144 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78d1f5-fae7-43a5-928b-d7f7522dea78 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:47.715591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78d1f5-fae7-43a5-928b-d7f7522dea78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:47.725535 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafef6b-6c3e-49c7-bef0-b3fd0141670c service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:47.765769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-5c78d1f5-fae7-43a5-928b-d7f7522dea78 None None] MFA Rules not processed for user `3f583c4362634235b16379035526bf84`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:47.769752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5c78d1f5-fae7-43a5-928b-d7f7522dea78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:47.850769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e1d17-0ad0-440d-971f-7d547abd77b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:47.851628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e1d17-0ad0-440d-971f-7d547abd77b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:47.851980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e1d17-0ad0-440d-971f-7d547abd77b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:47.852428 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e1d17-0ad0-440d-971f-7d547abd77b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:47.853771 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e1d17-0ad0-440d-971f-7d547abd77b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:47.856867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e1d17-0ad0-440d-971f-7d547abd77b5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:47.875882 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 955/1916] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:47 2021] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:47.882505 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e1d17-0ad0-440d-971f-7d547abd77b5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:47.883896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 962/1917] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:47 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:47.887838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78d1f5-fae7-43a5-928b-d7f7522dea78 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:47.899836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78d1f5-fae7-43a5-928b-d7f7522dea78 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:47.900247 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e1d17-0ad0-440d-971f-7d547abd77b5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:47.905843 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46492fe0-d363-447f-8017-05e42841de66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:47.906006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634105b-88d7-4b55-a848-4d9d96c18b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:47.907005 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46492fe0-d363-447f-8017-05e42841de66 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:47.907383 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46492fe0-d363-447f-8017-05e42841de66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:47.908009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634105b-88d7-4b55-a848-4d9d96c18b4f admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:47.908272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634105b-88d7-4b55-a848-4d9d96c18b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:47.908394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46492fe0-d363-447f-8017-05e42841de66 admin admin] PATH_INFO: `/v3/projects/66921635faaf4cba9b41e8d5f5ae8813/users/8695faac6f1f4f94bbb74ff4f184fdba/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:47.908582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634105b-88d7-4b55-a848-4d9d96c18b4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:47.909376 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634105b-88d7-4b55-a848-4d9d96c18b4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:47.911544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634105b-88d7-4b55-a848-4d9d96c18b4f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:47.930872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46492fe0-d363-447f-8017-05e42841de66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66921635faaf4cba9b41e8d5f5ae8813, user_id=8695faac6f1f4f94bbb74ff4f184fdba, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:47.934312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46492fe0-d363-447f-8017-05e42841de66 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:47.946545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 963/1918] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:47 2021] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:47.950887 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634105b-88d7-4b55-a848-4d9d96c18b4f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:47.954169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 956/1919] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:47 2021] PUT /identity/v3/projects/66921635faaf4cba9b41e8d5f5ae8813/users/8695faac6f1f4f94bbb74ff4f184fdba/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:47.965163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1986d9d-07ee-4c2f-8326-eab9dd807e85 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:47.965614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1986d9d-07ee-4c2f-8326-eab9dd807e85 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:47.965997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1986d9d-07ee-4c2f-8326-eab9dd807e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:48.004465 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e1986d9d-07ee-4c2f-8326-eab9dd807e85 None None] MFA Rules not processed for user `8695faac6f1f4f94bbb74ff4f184fdba`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:48.006096 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e1986d9d-07ee-4c2f-8326-eab9dd807e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:48.043890 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634105b-88d7-4b55-a848-4d9d96c18b4f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:48.049788 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f65405-68de-47cb-90ef-13694c0163e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:48.050468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f65405-68de-47cb-90ef-13694c0163e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:48.050764 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f65405-68de-47cb-90ef-13694c0163e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:48.051060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f65405-68de-47cb-90ef-13694c0163e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:48.053000 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f65405-68de-47cb-90ef-13694c0163e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:48.053847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f65405-68de-47cb-90ef-13694c0163e8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:48.078731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 964/1920] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:47 2021] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:48.083019 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f65405-68de-47cb-90ef-13694c0163e8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:48.093531 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f65405-68de-47cb-90ef-13694c0163e8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:48.112122 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a13d8-9f6e-4907-9a25-f12fe1b9c3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:48.115192 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a13d8-9f6e-4907-9a25-f12fe1b9c3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:48.117544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a13d8-9f6e-4907-9a25-f12fe1b9c3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:48.118048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a13d8-9f6e-4907-9a25-f12fe1b9c3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:48.118971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a13d8-9f6e-4907-9a25-f12fe1b9c3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:48.128725 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a13d8-9f6e-4907-9a25-f12fe1b9c3f8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:48.141188 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 965/1921] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:48 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:31:48.146378 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a13d8-9f6e-4907-9a25-f12fe1b9c3f8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:48.164886 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 957/1922] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:47 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:31:48.171569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a13d8-9f6e-4907-9a25-f12fe1b9c3f8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:48.171912 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1986d9d-07ee-4c2f-8326-eab9dd807e85 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:48.173425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e1986d9d-07ee-4c2f-8326-eab9dd807e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:48.177469 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab01536-579e-4977-be83-88e591219bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:48.178697 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab01536-579e-4977-be83-88e591219bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:48.179025 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab01536-579e-4977-be83-88e591219bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:48.179313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab01536-579e-4977-be83-88e591219bf5 admin admin] PATH_INFO: `/v3/projects/fe2f2a39e2fa4b56b40490160859c149/users/7fa7d631e27c46798aa63388693f9650/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:48.198836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab01536-579e-4977-be83-88e591219bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2f2a39e2fa4b56b40490160859c149, user_id=7fa7d631e27c46798aa63388693f9650, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:48.203543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab01536-579e-4977-be83-88e591219bf5 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:48.226001 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 966/1923] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:48 2021] PUT /identity/v3/projects/fe2f2a39e2fa4b56b40490160859c149/users/7fa7d631e27c46798aa63388693f9650/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:48.227107 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab01536-579e-4977-be83-88e591219bf5 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:48.261324 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1986d9d-07ee-4c2f-8326-eab9dd807e85 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:48.322370 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab01536-579e-4977-be83-88e591219bf5 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:48.326055 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45314a1-5856-4c65-a313-c45767f0b77f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:48.326055 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45314a1-5856-4c65-a313-c45767f0b77f service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:48.326349 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45314a1-5856-4c65-a313-c45767f0b77f service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:48.326586 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45314a1-5856-4c65-a313-c45767f0b77f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:48.330534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ee069-cf6f-4975-aef0-3d1f1891cf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:48.331508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee069-cf6f-4975-aef0-3d1f1891cf04 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:48.331958 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee069-cf6f-4975-aef0-3d1f1891cf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:48.333014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee069-cf6f-4975-aef0-3d1f1891cf04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:48.335413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ee069-cf6f-4975-aef0-3d1f1891cf04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:48.337074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ee069-cf6f-4975-aef0-3d1f1891cf04 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:48.354067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 967/1924] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:48 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:48.355964 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ee069-cf6f-4975-aef0-3d1f1891cf04 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:48.367000 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ee069-cf6f-4975-aef0-3d1f1891cf04 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:48.372008 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e67e3d-0c54-4dfa-ac73-6676321aadc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:48.373142 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e67e3d-0c54-4dfa-ac73-6676321aadc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:48.373457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e67e3d-0c54-4dfa-ac73-6676321aadc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:48.373740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e67e3d-0c54-4dfa-ac73-6676321aadc5 admin admin] PATH_INFO: `/v3/projects/fe2f2a39e2fa4b56b40490160859c149/users/7fa7d631e27c46798aa63388693f9650/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:48.376999 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e67e3d-0c54-4dfa-ac73-6676321aadc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2f2a39e2fa4b56b40490160859c149, user_id=7fa7d631e27c46798aa63388693f9650, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:48.379786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e67e3d-0c54-4dfa-ac73-6676321aadc5 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:48.403714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 968/1925] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:48 2021] PUT /identity/v3/projects/fe2f2a39e2fa4b56b40490160859c149/users/7fa7d631e27c46798aa63388693f9650/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:48.405376 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c1142-231e-4b8d-9643-fcab16a2e51a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:48.405684 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c1142-231e-4b8d-9643-fcab16a2e51a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:48.406131 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c1142-231e-4b8d-9643-fcab16a2e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:48.420334 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45314a1-5856-4c65-a313-c45767f0b77f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:48.422373 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45314a1-5856-4c65-a313-c45767f0b77f service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:48.437560 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 958/1926] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:48 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:48.447008 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-825c1142-231e-4b8d-9643-fcab16a2e51a None None] MFA Rules not processed for user `7fa7d631e27c46798aa63388693f9650`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:48.448355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-825c1142-231e-4b8d-9643-fcab16a2e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:48.463313 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45314a1-5856-4c65-a313-c45767f0b77f service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:48.475906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45314a1-5856-4c65-a313-c45767f0b77f service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:48.537211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fbad4-dffd-44b6-a009-e205c07212b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:48.538090 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fbad4-dffd-44b6-a009-e205c07212b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:48.538455 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fbad4-dffd-44b6-a009-e205c07212b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:48.538639 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fbad4-dffd-44b6-a009-e205c07212b1 admin admin] PATH_INFO: `/v3/users/8695faac6f1f4f94bbb74ff4f184fdba` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:48.539918 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fbad4-dffd-44b6-a009-e205c07212b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8695faac6f1f4f94bbb74ff4f184fdba)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:48.541628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 969/1927] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:48 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:48.541994 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fbad4-dffd-44b6-a009-e205c07212b1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:48.553819 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c1142-231e-4b8d-9643-fcab16a2e51a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:48.624249 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a36fbad4-dffd-44b6-a009-e205c07212b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8695faac6f1f4f94bbb74ff4f184fdba'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:48.625727 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c1142-231e-4b8d-9643-fcab16a2e51a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:48.630248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a00533-075a-4e02-8d9b-856c837ade9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:48.631176 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a00533-075a-4e02-8d9b-856c837ade9f service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:48.631639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a00533-075a-4e02-8d9b-856c837ade9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:48.632056 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a00533-075a-4e02-8d9b-856c837ade9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:48.639091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a36fbad4-dffd-44b6-a009-e205c07212b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8695faac6f1f4f94bbb74ff4f184fdba'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:48.643880 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a00533-075a-4e02-8d9b-856c837ade9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:48.645663 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a00533-075a-4e02-8d9b-856c837ade9f service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:48.648057 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a36fbad4-dffd-44b6-a009-e205c07212b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8695faac6f1f4f94bbb74ff4f184fdba'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:48.669998 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a36fbad4-dffd-44b6-a009-e205c07212b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8695faac6f1f4f94bbb74ff4f184fdba'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:48.671130 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a36fbad4-dffd-44b6-a009-e205c07212b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8695faac6f1f4f94bbb74ff4f184fdba'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:48.671450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 970/1928] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:48 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:48.687654 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 959/1929] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:48 2021] DELETE /identity/v3/users/8695faac6f1f4f94bbb74ff4f184fdba => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:48.693631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef1dc9-24c2-4c02-902c-a2eebeb6bbb1 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:48.694180 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef1dc9-24c2-4c02-902c-a2eebeb6bbb1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:48.694573 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef1dc9-24c2-4c02-902c-a2eebeb6bbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:48.718311 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-e2ef1dc9-24c2-4c02-902c-a2eebeb6bbb1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:48.719796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e2ef1dc9-24c2-4c02-902c-a2eebeb6bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:48.779845 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fbad4-dffd-44b6-a009-e205c07212b1 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:48.781417 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a36fbad4-dffd-44b6-a009-e205c07212b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:48.850177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fbad4-dffd-44b6-a009-e205c07212b1 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:48.854251 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5311c-2a96-4d9d-b8af-3842c94c3ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:48.854947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5311c-2a96-4d9d-b8af-3842c94c3ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:48.855233 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5311c-2a96-4d9d-b8af-3842c94c3ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:48.855508 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5311c-2a96-4d9d-b8af-3842c94c3ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:48.857696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4ae5311c-2a96-4d9d-b8af-3842c94c3ba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:48.916355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 971/1930] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:48.919637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5311c-2a96-4d9d-b8af-3842c94c3ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:48.921231 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5311c-2a96-4d9d-b8af-3842c94c3ba9 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:48.927442 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef1dc9-24c2-4c02-902c-a2eebeb6bbb1 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:48.928904 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e2ef1dc9-24c2-4c02-902c-a2eebeb6bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:48.932219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 960/1931] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:48 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:48.988780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef1dc9-24c2-4c02-902c-a2eebeb6bbb1 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:48.992573 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901829b-fb4b-436d-ae34-c2b4f1637eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:48.993296 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901829b-fb4b-436d-ae34-c2b4f1637eed service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:48.993673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901829b-fb4b-436d-ae34-c2b4f1637eed service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:48.994014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901829b-fb4b-436d-ae34-c2b4f1637eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:49.003550 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901829b-fb4b-436d-ae34-c2b4f1637eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:49.005150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901829b-fb4b-436d-ae34-c2b4f1637eed service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:49.014922 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 972/1932] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:49.312369 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5311c-2a96-4d9d-b8af-3842c94c3ba9 service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:49.313878 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4ae5311c-2a96-4d9d-b8af-3842c94c3ba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:49.333387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5311c-2a96-4d9d-b8af-3842c94c3ba9 service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:49.342024 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:49.342910 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:49.343200 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:49.343477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd admin admin] PATH_INFO: `/v3/projects/66921635faaf4cba9b41e8d5f5ae8813` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:49.344837 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=66921635faaf4cba9b41e8d5f5ae8813)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:49.347471 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:49.405792 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66921635faaf4cba9b41e8d5f5ae8813', 'request_id': 'req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:49.420014 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66921635faaf4cba9b41e8d5f5ae8813', 'request_id': 'req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:49.425949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66921635faaf4cba9b41e8d5f5ae8813', 'request_id': 'req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:49.436997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd admin admin] The token cache is being invalidate because project 66921635faaf4cba9b41e8d5f5ae8813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:49.437287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:49.437932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4a4f7008-bbc4-4057-96ad-15e20b37d0cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:49.439527 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 961/1933] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:49 2021] DELETE /identity/v3/projects/66921635faaf4cba9b41e8d5f5ae8813 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:49.445150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd4f9-ed06-4806-b874-dfdcd18342df None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:49.445460 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd4f9-ed06-4806-b874-dfdcd18342df None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:49.445926 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd4f9-ed06-4806-b874-dfdcd18342df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:49.465659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-e82fd4f9-ed06-4806-b874-dfdcd18342df None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:49.466929 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e82fd4f9-ed06-4806-b874-dfdcd18342df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:49.523265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 973/1934] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:49.531110 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc69c8-c323-4214-866e-da69a60c768b None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:49.531458 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc69c8-c323-4214-866e-da69a60c768b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:49.531747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc69c8-c323-4214-866e-da69a60c768b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:49.549601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-38dc69c8-c323-4214-866e-da69a60c768b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:49.550792 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-38dc69c8-c323-4214-866e-da69a60c768b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:49.558641 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 962/1935] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:49.562758 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fd4f9-ed06-4806-b874-dfdcd18342df None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:49.572517 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fd4f9-ed06-4806-b874-dfdcd18342df None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:49.577265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22055c3c-d7f7-4ec9-b8ca-b7b99259c2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:49.577909 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22055c3c-d7f7-4ec9-b8ca-b7b99259c2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:49.578193 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22055c3c-d7f7-4ec9-b8ca-b7b99259c2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:49.578471 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22055c3c-d7f7-4ec9-b8ca-b7b99259c2d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:49.579315 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22055c3c-d7f7-4ec9-b8ca-b7b99259c2d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:49.580191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22055c3c-d7f7-4ec9-b8ca-b7b99259c2d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:49.581775 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22055c3c-d7f7-4ec9-b8ca-b7b99259c2d6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:49.592874 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 974/1936] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:31:49.597015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc69c8-c323-4214-866e-da69a60c768b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:49.605860 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc69c8-c323-4214-866e-da69a60c768b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:49.610508 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a4052-bdea-44c8-a342-84cf73ab9771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:49.611184 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a4052-bdea-44c8-a342-84cf73ab9771 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:49.611471 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a4052-bdea-44c8-a342-84cf73ab9771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:49.611795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a4052-bdea-44c8-a342-84cf73ab9771 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:49.612525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a4052-bdea-44c8-a342-84cf73ab9771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:49.614415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a4052-bdea-44c8-a342-84cf73ab9771 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:49.639303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 963/1937] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:49 2021] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:49.643420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22055c3c-d7f7-4ec9-b8ca-b7b99259c2d6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:49.654040 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22055c3c-d7f7-4ec9-b8ca-b7b99259c2d6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:49.709879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6787d5-8bbe-4ea4-bd6d-3b696ed8a975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:49.710553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6787d5-8bbe-4ea4-bd6d-3b696ed8a975 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:49.710837 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6787d5-8bbe-4ea4-bd6d-3b696ed8a975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:49.711156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6787d5-8bbe-4ea4-bd6d-3b696ed8a975 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:49.711875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6787d5-8bbe-4ea4-bd6d-3b696ed8a975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:49.713754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6787d5-8bbe-4ea4-bd6d-3b696ed8a975 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:49.737646 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 975/1938] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:49 2021] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:49.741813 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a4052-bdea-44c8-a342-84cf73ab9771 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:49.752010 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a4052-bdea-44c8-a342-84cf73ab9771 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:49.756797 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ec3a4-19f8-48d7-811d-c9f610631200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:49.757491 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ec3a4-19f8-48d7-811d-c9f610631200 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:49.757782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ec3a4-19f8-48d7-811d-c9f610631200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:49.758061 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ec3a4-19f8-48d7-811d-c9f610631200 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:49.758810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ec3a4-19f8-48d7-811d-c9f610631200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:49.760452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ec3a4-19f8-48d7-811d-c9f610631200 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:49.772057 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 964/1939] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:49 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:49.775980 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6787d5-8bbe-4ea4-bd6d-3b696ed8a975 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:49.786521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6787d5-8bbe-4ea4-bd6d-3b696ed8a975 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:49.791490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4c05d-0495-45e7-af76-e3f158bd5c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:49.792213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4c05d-0495-45e7-af76-e3f158bd5c91 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:49.793873 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4c05d-0495-45e7-af76-e3f158bd5c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:49.793873 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4c05d-0495-45e7-af76-e3f158bd5c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:49.793873 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4c05d-0495-45e7-af76-e3f158bd5c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:49.795389 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4c05d-0495-45e7-af76-e3f158bd5c91 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:49.810168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 976/1940] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:49 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:49.814310 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ec3a4-19f8-48d7-811d-c9f610631200 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:49.824339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ec3a4-19f8-48d7-811d-c9f610631200 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:49.829304 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b51753-01ee-4107-8d85-b405c9cf7dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:49.830213 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51753-01ee-4107-8d85-b405c9cf7dca admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:49.830498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51753-01ee-4107-8d85-b405c9cf7dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:49.830782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51753-01ee-4107-8d85-b405c9cf7dca admin admin] PATH_INFO: `/v3/projects/c9aa627d43f24d6e8d2790ec070af1a7/users/1e13a98cefa8431a8eb86ffe72cffee3/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:49.845727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b51753-01ee-4107-8d85-b405c9cf7dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9aa627d43f24d6e8d2790ec070af1a7, user_id=1e13a98cefa8431a8eb86ffe72cffee3, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:49.848409 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b51753-01ee-4107-8d85-b405c9cf7dca admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:49.862436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 965/1941] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:49 2021] PUT /identity/v3/projects/c9aa627d43f24d6e8d2790ec070af1a7/users/1e13a98cefa8431a8eb86ffe72cffee3/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:49.873511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166283-6420-4034-a6d2-7a53b7d16440 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:49.873808 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166283-6420-4034-a6d2-7a53b7d16440 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:49.874094 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166283-6420-4034-a6d2-7a53b7d16440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:49.902762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-1a166283-6420-4034-a6d2-7a53b7d16440 None None] MFA Rules not processed for user `1e13a98cefa8431a8eb86ffe72cffee3`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:49.904011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-1a166283-6420-4034-a6d2-7a53b7d16440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:49.974180 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 977/1942] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:49 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:49.978832 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b51753-01ee-4107-8d85-b405c9cf7dca admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:50.036403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b51753-01ee-4107-8d85-b405c9cf7dca admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:50.040954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd721-786f-4a26-b0d9-b9c675fed987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:50.041590 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd721-786f-4a26-b0d9-b9c675fed987 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:50.041869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd721-786f-4a26-b0d9-b9c675fed987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:50.042143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd721-786f-4a26-b0d9-b9c675fed987 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:50.042876 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cd721-786f-4a26-b0d9-b9c675fed987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:50.044759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cd721-786f-4a26-b0d9-b9c675fed987 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:50.072249 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 966/1943] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:49 2021] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:50.073357 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a166283-6420-4034-a6d2-7a53b7d16440 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:50.084840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a166283-6420-4034-a6d2-7a53b7d16440 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:50.138263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99b61e-e8b6-4e8b-b450-4216d10a6bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:50.138964 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b61e-e8b6-4e8b-b450-4216d10a6bfe admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:50.139247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b61e-e8b6-4e8b-b450-4216d10a6bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:50.139521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b61e-e8b6-4e8b-b450-4216d10a6bfe admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:50.140243 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99b61e-e8b6-4e8b-b450-4216d10a6bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:50.142638 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99b61e-e8b6-4e8b-b450-4216d10a6bfe admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:50.163167 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 978/1944] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:50 2021] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:50.167025 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd721-786f-4a26-b0d9-b9c675fed987 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:50.177180 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd721-786f-4a26-b0d9-b9c675fed987 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:50.181749 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfa399-61ab-4758-a171-676d506bf518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:50.182394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfa399-61ab-4758-a171-676d506bf518 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:50.182672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfa399-61ab-4758-a171-676d506bf518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:50.182971 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfa399-61ab-4758-a171-676d506bf518 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:50.183710 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfa399-61ab-4758-a171-676d506bf518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:50.185332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfa399-61ab-4758-a171-676d506bf518 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:50.195637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 967/1945] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:50.200653 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99b61e-e8b6-4e8b-b450-4216d10a6bfe admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:50.212226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99b61e-e8b6-4e8b-b450-4216d10a6bfe admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:50.219906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1063353-43b3-4c19-9290-8bc343124b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:50.221414 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1063353-43b3-4c19-9290-8bc343124b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:50.221773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1063353-43b3-4c19-9290-8bc343124b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:50.222122 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1063353-43b3-4c19-9290-8bc343124b5f admin admin] PATH_INFO: `/v3/projects/6f44f485a604490b85bbf03d32faf1aa/users/d2e67841f557430fbbbd82bbcba86ceb/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:50.237687 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1063353-43b3-4c19-9290-8bc343124b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f44f485a604490b85bbf03d32faf1aa, user_id=d2e67841f557430fbbbd82bbcba86ceb, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:50.240568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1063353-43b3-4c19-9290-8bc343124b5f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:50.258085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 979/1946] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:50 2021] PUT /identity/v3/projects/6f44f485a604490b85bbf03d32faf1aa/users/d2e67841f557430fbbbd82bbcba86ceb/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:50.261952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfa399-61ab-4758-a171-676d506bf518 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:50.273864 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfa399-61ab-4758-a171-676d506bf518 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:50.340883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff6dcc-103e-43d1-89e7-40f91de92107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:50.341848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6dcc-103e-43d1-89e7-40f91de92107 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:50.342346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6dcc-103e-43d1-89e7-40f91de92107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:50.342983 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6dcc-103e-43d1-89e7-40f91de92107 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:50.343897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff6dcc-103e-43d1-89e7-40f91de92107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:50.345732 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff6dcc-103e-43d1-89e7-40f91de92107 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:50.365163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 968/1947] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:50 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:50.369388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1063353-43b3-4c19-9290-8bc343124b5f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:50.388448 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1063353-43b3-4c19-9290-8bc343124b5f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:50.388448 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b65bc-21db-4cdd-b3f2-7002b9ff09f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:50.388448 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b65bc-21db-4cdd-b3f2-7002b9ff09f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:50.388448 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b65bc-21db-4cdd-b3f2-7002b9ff09f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:50.388856 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b65bc-21db-4cdd-b3f2-7002b9ff09f9 admin admin] PATH_INFO: `/v3/projects/6f44f485a604490b85bbf03d32faf1aa/users/d2e67841f557430fbbbd82bbcba86ceb/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:50.389735 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b65bc-21db-4cdd-b3f2-7002b9ff09f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f44f485a604490b85bbf03d32faf1aa, user_id=d2e67841f557430fbbbd82bbcba86ceb, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:50.393654 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b65bc-21db-4cdd-b3f2-7002b9ff09f9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:50.405399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 980/1948] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:50 2021] PUT /identity/v3/projects/6f44f485a604490b85bbf03d32faf1aa/users/d2e67841f557430fbbbd82bbcba86ceb/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:50.415279 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ad3c3-71ce-41ec-a955-20f448fc2dfa None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:50.415574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ad3c3-71ce-41ec-a955-20f448fc2dfa None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:50.415858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ad3c3-71ce-41ec-a955-20f448fc2dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:50.445952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-181ad3c3-71ce-41ec-a955-20f448fc2dfa None None] MFA Rules not processed for user `d2e67841f557430fbbbd82bbcba86ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:50.447227 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-181ad3c3-71ce-41ec-a955-20f448fc2dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:50.515656 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 969/1949] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:50 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:31:50.527014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b65bc-21db-4cdd-b3f2-7002b9ff09f9 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:50.528711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e83b65bc-21db-4cdd-b3f2-7002b9ff09f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:50.584541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b65bc-21db-4cdd-b3f2-7002b9ff09f9 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:50.588301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f91f5-a9be-44df-9c34-c028046119a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:50.588948 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f91f5-a9be-44df-9c34-c028046119a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:50.589233 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f91f5-a9be-44df-9c34-c028046119a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:50.589513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f91f5-a9be-44df-9c34-c028046119a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:50.645071 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f91f5-a9be-44df-9c34-c028046119a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:50.646499 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f91f5-a9be-44df-9c34-c028046119a4 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:50.655132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 981/1950] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:50 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:56.794019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ad3c3-71ce-41ec-a955-20f448fc2dfa None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:56.795443 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-181ad3c3-71ce-41ec-a955-20f448fc2dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:56.856183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ad3c3-71ce-41ec-a955-20f448fc2dfa None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:56.860575 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de486-b5a1-438b-8bf7-91bfa07deb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:56.861419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de486-b5a1-438b-8bf7-91bfa07deb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:56.861726 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de486-b5a1-438b-8bf7-91bfa07deb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:56.862003 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de486-b5a1-438b-8bf7-91bfa07deb16 admin admin] PATH_INFO: `/v3/users/3f583c4362634235b16379035526bf84` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:56.863731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de486-b5a1-438b-8bf7-91bfa07deb16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f583c4362634235b16379035526bf84)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:56.865646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de486-b5a1-438b-8bf7-91bfa07deb16 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:56.910022 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d10de486-b5a1-438b-8bf7-91bfa07deb16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f583c4362634235b16379035526bf84'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:56.921689 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d10de486-b5a1-438b-8bf7-91bfa07deb16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f583c4362634235b16379035526bf84'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:56.929485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d10de486-b5a1-438b-8bf7-91bfa07deb16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f583c4362634235b16379035526bf84'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:56.936301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d10de486-b5a1-438b-8bf7-91bfa07deb16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f583c4362634235b16379035526bf84'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:56.937069 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d10de486-b5a1-438b-8bf7-91bfa07deb16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f583c4362634235b16379035526bf84'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:56.943638 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 970/1951] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:56 2021] DELETE /identity/v3/users/3f583c4362634235b16379035526bf84 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:56.948189 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e333ee-a7f5-405b-80b9-1e0ffd47197a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:56.948616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e333ee-a7f5-405b-80b9-1e0ffd47197a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:56.948737 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e333ee-a7f5-405b-80b9-1e0ffd47197a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:56.966037 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-69e333ee-a7f5-405b-80b9-1e0ffd47197a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:56.967262 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-69e333ee-a7f5-405b-80b9-1e0ffd47197a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:57.026632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 982/1952] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:57.037290 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de486-b5a1-438b-8bf7-91bfa07deb16 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:57.039387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-d10de486-b5a1-438b-8bf7-91bfa07deb16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:57.106931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de486-b5a1-438b-8bf7-91bfa07deb16 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:57.110916 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0886070-1ca7-4bb8-a224-cf13b5fce772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:57.111704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0886070-1ca7-4bb8-a224-cf13b5fce772 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:57.112131 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0886070-1ca7-4bb8-a224-cf13b5fce772 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:57.112472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0886070-1ca7-4bb8-a224-cf13b5fce772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:57.125172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0886070-1ca7-4bb8-a224-cf13b5fce772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:57.126949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0886070-1ca7-4bb8-a224-cf13b5fce772 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:57.137121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 971/1953] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:57.339017 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e333ee-a7f5-405b-80b9-1e0ffd47197a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:57.340932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-69e333ee-a7f5-405b-80b9-1e0ffd47197a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:57.352714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e333ee-a7f5-405b-80b9-1e0ffd47197a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:57.357828 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dac351-a045-4286-a6cf-2495a645397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:57.358657 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dac351-a045-4286-a6cf-2495a645397c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:57.358979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dac351-a045-4286-a6cf-2495a645397c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:57.359259 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dac351-a045-4286-a6cf-2495a645397c admin admin] PATH_INFO: `/v3/users/1e13a98cefa8431a8eb86ffe72cffee3` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:57.360457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dac351-a045-4286-a6cf-2495a645397c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e13a98cefa8431a8eb86ffe72cffee3)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:57.362396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dac351-a045-4286-a6cf-2495a645397c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:57.418802 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-12dac351-a045-4286-a6cf-2495a645397c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e13a98cefa8431a8eb86ffe72cffee3'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.430225 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-12dac351-a045-4286-a6cf-2495a645397c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e13a98cefa8431a8eb86ffe72cffee3'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.437266 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-12dac351-a045-4286-a6cf-2495a645397c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e13a98cefa8431a8eb86ffe72cffee3'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.444155 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-12dac351-a045-4286-a6cf-2495a645397c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e13a98cefa8431a8eb86ffe72cffee3'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.444793 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-12dac351-a045-4286-a6cf-2495a645397c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e13a98cefa8431a8eb86ffe72cffee3'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.451177 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 983/1954] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:57 2021] DELETE /identity/v3/users/1e13a98cefa8431a8eb86ffe72cffee3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:57.455959 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34809da5-03cb-43f3-96fb-b22341cf0f8e None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:57.456774 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34809da5-03cb-43f3-96fb-b22341cf0f8e None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:57.457053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34809da5-03cb-43f3-96fb-b22341cf0f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:57.475825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-34809da5-03cb-43f3-96fb-b22341cf0f8e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:57.477113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-34809da5-03cb-43f3-96fb-b22341cf0f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:57.512772 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dac351-a045-4286-a6cf-2495a645397c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:57.514131 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-12dac351-a045-4286-a6cf-2495a645397c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:57.543362 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 972/1955] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:57.553381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34809da5-03cb-43f3-96fb-b22341cf0f8e None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:57.555115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-34809da5-03cb-43f3-96fb-b22341cf0f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:57.598039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dac351-a045-4286-a6cf-2495a645397c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:57.605821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:57.607119 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:57.607643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:57.607996 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] PATH_INFO: `/v3/projects/ee2d427e4a504b0aaa9ea82addcbd389` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:57.609439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee2d427e4a504b0aaa9ea82addcbd389)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:57.612241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:57.618193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34809da5-03cb-43f3-96fb-b22341cf0f8e None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:57.626769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5728cf-ac9a-4d85-81c5-772f05df57b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:57.627675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5728cf-ac9a-4d85-81c5-772f05df57b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:57.627960 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5728cf-ac9a-4d85-81c5-772f05df57b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:57.628319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5728cf-ac9a-4d85-81c5-772f05df57b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:57.639313 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5728cf-ac9a-4d85-81c5-772f05df57b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:57.640773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5728cf-ac9a-4d85-81c5-772f05df57b9 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:57.660334 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 973/1956] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:57.670818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee2d427e4a504b0aaa9ea82addcbd389', 'request_id': 'req-d6f208a1-9a77-4784-972b-39bc4e879d73'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.681860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee2d427e4a504b0aaa9ea82addcbd389', 'request_id': 'req-d6f208a1-9a77-4784-972b-39bc4e879d73'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.695834 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee2d427e4a504b0aaa9ea82addcbd389', 'request_id': 'req-d6f208a1-9a77-4784-972b-39bc4e879d73'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.712347 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] The token cache is being invalidate because project ee2d427e4a504b0aaa9ea82addcbd389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:57.712703 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.713834 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.715855 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 984/1957] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:57 2021] DELETE /identity/v3/projects/ee2d427e4a504b0aaa9ea82addcbd389 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:57.723151 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5728cf-ac9a-4d85-81c5-772f05df57b9 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:57.731263 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5728cf-ac9a-4d85-81c5-772f05df57b9 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:57.801856 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cab02-2507-4a0a-bf2e-06bff4ef952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:57.802723 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cab02-2507-4a0a-bf2e-06bff4ef952a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:57.803033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cab02-2507-4a0a-bf2e-06bff4ef952a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:57.803312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cab02-2507-4a0a-bf2e-06bff4ef952a admin admin] PATH_INFO: `/v3/users/7fa7d631e27c46798aa63388693f9650` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:57.804538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cab02-2507-4a0a-bf2e-06bff4ef952a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa7d631e27c46798aa63388693f9650)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:57.807312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cab02-2507-4a0a-bf2e-06bff4ef952a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:57.870651 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-114cab02-2507-4a0a-bf2e-06bff4ef952a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa7d631e27c46798aa63388693f9650'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.882581 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-114cab02-2507-4a0a-bf2e-06bff4ef952a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa7d631e27c46798aa63388693f9650'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.891969 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-114cab02-2507-4a0a-bf2e-06bff4ef952a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa7d631e27c46798aa63388693f9650'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.899553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-114cab02-2507-4a0a-bf2e-06bff4ef952a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa7d631e27c46798aa63388693f9650'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.900211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-114cab02-2507-4a0a-bf2e-06bff4ef952a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa7d631e27c46798aa63388693f9650'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:57.906002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 974/1958] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:57 2021] DELETE /identity/v3/users/7fa7d631e27c46798aa63388693f9650 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:57.980056 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:57.981519 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:57.995013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f208a1-9a77-4784-972b-39bc4e879d73 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:58.072470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:58.074917 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:58.075481 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:58.076095 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] PATH_INFO: `/v3/projects/c9aa627d43f24d6e8d2790ec070af1a7` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:58.078655 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9aa627d43f24d6e8d2790ec070af1a7)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:58.081192 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:58.130160 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9aa627d43f24d6e8d2790ec070af1a7', 'request_id': 'req-27310954-129d-477a-9cce-8d6ff179f556'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.139534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9aa627d43f24d6e8d2790ec070af1a7', 'request_id': 'req-27310954-129d-477a-9cce-8d6ff179f556'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.147666 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9aa627d43f24d6e8d2790ec070af1a7', 'request_id': 'req-27310954-129d-477a-9cce-8d6ff179f556'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.160411 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] The token cache is being invalidate because project c9aa627d43f24d6e8d2790ec070af1a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:58.160704 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.161353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.163114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 985/1959] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:57 2021] DELETE /identity/v3/projects/c9aa627d43f24d6e8d2790ec070af1a7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:58.167830 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cab02-2507-4a0a-bf2e-06bff4ef952a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:58.169594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-114cab02-2507-4a0a-bf2e-06bff4ef952a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:58.192486 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cab02-2507-4a0a-bf2e-06bff4ef952a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:58.212980 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:58.214481 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:58.254785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6190819-88c8-4411-8cbd-98255cd1f95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:58.255688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190819-88c8-4411-8cbd-98255cd1f95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:58.256003 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190819-88c8-4411-8cbd-98255cd1f95d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:58.256279 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190819-88c8-4411-8cbd-98255cd1f95d admin admin] PATH_INFO: `/v3/users/d2e67841f557430fbbbd82bbcba86ceb` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:58.257490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6190819-88c8-4411-8cbd-98255cd1f95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2e67841f557430fbbbd82bbcba86ceb)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:58.259463 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6190819-88c8-4411-8cbd-98255cd1f95d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:58.279833 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27310954-129d-477a-9cce-8d6ff179f556 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:58.286198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b12514-b416-427b-a5ba-29c969b60b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:58.287242 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b12514-b416-427b-a5ba-29c969b60b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:58.287525 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b12514-b416-427b-a5ba-29c969b60b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:58.287800 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b12514-b416-427b-a5ba-29c969b60b6a admin admin] PATH_INFO: `/v3/projects/fe2f2a39e2fa4b56b40490160859c149` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:58.289028 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b12514-b416-427b-a5ba-29c969b60b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2f2a39e2fa4b56b40490160859c149)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:58.291254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b12514-b416-427b-a5ba-29c969b60b6a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:58.305172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e6190819-88c8-4411-8cbd-98255cd1f95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2e67841f557430fbbbd82bbcba86ceb'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.317200 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e6190819-88c8-4411-8cbd-98255cd1f95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2e67841f557430fbbbd82bbcba86ceb'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.325908 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e6190819-88c8-4411-8cbd-98255cd1f95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2e67841f557430fbbbd82bbcba86ceb'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.334989 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e6190819-88c8-4411-8cbd-98255cd1f95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2e67841f557430fbbbd82bbcba86ceb'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.335826 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e6190819-88c8-4411-8cbd-98255cd1f95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2e67841f557430fbbbd82bbcba86ceb'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.342184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-31b12514-b416-427b-a5ba-29c969b60b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2f2a39e2fa4b56b40490160859c149', 'request_id': 'req-31b12514-b416-427b-a5ba-29c969b60b6a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.344744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 975/1960] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:58 2021] DELETE /identity/v3/users/d2e67841f557430fbbbd82bbcba86ceb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:58.351180 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-31b12514-b416-427b-a5ba-29c969b60b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2f2a39e2fa4b56b40490160859c149', 'request_id': 'req-31b12514-b416-427b-a5ba-29c969b60b6a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.359897 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-31b12514-b416-427b-a5ba-29c969b60b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2f2a39e2fa4b56b40490160859c149', 'request_id': 'req-31b12514-b416-427b-a5ba-29c969b60b6a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.380691 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-31b12514-b416-427b-a5ba-29c969b60b6a admin admin] The token cache is being invalidate because project fe2f2a39e2fa4b56b40490160859c149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:58.381027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-31b12514-b416-427b-a5ba-29c969b60b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.383370 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-31b12514-b416-427b-a5ba-29c969b60b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.384934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6190819-88c8-4411-8cbd-98255cd1f95d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:58.386322 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e6190819-88c8-4411-8cbd-98255cd1f95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:58.389328 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 986/1961] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:58 2021] DELETE /identity/v3/projects/fe2f2a39e2fa4b56b40490160859c149 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:31:58.390892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f4bc-5747-43af-a272-efd59f5498f6 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:58.391392 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f4bc-5747-43af-a272-efd59f5498f6 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:58.391713 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f4bc-5747-43af-a272-efd59f5498f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:58.417768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-9ec9f4bc-5747-43af-a272-efd59f5498f6 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:58.418951 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9ec9f4bc-5747-43af-a272-efd59f5498f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:58.484574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6190819-88c8-4411-8cbd-98255cd1f95d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:58.493093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0e173-482a-4236-9923-b1487c20472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:58.494066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0e173-482a-4236-9923-b1487c20472a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:58.494406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0e173-482a-4236-9923-b1487c20472a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:58.494696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0e173-482a-4236-9923-b1487c20472a admin admin] PATH_INFO: `/v3/users/78497342c65f488b95e7e37ed7d65e4c` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:58.495135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 987/1962] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:58.500410 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0e173-482a-4236-9923-b1487c20472a admin admin] RBAC: Authorizing `identity:delete_user(user_id=78497342c65f488b95e7e37ed7d65e4c)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:58.502467 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0e173-482a-4236-9923-b1487c20472a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:58.504247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43467fae-f2b2-4cb0-bbf4-60be3456cb77 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:58.504539 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43467fae-f2b2-4cb0-bbf4-60be3456cb77 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:58.504820 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43467fae-f2b2-4cb0-bbf4-60be3456cb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:58.531598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-43467fae-f2b2-4cb0-bbf4-60be3456cb77 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:58.536246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-43467fae-f2b2-4cb0-bbf4-60be3456cb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:58.546886 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 988/1963] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:58.552074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43467fae-f2b2-4cb0-bbf4-60be3456cb77 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:58.561735 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43467fae-f2b2-4cb0-bbf4-60be3456cb77 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:58.567631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ab41c-7f4d-4da3-b6cf-a885d34e1aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:58.568491 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ab41c-7f4d-4da3-b6cf-a885d34e1aaf admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:58.568918 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ab41c-7f4d-4da3-b6cf-a885d34e1aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:58.569265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ab41c-7f4d-4da3-b6cf-a885d34e1aaf admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:58.570204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ab41c-7f4d-4da3-b6cf-a885d34e1aaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:58.570618 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ab41c-7f4d-4da3-b6cf-a885d34e1aaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:58.572456 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ab41c-7f4d-4da3-b6cf-a885d34e1aaf admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:58.593642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 989/1964] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:31:58.598191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ab41c-7f4d-4da3-b6cf-a885d34e1aaf admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:58.605583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-cbb0e173-482a-4236-9923-b1487c20472a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78497342c65f488b95e7e37ed7d65e4c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.611252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ab41c-7f4d-4da3-b6cf-a885d34e1aaf admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:58.616592 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee0963-801e-4b34-ac24-43c5bab54342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:58.617386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee0963-801e-4b34-ac24-43c5bab54342 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:58.617670 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee0963-801e-4b34-ac24-43c5bab54342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:58.617943 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee0963-801e-4b34-ac24-43c5bab54342 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:58.618652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee0963-801e-4b34-ac24-43c5bab54342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:58.620953 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-cbb0e173-482a-4236-9923-b1487c20472a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78497342c65f488b95e7e37ed7d65e4c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.621632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee0963-801e-4b34-ac24-43c5bab54342 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:58.631422 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-cbb0e173-482a-4236-9923-b1487c20472a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78497342c65f488b95e7e37ed7d65e4c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.642663 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-cbb0e173-482a-4236-9923-b1487c20472a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78497342c65f488b95e7e37ed7d65e4c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.643704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-cbb0e173-482a-4236-9923-b1487c20472a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78497342c65f488b95e7e37ed7d65e4c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.652720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 976/1965] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:31:58 2021] DELETE /identity/v3/users/78497342c65f488b95e7e37ed7d65e4c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:58.657103 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 990/1966] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:58 2021] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:58.661267 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0e173-482a-4236-9923-b1487c20472a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:58.663225 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eea35b-1929-46c6-a90c-2db64e0fd054 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:58.663544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eea35b-1929-46c6-a90c-2db64e0fd054 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:58.663829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eea35b-1929-46c6-a90c-2db64e0fd054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:58.665295 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-cbb0e173-482a-4236-9923-b1487c20472a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:58.698321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-a8eea35b-1929-46c6-a90c-2db64e0fd054 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:58.700208 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a8eea35b-1929-46c6-a90c-2db64e0fd054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:58.761861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0e173-482a-4236-9923-b1487c20472a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:58.768387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032608c7-eef0-4ab1-a237-927997841eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:58.769682 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032608c7-eef0-4ab1-a237-927997841eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:58.769973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032608c7-eef0-4ab1-a237-927997841eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:58.770250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032608c7-eef0-4ab1-a237-927997841eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:58.771348 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032608c7-eef0-4ab1-a237-927997841eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:58.774065 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032608c7-eef0-4ab1-a237-927997841eb4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:58.794722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 991/1967] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:58.795605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eea35b-1929-46c6-a90c-2db64e0fd054 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:58.798139 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a8eea35b-1929-46c6-a90c-2db64e0fd054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:58.812171 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eea35b-1929-46c6-a90c-2db64e0fd054 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:58.819629 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 977/1968] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:58 2021] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:58.820578 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032608c7-eef0-4ab1-a237-927997841eb4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:58.824077 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:58.824940 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:58.825248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:58.825534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] PATH_INFO: `/v3/projects/6f44f485a604490b85bbf03d32faf1aa` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:58.826745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f44f485a604490b85bbf03d32faf1aa)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:58.828815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-032608c7-eef0-4ab1-a237-927997841eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:58.829384 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:58.908241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f44f485a604490b85bbf03d32faf1aa', 'request_id': 'req-4217d520-3534-41da-b92d-785d3db59336'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.915616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032608c7-eef0-4ab1-a237-927997841eb4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:58.919007 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f44f485a604490b85bbf03d32faf1aa', 'request_id': 'req-4217d520-3534-41da-b92d-785d3db59336'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.931753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f44f485a604490b85bbf03d32faf1aa', 'request_id': 'req-4217d520-3534-41da-b92d-785d3db59336'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.958188 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] The token cache is being invalidate because project 6f44f485a604490b85bbf03d32faf1aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:58.958543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.960640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:58.967789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 992/1969] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:58 2021] DELETE /identity/v3/projects/6f44f485a604490b85bbf03d32faf1aa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:58.967789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:58.967789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:58.998011 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d4cb4-c891-47c1-b798-71563450ad18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:58.999720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d4cb4-c891-47c1-b798-71563450ad18 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.000287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d4cb4-c891-47c1-b798-71563450ad18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.000909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d4cb4-c891-47c1-b798-71563450ad18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.003296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-948d4cb4-c891-47c1-b798-71563450ad18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:59.052042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d520-3534-41da-b92d-785d3db59336 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:59.064433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f01cc9-fecb-4f66-af25-1bf06cf70e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:59.065280 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f01cc9-fecb-4f66-af25-1bf06cf70e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.065634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f01cc9-fecb-4f66-af25-1bf06cf70e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.067149 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f01cc9-fecb-4f66-af25-1bf06cf70e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.071459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f01cc9-fecb-4f66-af25-1bf06cf70e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.073292 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f01cc9-fecb-4f66-af25-1bf06cf70e48 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.086646 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 993/1970] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:58 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:59.089190 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0830fc-b490-42cf-b569-002e581c55b3 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.089486 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0830fc-b490-42cf-b569-002e581c55b3 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.089776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0830fc-b490-42cf-b569-002e581c55b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.109654 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-dd0830fc-b490-42cf-b569-002e581c55b3 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:59.110288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d4cb4-c891-47c1-b798-71563450ad18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.111101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-dd0830fc-b490-42cf-b569-002e581c55b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:59.111856 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d4cb4-c891-47c1-b798-71563450ad18 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.127673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 994/1971] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:59.127673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0830fc-b490-42cf-b569-002e581c55b3 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:59.127943 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 978/1972] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:59.131644 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e6b61-e0d0-494d-97fd-36df1fcc1280 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.131931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e6b61-e0d0-494d-97fd-36df1fcc1280 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.132210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e6b61-e0d0-494d-97fd-36df1fcc1280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.136977 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0830fc-b490-42cf-b569-002e581c55b3 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:59.152111 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-bd1e6b61-e0d0-494d-97fd-36df1fcc1280 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:59.153372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-bd1e6b61-e0d0-494d-97fd-36df1fcc1280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:59.154954 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e206d33-a499-490e-b855-1ab860bbe59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:59.155635 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e206d33-a499-490e-b855-1ab860bbe59e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.155923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e206d33-a499-490e-b855-1ab860bbe59e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.156201 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e206d33-a499-490e-b855-1ab860bbe59e admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.156955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e206d33-a499-490e-b855-1ab860bbe59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.158565 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e206d33-a499-490e-b855-1ab860bbe59e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.162942 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 979/1973] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:59.167912 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e6b61-e0d0-494d-97fd-36df1fcc1280 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:59.179575 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e6b61-e0d0-494d-97fd-36df1fcc1280 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:59.185786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 995/1974] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:59 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:59.186658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e206d33-a499-490e-b855-1ab860bbe59e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:59.197598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e206d33-a499-490e-b855-1ab860bbe59e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:59.201681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbfadc-b5f0-44ea-ae59-b5d9ac59d798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:59.202369 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbfadc-b5f0-44ea-ae59-b5d9ac59d798 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.202579 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8b81e-9770-4746-a33a-dc139f9c8a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:59.202673 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbfadc-b5f0-44ea-ae59-b5d9ac59d798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.203197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbfadc-b5f0-44ea-ae59-b5d9ac59d798 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.203844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8b81e-9770-4746-a33a-dc139f9c8a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.203965 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbfadc-b5f0-44ea-ae59-b5d9ac59d798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:31:59.204193 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8b81e-9770-4746-a33a-dc139f9c8a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.204292 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbfadc-b5f0-44ea-ae59-b5d9ac59d798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.204564 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8b81e-9770-4746-a33a-dc139f9c8a3d admin admin] PATH_INFO: `/v3/projects/ab1ada8ab309456c8b965566b381a71a/users/ed20fe02852943828c36a3c0da01cbc0/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.210369 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbfadc-b5f0-44ea-ae59-b5d9ac59d798 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.221770 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8b81e-9770-4746-a33a-dc139f9c8a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1ada8ab309456c8b965566b381a71a, user_id=ed20fe02852943828c36a3c0da01cbc0, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.225064 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8b81e-9770-4746-a33a-dc139f9c8a3d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.234539 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 980/1975] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:31:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:31:59.246962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbfadc-b5f0-44ea-ae59-b5d9ac59d798 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:59.253053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 996/1976] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:59 2021] PUT /identity/v3/projects/ab1ada8ab309456c8b965566b381a71a/users/ed20fe02852943828c36a3c0da01cbc0/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:59.263743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e52f0-c7ec-49b5-8c90-40514c045c06 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.264040 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e52f0-c7ec-49b5-8c90-40514c045c06 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.264327 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e52f0-c7ec-49b5-8c90-40514c045c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.264564 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbfadc-b5f0-44ea-ae59-b5d9ac59d798 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:59.293864 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-ae8e52f0-c7ec-49b5-8c90-40514c045c06 None None] MFA Rules not processed for user `ed20fe02852943828c36a3c0da01cbc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:59.296163 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-ae8e52f0-c7ec-49b5-8c90-40514c045c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:59.335353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdbbe8-9138-420e-a2f0-21a70ee135cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:59.336115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdbbe8-9138-420e-a2f0-21a70ee135cb admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.336473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdbbe8-9138-420e-a2f0-21a70ee135cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.336828 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdbbe8-9138-420e-a2f0-21a70ee135cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.337613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdbbe8-9138-420e-a2f0-21a70ee135cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.339760 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdbbe8-9138-420e-a2f0-21a70ee135cb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.371893 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 997/1977] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:59 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:31:59.372910 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 981/1978] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:59 2021] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:59.377215 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e52f0-c7ec-49b5-8c90-40514c045c06 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:59.377516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdbbe8-9138-420e-a2f0-21a70ee135cb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:59.387731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e52f0-c7ec-49b5-8c90-40514c045c06 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:59.449678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdbbe8-9138-420e-a2f0-21a70ee135cb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:59.453639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f53a6d-736e-4a1a-9586-cacfaea29c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:59.454342 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53a6d-736e-4a1a-9586-cacfaea29c18 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.454621 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53a6d-736e-4a1a-9586-cacfaea29c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.454934 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53a6d-736e-4a1a-9586-cacfaea29c18 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.455669 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f53a6d-736e-4a1a-9586-cacfaea29c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.455792 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf4489-32d2-4f76-963c-cc0ae6e522ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:59.456455 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf4489-32d2-4f76-963c-cc0ae6e522ff admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.456740 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf4489-32d2-4f76-963c-cc0ae6e522ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.457014 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf4489-32d2-4f76-963c-cc0ae6e522ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.457702 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f53a6d-736e-4a1a-9586-cacfaea29c18 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.457905 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf4489-32d2-4f76-963c-cc0ae6e522ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.460028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf4489-32d2-4f76-963c-cc0ae6e522ff admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.484588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 998/1979] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:59 2021] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:59.485749 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f53a6d-736e-4a1a-9586-cacfaea29c18 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:59.496899 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f53a6d-736e-4a1a-9586-cacfaea29c18 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:59.503456 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf8a2-89e7-49e4-9b23-b5c6091a87b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:59.504445 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf8a2-89e7-49e4-9b23-b5c6091a87b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.504560 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf8a2-89e7-49e4-9b23-b5c6091a87b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.504890 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf8a2-89e7-49e4-9b23-b5c6091a87b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.505680 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebf8a2-89e7-49e4-9b23-b5c6091a87b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.507365 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebf8a2-89e7-49e4-9b23-b5c6091a87b5 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.523305 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 999/1980] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:59 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:59.525839 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 982/1981] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:31:59 2021] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:31:59.529340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf4489-32d2-4f76-963c-cc0ae6e522ff admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:59.529476 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf8a2-89e7-49e4-9b23-b5c6091a87b5 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:59.540420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf8a2-89e7-49e4-9b23-b5c6091a87b5 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:59.607962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf4489-32d2-4f76-963c-cc0ae6e522ff admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:59.615510 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f1862-0f27-4caa-8f39-1bda919696fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:59.616186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f1862-0f27-4caa-8f39-1bda919696fd admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.616469 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f1862-0f27-4caa-8f39-1bda919696fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.616749 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f1862-0f27-4caa-8f39-1bda919696fd admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.617458 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f1862-0f27-4caa-8f39-1bda919696fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.619545 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f1862-0f27-4caa-8f39-1bda919696fd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.626489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c40e1a-5efe-4d4f-8ce5-342678576b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:59.628252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c40e1a-5efe-4d4f-8ce5-342678576b8c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.628745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c40e1a-5efe-4d4f-8ce5-342678576b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.629630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c40e1a-5efe-4d4f-8ce5-342678576b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.630399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c40e1a-5efe-4d4f-8ce5-342678576b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.632699 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c40e1a-5efe-4d4f-8ce5-342678576b8c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.649082 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1000/1982] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:59 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:59.652506 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c40e1a-5efe-4d4f-8ce5-342678576b8c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:59.672383 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 983/1983] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:31:59 2021] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:31:59.672383 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f1862-0f27-4caa-8f39-1bda919696fd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:59.677252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c40e1a-5efe-4d4f-8ce5-342678576b8c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:59.679527 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-7b2f1862-0f27-4caa-8f39-1bda919696fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:59.693727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f1862-0f27-4caa-8f39-1bda919696fd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:59.699251 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3634f-052d-414b-b5a6-3329857cd952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:59.700605 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3634f-052d-414b-b5a6-3329857cd952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.700898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3634f-052d-414b-b5a6-3329857cd952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.701180 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3634f-052d-414b-b5a6-3329857cd952 admin admin] PATH_INFO: `/v3/projects/d05f015fa1434a6d91c8e12f1bf2cda0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.702619 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3634f-052d-414b-b5a6-3329857cd952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05f015fa1434a6d91c8e12f1bf2cda0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.705063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a940e-b6d6-4a71-a13d-e77222fc4ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:59.706099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3634f-052d-414b-b5a6-3329857cd952 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.706367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a940e-b6d6-4a71-a13d-e77222fc4ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.709067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a940e-b6d6-4a71-a13d-e77222fc4ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.709667 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a940e-b6d6-4a71-a13d-e77222fc4ad8 admin admin] PATH_INFO: `/v3/projects/9fed781cf7e74c96883738ab77973bd8/users/e86ba76d348c41e5880fb48a9b95848d/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.727167 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a940e-b6d6-4a71-a13d-e77222fc4ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fed781cf7e74c96883738ab77973bd8, user_id=e86ba76d348c41e5880fb48a9b95848d, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.729828 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a940e-b6d6-4a71-a13d-e77222fc4ad8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.759383 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1001/1984] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:59 2021] PUT /identity/v3/projects/9fed781cf7e74c96883738ab77973bd8/users/e86ba76d348c41e5880fb48a9b95848d/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:59.760799 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a940e-b6d6-4a71-a13d-e77222fc4ad8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:59.766293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-54f3634f-052d-414b-b5a6-3329857cd952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05f015fa1434a6d91c8e12f1bf2cda0', 'request_id': 'req-54f3634f-052d-414b-b5a6-3329857cd952'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:59.778817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-54f3634f-052d-414b-b5a6-3329857cd952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05f015fa1434a6d91c8e12f1bf2cda0', 'request_id': 'req-54f3634f-052d-414b-b5a6-3329857cd952'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:59.788943 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-54f3634f-052d-414b-b5a6-3329857cd952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05f015fa1434a6d91c8e12f1bf2cda0', 'request_id': 'req-54f3634f-052d-414b-b5a6-3329857cd952'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:59.807997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-54f3634f-052d-414b-b5a6-3329857cd952 admin admin] The token cache is being invalidate because project d05f015fa1434a6d91c8e12f1bf2cda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:31:59.808672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-54f3634f-052d-414b-b5a6-3329857cd952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:59.809714 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-54f3634f-052d-414b-b5a6-3329857cd952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:31:59.811474 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 984/1985] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:31:59 2021] DELETE /identity/v3/projects/d05f015fa1434a6d91c8e12f1bf2cda0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:59.812730 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196d39b-2785-40f2-8d95-631100a9dde0 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.813015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196d39b-2785-40f2-8d95-631100a9dde0 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.813291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196d39b-2785-40f2-8d95-631100a9dde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.839689 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a940e-b6d6-4a71-a13d-e77222fc4ad8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:59.840343 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-5196d39b-2785-40f2-8d95-631100a9dde0 None None] MFA Rules not processed for user `e86ba76d348c41e5880fb48a9b95848d`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:59.841555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5196d39b-2785-40f2-8d95-631100a9dde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:59.893796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331d419-1eb0-46b3-b324-cf75ce5ee9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:59.895185 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331d419-1eb0-46b3-b324-cf75ce5ee9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.895499 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331d419-1eb0-46b3-b324-cf75ce5ee9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.895776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331d419-1eb0-46b3-b324-cf75ce5ee9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.896513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331d419-1eb0-46b3-b324-cf75ce5ee9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.898098 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331d419-1eb0-46b3-b324-cf75ce5ee9e7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.911538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1002/1986] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:31:59 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:59.911538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85593f-ac72-4d73-b021-e0477d9dd30c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.911538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85593f-ac72-4d73-b021-e0477d9dd30c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.911538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85593f-ac72-4d73-b021-e0477d9dd30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.915075 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 985/1987] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:59 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:59.915894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196d39b-2785-40f2-8d95-631100a9dde0 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:59.917250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5196d39b-2785-40f2-8d95-631100a9dde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:59.929183 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-1f85593f-ac72-4d73-b021-e0477d9dd30c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:59.930021 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196d39b-2785-40f2-8d95-631100a9dde0 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:59.930360 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-1f85593f-ac72-4d73-b021-e0477d9dd30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:59.934555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9945e-5545-4b7b-b487-630965a3a39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:59.935503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9945e-5545-4b7b-b487-630965a3a39d admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.935768 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9945e-5545-4b7b-b487-630965a3a39d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.936044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9945e-5545-4b7b-b487-630965a3a39d admin admin] PATH_INFO: `/v3/projects/9f400c829ff04a3cb0d71e4628ef2417/users/23fc00f70a7d42ea8a6d4aaa8e7af632/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.938160 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1003/1988] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:59.939614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85593f-ac72-4d73-b021-e0477d9dd30c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:59.940505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-1f85593f-ac72-4d73-b021-e0477d9dd30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:59.951262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9945e-5545-4b7b-b487-630965a3a39d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f400c829ff04a3cb0d71e4628ef2417, user_id=23fc00f70a7d42ea8a6d4aaa8e7af632, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:59.954191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9945e-5545-4b7b-b487-630965a3a39d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:59.967301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 986/1989] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:31:59 2021] PUT /identity/v3/projects/9f400c829ff04a3cb0d71e4628ef2417/users/23fc00f70a7d42ea8a6d4aaa8e7af632/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:31:59.970419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e78c1-e3e2-4e17-b7de-fccf4fdf9e61 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:59.970419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e78c1-e3e2-4e17-b7de-fccf4fdf9e61 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:59.970419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e78c1-e3e2-4e17-b7de-fccf4fdf9e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:59.986691 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-bb3e78c1-e3e2-4e17-b7de-fccf4fdf9e61 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:59.987970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-bb3e78c1-e3e2-4e17-b7de-fccf4fdf9e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:59.995313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85593f-ac72-4d73-b021-e0477d9dd30c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:00.042027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98158b0-2470-4922-b235-b9d64755a4be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:00.042754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98158b0-2470-4922-b235-b9d64755a4be service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:00.043082 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98158b0-2470-4922-b235-b9d64755a4be service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:00.043368 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98158b0-2470-4922-b235-b9d64755a4be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:00.045258 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 987/1990] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:31:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:00.049269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e78c1-e3e2-4e17-b7de-fccf4fdf9e61 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:00.059496 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e78c1-e3e2-4e17-b7de-fccf4fdf9e61 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:00.064397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c1512-bff5-4ebd-b9c1-6b9121a581b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:00.065066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c1512-bff5-4ebd-b9c1-6b9121a581b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:00.065350 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c1512-bff5-4ebd-b9c1-6b9121a581b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:00.065628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c1512-bff5-4ebd-b9c1-6b9121a581b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:00.066928 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c1512-bff5-4ebd-b9c1-6b9121a581b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:00.068960 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c1512-bff5-4ebd-b9c1-6b9121a581b8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:00.079416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 988/1991] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:00 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:00.080069 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c1512-bff5-4ebd-b9c1-6b9121a581b8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:00.090262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c1512-bff5-4ebd-b9c1-6b9121a581b8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:00.095056 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c3d7a-b56b-41ab-8a27-73416bdb08e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:00.095709 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c3d7a-b56b-41ab-8a27-73416bdb08e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:00.095999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c3d7a-b56b-41ab-8a27-73416bdb08e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:00.096283 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c3d7a-b56b-41ab-8a27-73416bdb08e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:00.097054 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c3d7a-b56b-41ab-8a27-73416bdb08e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:32:00.097363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c3d7a-b56b-41ab-8a27-73416bdb08e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:00.098990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c3d7a-b56b-41ab-8a27-73416bdb08e3 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:00.115210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 989/1992] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:32:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:32:00.115210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c3d7a-b56b-41ab-8a27-73416bdb08e3 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:00.119965 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98158b0-2470-4922-b235-b9d64755a4be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:00.121417 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98158b0-2470-4922-b235-b9d64755a4be service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:00.126378 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c3d7a-b56b-41ab-8a27-73416bdb08e3 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:00.131864 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1004/1993] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:59 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:32:00.131997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97868a41-ac00-4d50-849e-17f92efd1be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:00.132966 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97868a41-ac00-4d50-849e-17f92efd1be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:00.133270 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98158b0-2470-4922-b235-b9d64755a4be service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:00.133442 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97868a41-ac00-4d50-849e-17f92efd1be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:00.133822 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97868a41-ac00-4d50-849e-17f92efd1be1 admin admin] PATH_INFO: `/v3/projects/9f400c829ff04a3cb0d71e4628ef2417/users/23fc00f70a7d42ea8a6d4aaa8e7af632/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:00.137019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97868a41-ac00-4d50-849e-17f92efd1be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f400c829ff04a3cb0d71e4628ef2417, user_id=23fc00f70a7d42ea8a6d4aaa8e7af632, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:00.142016 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97868a41-ac00-4d50-849e-17f92efd1be1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:00.144875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98158b0-2470-4922-b235-b9d64755a4be service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:00.149828 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98141398-354e-41bf-86dc-7524eef0a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:00.151845 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98141398-354e-41bf-86dc-7524eef0a2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:00.152287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98141398-354e-41bf-86dc-7524eef0a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:00.152582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98141398-354e-41bf-86dc-7524eef0a2c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:00.153414 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98141398-354e-41bf-86dc-7524eef0a2c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:00.155358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98141398-354e-41bf-86dc-7524eef0a2c2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:00.156314 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 990/1994] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:00 2021] PUT /identity/v3/projects/9f400c829ff04a3cb0d71e4628ef2417/users/23fc00f70a7d42ea8a6d4aaa8e7af632/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:00.167927 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8370a-a513-40d6-a69a-3640d31d9ce0 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:00.168393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8370a-a513-40d6-a69a-3640d31d9ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:00.168835 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8370a-a513-40d6-a69a-3640d31d9ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:00.187627 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1005/1995] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:32:00 2021] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:00.192284 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98141398-354e-41bf-86dc-7524eef0a2c2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:00.204938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-17d8370a-a513-40d6-a69a-3640d31d9ce0 None None] MFA Rules not processed for user `23fc00f70a7d42ea8a6d4aaa8e7af632`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:00.207223 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-17d8370a-a513-40d6-a69a-3640d31d9ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:00.286025 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98141398-354e-41bf-86dc-7524eef0a2c2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:00.293850 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ea3d2-3be6-4154-b301-6b8926a2be9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:00.295140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ea3d2-3be6-4154-b301-6b8926a2be9d admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:00.295358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ea3d2-3be6-4154-b301-6b8926a2be9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:00.295709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ea3d2-3be6-4154-b301-6b8926a2be9d admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:00.296560 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ea3d2-3be6-4154-b301-6b8926a2be9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:00.298952 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ea3d2-3be6-4154-b301-6b8926a2be9d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:00.332467 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 991/1996] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:00 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:32:00.334880 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1006/1997] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:32:00 2021] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:00.339055 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8370a-a513-40d6-a69a-3640d31d9ce0 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:00.350510 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ea3d2-3be6-4154-b301-6b8926a2be9d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:00.355146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8370a-a513-40d6-a69a-3640d31d9ce0 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:00.362525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84588df3-83d3-4255-9b03-76ad62a49b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:00.364323 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84588df3-83d3-4255-9b03-76ad62a49b87 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:00.364922 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84588df3-83d3-4255-9b03-76ad62a49b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:00.366045 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84588df3-83d3-4255-9b03-76ad62a49b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:00.367236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84588df3-83d3-4255-9b03-76ad62a49b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:00.369142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84588df3-83d3-4255-9b03-76ad62a49b87 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:00.382291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 992/1998] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:00 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:00.387317 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84588df3-83d3-4255-9b03-76ad62a49b87 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:00.402363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84588df3-83d3-4255-9b03-76ad62a49b87 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:00.408191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bc84a-3a8d-430e-a38d-448ef63ded61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:00.408858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bc84a-3a8d-430e-a38d-448ef63ded61 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:00.409163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bc84a-3a8d-430e-a38d-448ef63ded61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:00.409425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bc84a-3a8d-430e-a38d-448ef63ded61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:00.410202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bc84a-3a8d-430e-a38d-448ef63ded61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:00.411853 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bc84a-3a8d-430e-a38d-448ef63ded61 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:00.430565 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ea3d2-3be6-4154-b301-6b8926a2be9d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:00.430659 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 993/1999] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:00 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:32:00.431628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bc84a-3a8d-430e-a38d-448ef63ded61 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:00.432594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48318ed8-a652-432c-a96c-69cb74e3fb89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:00.433254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48318ed8-a652-432c-a96c-69cb74e3fb89 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:00.433568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48318ed8-a652-432c-a96c-69cb74e3fb89 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:00.433818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48318ed8-a652-432c-a96c-69cb74e3fb89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:00.436064 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-48318ed8-a652-432c-a96c-69cb74e3fb89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:00.442174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bc84a-3a8d-430e-a38d-448ef63ded61 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:00.448623 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ed503-dbb1-4f70-bbea-c1df85fa7518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:00.449693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ed503-dbb1-4f70-bbea-c1df85fa7518 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:00.449978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ed503-dbb1-4f70-bbea-c1df85fa7518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:00.450318 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ed503-dbb1-4f70-bbea-c1df85fa7518 admin admin] PATH_INFO: `/v3/projects/aa6be1ce4fb549029261786d5117f118/users/9949afc9b447499081f30e414b29fa6b/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:00.470227 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ed503-dbb1-4f70-bbea-c1df85fa7518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6be1ce4fb549029261786d5117f118, user_id=9949afc9b447499081f30e414b29fa6b, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:00.473097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ed503-dbb1-4f70-bbea-c1df85fa7518 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:00.496057 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 994/2000] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:00 2021] PUT /identity/v3/projects/aa6be1ce4fb549029261786d5117f118/users/9949afc9b447499081f30e414b29fa6b/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:00.497993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ab5b3-f0c3-4448-a8bc-f883dad83b6e None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:00.498285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ab5b3-f0c3-4448-a8bc-f883dad83b6e None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:00.500290 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ab5b3-f0c3-4448-a8bc-f883dad83b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:00.529780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48318ed8-a652-432c-a96c-69cb74e3fb89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:00.531613 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48318ed8-a652-432c-a96c-69cb74e3fb89 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:00.539088 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-667ab5b3-f0c3-4448-a8bc-f883dad83b6e None None] MFA Rules not processed for user `9949afc9b447499081f30e414b29fa6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:00.541461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-667ab5b3-f0c3-4448-a8bc-f883dad83b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:00.541598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1007/2001] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:00 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:32:00.634482 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 995/2002] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:00 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:00.644530 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48318ed8-a652-432c-a96c-69cb74e3fb89 service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:00.653187 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48318ed8-a652-432c-a96c-69cb74e3fb89 service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:00.707902 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7c916-8bbc-4cff-9957-2ffac241f375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:00.708567 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c916-8bbc-4cff-9957-2ffac241f375 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:00.708857 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c916-8bbc-4cff-9957-2ffac241f375 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:00.709159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c916-8bbc-4cff-9957-2ffac241f375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:00.717699 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7c916-8bbc-4cff-9957-2ffac241f375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:00.719175 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7c916-8bbc-4cff-9957-2ffac241f375 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:00.729734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1008/2003] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:00 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:32:04.786200 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ab5b3-f0c3-4448-a8bc-f883dad83b6e None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:04.848023 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ab5b3-f0c3-4448-a8bc-f883dad83b6e None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:04.853145 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd4646-cf87-48a7-8ae7-1a57c37a5f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:04.853769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd4646-cf87-48a7-8ae7-1a57c37a5f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:04.854220 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd4646-cf87-48a7-8ae7-1a57c37a5f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:04.854609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd4646-cf87-48a7-8ae7-1a57c37a5f36 admin admin] PATH_INFO: `/v3/users/9949afc9b447499081f30e414b29fa6b` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:04.856240 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd4646-cf87-48a7-8ae7-1a57c37a5f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9949afc9b447499081f30e414b29fa6b)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:04.858295 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd4646-cf87-48a7-8ae7-1a57c37a5f36 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:04.907562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-44dd4646-cf87-48a7-8ae7-1a57c37a5f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9949afc9b447499081f30e414b29fa6b'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:04.918778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-44dd4646-cf87-48a7-8ae7-1a57c37a5f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9949afc9b447499081f30e414b29fa6b'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:04.927120 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-44dd4646-cf87-48a7-8ae7-1a57c37a5f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9949afc9b447499081f30e414b29fa6b'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:04.933951 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-44dd4646-cf87-48a7-8ae7-1a57c37a5f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9949afc9b447499081f30e414b29fa6b'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:04.934859 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-44dd4646-cf87-48a7-8ae7-1a57c37a5f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9949afc9b447499081f30e414b29fa6b'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:04.950511 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 996/2004] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:32:04 2021] DELETE /identity/v3/users/9949afc9b447499081f30e414b29fa6b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:04.952349 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf71f9-a84b-4643-9c5b-e980026184bb None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:04.952823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf71f9-a84b-4643-9c5b-e980026184bb None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:04.952919 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf71f9-a84b-4643-9c5b-e980026184bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:04.970293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-aedf71f9-a84b-4643-9c5b-e980026184bb None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:04.971609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-aedf71f9-a84b-4643-9c5b-e980026184bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:05.034595 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1009/2005] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:05.045132 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd4646-cf87-48a7-8ae7-1a57c37a5f36 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:05.046535 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-44dd4646-cf87-48a7-8ae7-1a57c37a5f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:05.103273 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd4646-cf87-48a7-8ae7-1a57c37a5f36 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:05.107326 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285a901-d5b4-4857-9576-43e7ce18da0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:05.107965 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285a901-d5b4-4857-9576-43e7ce18da0c service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:05.108245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285a901-d5b4-4857-9576-43e7ce18da0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:05.108523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285a901-d5b4-4857-9576-43e7ce18da0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:05.121138 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285a901-d5b4-4857-9576-43e7ce18da0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:05.122593 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285a901-d5b4-4857-9576-43e7ce18da0c service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:05.133327 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 997/2006] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:32:05.406203 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf71f9-a84b-4643-9c5b-e980026184bb None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:05.407655 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-aedf71f9-a84b-4643-9c5b-e980026184bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:05.420465 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf71f9-a84b-4643-9c5b-e980026184bb None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:05.426292 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:05.427211 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:05.427491 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:05.427766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] PATH_INFO: `/v3/projects/aa6be1ce4fb549029261786d5117f118` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:05.428958 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6be1ce4fb549029261786d5117f118)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:05.430892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:05.479944 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6be1ce4fb549029261786d5117f118', 'request_id': 'req-a15be725-24c4-443b-a69b-4d61519d09ff'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:05.487394 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6be1ce4fb549029261786d5117f118', 'request_id': 'req-a15be725-24c4-443b-a69b-4d61519d09ff'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:05.496884 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6be1ce4fb549029261786d5117f118', 'request_id': 'req-a15be725-24c4-443b-a69b-4d61519d09ff'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:05.507313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] The token cache is being invalidate because project aa6be1ce4fb549029261786d5117f118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:32:05.507604 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:05.508255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:05.509769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1010/2007] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:32:05 2021] DELETE /identity/v3/projects/aa6be1ce4fb549029261786d5117f118 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:05.755386 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a1621-b810-4803-a68d-2fd583f4a8dd None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:05.755673 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a1621-b810-4803-a68d-2fd583f4a8dd None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:05.755939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a1621-b810-4803-a68d-2fd583f4a8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:05.773648 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ee5a1621-b810-4803-a68d-2fd583f4a8dd None None] MFA Rules not processed for user `df94523ab7c545f2a17a2cafe936d2ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:05.774869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ee5a1621-b810-4803-a68d-2fd583f4a8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:05.806165 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:05.808826 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:05.840919 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 998/2008] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:05 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:05.893067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be725-24c4-443b-a69b-4d61519d09ff admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:05.898547 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d0b70-c064-4261-acbb-650cc416e5e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:05.899638 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d0b70-c064-4261-acbb-650cc416e5e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:05.900011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d0b70-c064-4261-acbb-650cc416e5e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:05.900390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d0b70-c064-4261-acbb-650cc416e5e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:05.903673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-ef2d0b70-c064-4261-acbb-650cc416e5e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:05.989284 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d0b70-c064-4261-acbb-650cc416e5e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:05.991899 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d0b70-c064-4261-acbb-650cc416e5e7 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:06.005492 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1011/2009] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:05 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:32:07.230311 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a1621-b810-4803-a68d-2fd583f4a8dd None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:07.232380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ee5a1621-b810-4803-a68d-2fd583f4a8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:07.301269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a1621-b810-4803-a68d-2fd583f4a8dd None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:07.307031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb9311-f379-42a9-8544-db9ffbca4709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:07.307956 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb9311-f379-42a9-8544-db9ffbca4709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:07.308239 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb9311-f379-42a9-8544-db9ffbca4709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:07.308562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb9311-f379-42a9-8544-db9ffbca4709 admin admin] PATH_INFO: `/v3/users/07defc49f2774d9e9c7001504aa647ef` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:07.309815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb9311-f379-42a9-8544-db9ffbca4709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07defc49f2774d9e9c7001504aa647ef)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:07.311837 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb9311-f379-42a9-8544-db9ffbca4709 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:07.357574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fbcb9311-f379-42a9-8544-db9ffbca4709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07defc49f2774d9e9c7001504aa647ef'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:07.369614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fbcb9311-f379-42a9-8544-db9ffbca4709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07defc49f2774d9e9c7001504aa647ef'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:07.376933 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fbcb9311-f379-42a9-8544-db9ffbca4709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07defc49f2774d9e9c7001504aa647ef'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:07.384765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fbcb9311-f379-42a9-8544-db9ffbca4709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07defc49f2774d9e9c7001504aa647ef'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:07.385422 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fbcb9311-f379-42a9-8544-db9ffbca4709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07defc49f2774d9e9c7001504aa647ef'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:07.391210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 999/2010] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:32:07 2021] DELETE /identity/v3/users/07defc49f2774d9e9c7001504aa647ef => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:07.695428 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d0b70-c064-4261-acbb-650cc416e5e7 service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:07.709332 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d0b70-c064-4261-acbb-650cc416e5e7 service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:07.847134 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:07.850375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:07.851453 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:07.852496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8 admin admin] PATH_INFO: `/v3/projects/c6099655f06b473db6eb84adfee54156` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:07.855642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6099655f06b473db6eb84adfee54156)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:07.860622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:07.968748 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6099655f06b473db6eb84adfee54156', 'request_id': 'req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:07.990414 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6099655f06b473db6eb84adfee54156', 'request_id': 'req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:08.007083 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6099655f06b473db6eb84adfee54156', 'request_id': 'req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:08.022608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8 admin admin] The token cache is being invalidate because project c6099655f06b473db6eb84adfee54156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:32:08.023399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:08.024655 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-275dfd3f-7866-43b7-8d4a-5ebb946bfba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:08.027758 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1012/2011] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:32:07 2021] DELETE /identity/v3/projects/c6099655f06b473db6eb84adfee54156 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:08.032677 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bf0e4-95af-43c3-a604-09981f01dd77 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:08.032979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bf0e4-95af-43c3-a604-09981f01dd77 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:08.033268 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bf0e4-95af-43c3-a604-09981f01dd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:08.055190 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-948bf0e4-95af-43c3-a604-09981f01dd77 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:08.056691 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-948bf0e4-95af-43c3-a604-09981f01dd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:08.140317 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1000/2012] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:08.194466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f27d9-bdf0-4e3b-b064-6d2b1e8ffe2a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:08.194869 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f27d9-bdf0-4e3b-b064-6d2b1e8ffe2a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:08.197367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f27d9-bdf0-4e3b-b064-6d2b1e8ffe2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:08.242050 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-f25f27d9-bdf0-4e3b-b064-6d2b1e8ffe2a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:08.245387 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-f25f27d9-bdf0-4e3b-b064-6d2b1e8ffe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:08.255419 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1013/2013] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:08.259761 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bf0e4-95af-43c3-a604-09981f01dd77 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:08.271635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bf0e4-95af-43c3-a604-09981f01dd77 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:08.276613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eb0cb-cf80-4a26-9049-cb8c0653270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:08.277256 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eb0cb-cf80-4a26-9049-cb8c0653270c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:08.277698 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eb0cb-cf80-4a26-9049-cb8c0653270c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:08.277984 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eb0cb-cf80-4a26-9049-cb8c0653270c admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:08.279178 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0eb0cb-cf80-4a26-9049-cb8c0653270c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:32:08.279613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0eb0cb-cf80-4a26-9049-cb8c0653270c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:08.281454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0eb0cb-cf80-4a26-9049-cb8c0653270c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:08.293569 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1001/2014] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:32:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:32:08.297965 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f27d9-bdf0-4e3b-b064-6d2b1e8ffe2a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:08.308452 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f27d9-bdf0-4e3b-b064-6d2b1e8ffe2a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:08.314143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbe24e-1f5b-47e9-82a6-8d62d9ff1093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:08.314806 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbe24e-1f5b-47e9-82a6-8d62d9ff1093 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:08.315158 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbe24e-1f5b-47e9-82a6-8d62d9ff1093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:08.315437 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbe24e-1f5b-47e9-82a6-8d62d9ff1093 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:08.316720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbe24e-1f5b-47e9-82a6-8d62d9ff1093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:08.318813 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbe24e-1f5b-47e9-82a6-8d62d9ff1093 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:08.352717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1014/2015] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:32:08 2021] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:08.357074 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eb0cb-cf80-4a26-9049-cb8c0653270c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:08.370193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eb0cb-cf80-4a26-9049-cb8c0653270c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:08.438869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f86f1b-6ac2-4068-ae86-1201d92b2411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:08.439493 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f86f1b-6ac2-4068-ae86-1201d92b2411 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:08.439958 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f86f1b-6ac2-4068-ae86-1201d92b2411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:08.440243 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f86f1b-6ac2-4068-ae86-1201d92b2411 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:08.440967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f86f1b-6ac2-4068-ae86-1201d92b2411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:08.443488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f86f1b-6ac2-4068-ae86-1201d92b2411 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:08.465019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1002/2016] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:32:08 2021] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:08.468560 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbe24e-1f5b-47e9-82a6-8d62d9ff1093 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:08.479002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbe24e-1f5b-47e9-82a6-8d62d9ff1093 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:08.484090 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c2c7f-6752-475b-8fa2-576cf9815d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:08.484912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c2c7f-6752-475b-8fa2-576cf9815d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:08.485207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c2c7f-6752-475b-8fa2-576cf9815d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:08.485489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c2c7f-6752-475b-8fa2-576cf9815d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:08.486317 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c2c7f-6752-475b-8fa2-576cf9815d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:08.487979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c2c7f-6752-475b-8fa2-576cf9815d48 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:08.499100 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1015/2017] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:08.503083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f86f1b-6ac2-4068-ae86-1201d92b2411 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:08.513646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f86f1b-6ac2-4068-ae86-1201d92b2411 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:08.519949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0a4e8-b380-48a8-88d0-05605607e3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:08.520892 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0a4e8-b380-48a8-88d0-05605607e3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:08.521249 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0a4e8-b380-48a8-88d0-05605607e3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:08.521631 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0a4e8-b380-48a8-88d0-05605607e3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:08.522456 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0a4e8-b380-48a8-88d0-05605607e3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:08.524193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0a4e8-b380-48a8-88d0-05605607e3a8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:08.534958 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1003/2018] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:08.539242 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c2c7f-6752-475b-8fa2-576cf9815d48 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:08.551569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c2c7f-6752-475b-8fa2-576cf9815d48 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:08.558565 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547361cf-be05-4809-a1b2-6cea892c272e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:08.560363 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547361cf-be05-4809-a1b2-6cea892c272e admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:08.561229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547361cf-be05-4809-a1b2-6cea892c272e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:08.561577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547361cf-be05-4809-a1b2-6cea892c272e admin admin] PATH_INFO: `/v3/projects/b9e3a61581e34208bc62621f010d9d4d/users/cc7b0ea626834a1090c73a67f8b099dc/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:08.583096 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547361cf-be05-4809-a1b2-6cea892c272e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e3a61581e34208bc62621f010d9d4d, user_id=cc7b0ea626834a1090c73a67f8b099dc, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:08.585867 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547361cf-be05-4809-a1b2-6cea892c272e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:08.606930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1016/2019] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:08 2021] PUT /identity/v3/projects/b9e3a61581e34208bc62621f010d9d4d/users/cc7b0ea626834a1090c73a67f8b099dc/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:08.612843 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efc48c-5c66-452a-827b-1c8c41769e6b None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:08.613703 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efc48c-5c66-452a-827b-1c8c41769e6b None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:08.613875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efc48c-5c66-452a-827b-1c8c41769e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:08.644502 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-33efc48c-5c66-452a-827b-1c8c41769e6b None None] MFA Rules not processed for user `cc7b0ea626834a1090c73a67f8b099dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:08.646129 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-33efc48c-5c66-452a-827b-1c8c41769e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:08.733577 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1004/2020] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:08 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:08.824992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547361cf-be05-4809-a1b2-6cea892c272e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:08.827013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-547361cf-be05-4809-a1b2-6cea892c272e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:08.906239 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547361cf-be05-4809-a1b2-6cea892c272e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:08.910757 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62604fad-da82-47cd-ac5f-5e7661c223ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:08.911748 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62604fad-da82-47cd-ac5f-5e7661c223ff service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:08.912160 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62604fad-da82-47cd-ac5f-5e7661c223ff service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:08.912547 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62604fad-da82-47cd-ac5f-5e7661c223ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:08.922953 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62604fad-da82-47cd-ac5f-5e7661c223ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:08.924627 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62604fad-da82-47cd-ac5f-5e7661c223ff service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:08.934810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1017/2021] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:08 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:32:11.157932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efc48c-5c66-452a-827b-1c8c41769e6b None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:11.159472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-33efc48c-5c66-452a-827b-1c8c41769e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:11.224944 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efc48c-5c66-452a-827b-1c8c41769e6b None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:11.229600 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308d26e-93ea-4cc4-825b-1b83750579bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:11.230464 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d26e-93ea-4cc4-825b-1b83750579bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:11.230745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d26e-93ea-4cc4-825b-1b83750579bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:11.231061 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d26e-93ea-4cc4-825b-1b83750579bd admin admin] PATH_INFO: `/v3/users/ed20fe02852943828c36a3c0da01cbc0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:11.232256 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308d26e-93ea-4cc4-825b-1b83750579bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed20fe02852943828c36a3c0da01cbc0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:11.234165 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308d26e-93ea-4cc4-825b-1b83750579bd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:11.282241 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-5308d26e-93ea-4cc4-825b-1b83750579bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed20fe02852943828c36a3c0da01cbc0'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.293539 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-5308d26e-93ea-4cc4-825b-1b83750579bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed20fe02852943828c36a3c0da01cbc0'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.301097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-5308d26e-93ea-4cc4-825b-1b83750579bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed20fe02852943828c36a3c0da01cbc0'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.307656 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-5308d26e-93ea-4cc4-825b-1b83750579bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed20fe02852943828c36a3c0da01cbc0'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.308273 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-5308d26e-93ea-4cc4-825b-1b83750579bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed20fe02852943828c36a3c0da01cbc0'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.313908 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1005/2022] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:32:11 2021] DELETE /identity/v3/users/ed20fe02852943828c36a3c0da01cbc0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:11.318917 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f6379-3577-4035-918c-dd14cf847b8a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:11.319366 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f6379-3577-4035-918c-dd14cf847b8a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:11.319457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f6379-3577-4035-918c-dd14cf847b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:11.337189 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-ca7f6379-3577-4035-918c-dd14cf847b8a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:11.338361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-ca7f6379-3577-4035-918c-dd14cf847b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:11.391935 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1018/2023] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:11.403840 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308d26e-93ea-4cc4-825b-1b83750579bd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:11.405251 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5308d26e-93ea-4cc4-825b-1b83750579bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:11.460087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308d26e-93ea-4cc4-825b-1b83750579bd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:11.463715 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abe2a5-cbe1-4f28-86b2-10afe0d0b390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:11.464342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abe2a5-cbe1-4f28-86b2-10afe0d0b390 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:11.464619 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abe2a5-cbe1-4f28-86b2-10afe0d0b390 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:11.464919 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abe2a5-cbe1-4f28-86b2-10afe0d0b390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:11.473740 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abe2a5-cbe1-4f28-86b2-10afe0d0b390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:11.475265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abe2a5-cbe1-4f28-86b2-10afe0d0b390 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:11.484626 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1006/2024] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:32:11.690114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f6379-3577-4035-918c-dd14cf847b8a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:11.690114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-ca7f6379-3577-4035-918c-dd14cf847b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:11.724337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f6379-3577-4035-918c-dd14cf847b8a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:11.730113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf79dbf-c2b9-4185-854b-cae272deba5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:11.731255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf79dbf-c2b9-4185-854b-cae272deba5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:11.731538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf79dbf-c2b9-4185-854b-cae272deba5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:11.731814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf79dbf-c2b9-4185-854b-cae272deba5e admin admin] PATH_INFO: `/v3/users/e86ba76d348c41e5880fb48a9b95848d` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:11.733169 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf79dbf-c2b9-4185-854b-cae272deba5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e86ba76d348c41e5880fb48a9b95848d)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:11.735139 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf79dbf-c2b9-4185-854b-cae272deba5e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:11.786636 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fdf79dbf-c2b9-4185-854b-cae272deba5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e86ba76d348c41e5880fb48a9b95848d'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.799400 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fdf79dbf-c2b9-4185-854b-cae272deba5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e86ba76d348c41e5880fb48a9b95848d'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.807197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abe2a5-cbe1-4f28-86b2-10afe0d0b390 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:11.808782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-52abe2a5-cbe1-4f28-86b2-10afe0d0b390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:11.819056 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fdf79dbf-c2b9-4185-854b-cae272deba5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e86ba76d348c41e5880fb48a9b95848d'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.824785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abe2a5-cbe1-4f28-86b2-10afe0d0b390 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:11.828063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fdf79dbf-c2b9-4185-854b-cae272deba5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e86ba76d348c41e5880fb48a9b95848d'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.829179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fdf79dbf-c2b9-4185-854b-cae272deba5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e86ba76d348c41e5880fb48a9b95848d'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.830342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e440c7-a2ce-41fb-9a9e-49cc84ddb82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:11.831286 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e440c7-a2ce-41fb-9a9e-49cc84ddb82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:11.831579 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e440c7-a2ce-41fb-9a9e-49cc84ddb82e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:11.831860 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e440c7-a2ce-41fb-9a9e-49cc84ddb82e admin admin] PATH_INFO: `/v3/users/cc7b0ea626834a1090c73a67f8b099dc` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:11.833110 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e440c7-a2ce-41fb-9a9e-49cc84ddb82e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc7b0ea626834a1090c73a67f8b099dc)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:11.835219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e440c7-a2ce-41fb-9a9e-49cc84ddb82e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:11.838348 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1019/2025] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:32:11 2021] DELETE /identity/v3/users/e86ba76d348c41e5880fb48a9b95848d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:11.843206 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdc25a-fc54-468d-bcc5-a8083bf27d45 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:11.843632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdc25a-fc54-468d-bcc5-a8083bf27d45 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:11.843981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdc25a-fc54-468d-bcc5-a8083bf27d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:11.871075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-7ffdc25a-fc54-468d-bcc5-a8083bf27d45 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:11.872333 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-7ffdc25a-fc54-468d-bcc5-a8083bf27d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:11.888572 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-18e440c7-a2ce-41fb-9a9e-49cc84ddb82e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc7b0ea626834a1090c73a67f8b099dc'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.900284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-18e440c7-a2ce-41fb-9a9e-49cc84ddb82e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc7b0ea626834a1090c73a67f8b099dc'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.908043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-18e440c7-a2ce-41fb-9a9e-49cc84ddb82e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc7b0ea626834a1090c73a67f8b099dc'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.918497 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-18e440c7-a2ce-41fb-9a9e-49cc84ddb82e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc7b0ea626834a1090c73a67f8b099dc'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.919233 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-18e440c7-a2ce-41fb-9a9e-49cc84ddb82e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc7b0ea626834a1090c73a67f8b099dc'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:11.926279 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1007/2026] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:32:11 2021] DELETE /identity/v3/users/cc7b0ea626834a1090c73a67f8b099dc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:32:11.927112 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e440c7-a2ce-41fb-9a9e-49cc84ddb82e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:11.928393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-18e440c7-a2ce-41fb-9a9e-49cc84ddb82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:11.933307 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1020/2027] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:11.934618 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64b25-cd98-4042-9cec-6389bbdd8492 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:11.934942 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64b25-cd98-4042-9cec-6389bbdd8492 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:11.935223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64b25-cd98-4042-9cec-6389bbdd8492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:11.953049 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-95c64b25-cd98-4042-9cec-6389bbdd8492 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:11.954485 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-95c64b25-cd98-4042-9cec-6389bbdd8492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:11.993953 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e440c7-a2ce-41fb-9a9e-49cc84ddb82e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:11.998574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:11.999450 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:11.999909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:12.000035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] PATH_INFO: `/v3/projects/ab1ada8ab309456c8b965566b381a71a` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:12.001372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab1ada8ab309456c8b965566b381a71a)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:12.003361 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:12.016385 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1021/2028] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:12.017296 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c64b25-cd98-4042-9cec-6389bbdd8492 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:12.018577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-95c64b25-cd98-4042-9cec-6389bbdd8492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:12.049169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab1ada8ab309456c8b965566b381a71a', 'request_id': 'req-fdfcaa6f-915b-446e-b91c-af27814a8b32'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.059844 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab1ada8ab309456c8b965566b381a71a', 'request_id': 'req-fdfcaa6f-915b-446e-b91c-af27814a8b32'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.069034 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab1ada8ab309456c8b965566b381a71a', 'request_id': 'req-fdfcaa6f-915b-446e-b91c-af27814a8b32'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.080054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c64b25-cd98-4042-9cec-6389bbdd8492 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:12.080547 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] The token cache is being invalidate because project ab1ada8ab309456c8b965566b381a71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:32:12.080837 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.081495 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.083068 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1008/2029] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:32:11 2021] DELETE /identity/v3/projects/ab1ada8ab309456c8b965566b381a71a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:12.083830 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:12.085050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:12.130828 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b4f68-7404-465e-a4f1-fa3a8ceb63e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:12.131510 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b4f68-7404-465e-a4f1-fa3a8ceb63e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:12.131802 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b4f68-7404-465e-a4f1-fa3a8ceb63e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:12.132085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b4f68-7404-465e-a4f1-fa3a8ceb63e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:12.134018 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-939b4f68-7404-465e-a4f1-fa3a8ceb63e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:12.140150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcaa6f-915b-446e-b91c-af27814a8b32 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:12.143818 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171ad98-2584-4be6-902d-407097da2163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:12.144451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171ad98-2584-4be6-902d-407097da2163 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:12.144738 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171ad98-2584-4be6-902d-407097da2163 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:12.145009 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171ad98-2584-4be6-902d-407097da2163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:12.146775 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0171ad98-2584-4be6-902d-407097da2163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:12.194339 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b4f68-7404-465e-a4f1-fa3a8ceb63e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:12.195839 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b4f68-7404-465e-a4f1-fa3a8ceb63e4 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:12.205553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1022/2030] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:32:12.206592 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b4f68-7404-465e-a4f1-fa3a8ceb63e4 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:12.207714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-939b4f68-7404-465e-a4f1-fa3a8ceb63e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:12.207930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171ad98-2584-4be6-902d-407097da2163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:12.209385 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171ad98-2584-4be6-902d-407097da2163 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:12.219811 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b4f68-7404-465e-a4f1-fa3a8ceb63e4 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:12.221196 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1009/2031] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:32:12.225452 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf13fd-7f37-4b20-b8e1-7f86114a9e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:12.226399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf13fd-7f37-4b20-b8e1-7f86114a9e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:12.226760 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf13fd-7f37-4b20-b8e1-7f86114a9e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:12.227142 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf13fd-7f37-4b20-b8e1-7f86114a9e92 admin admin] PATH_INFO: `/v3/users/23fc00f70a7d42ea8a6d4aaa8e7af632` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:12.228446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf13fd-7f37-4b20-b8e1-7f86114a9e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23fc00f70a7d42ea8a6d4aaa8e7af632)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:12.230455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf13fd-7f37-4b20-b8e1-7f86114a9e92 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:12.279400 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-17cf13fd-7f37-4b20-b8e1-7f86114a9e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23fc00f70a7d42ea8a6d4aaa8e7af632'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.293063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-17cf13fd-7f37-4b20-b8e1-7f86114a9e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23fc00f70a7d42ea8a6d4aaa8e7af632'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.301197 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-17cf13fd-7f37-4b20-b8e1-7f86114a9e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23fc00f70a7d42ea8a6d4aaa8e7af632'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.308016 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-17cf13fd-7f37-4b20-b8e1-7f86114a9e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23fc00f70a7d42ea8a6d4aaa8e7af632'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.308679 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-17cf13fd-7f37-4b20-b8e1-7f86114a9e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23fc00f70a7d42ea8a6d4aaa8e7af632'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.314936 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1023/2032] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:32:12 2021] DELETE /identity/v3/users/23fc00f70a7d42ea8a6d4aaa8e7af632 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:12.754180 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171ad98-2584-4be6-902d-407097da2163 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:12.755754 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0171ad98-2584-4be6-902d-407097da2163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:12.769568 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171ad98-2584-4be6-902d-407097da2163 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:12.877036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:12.878555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:12.878945 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:12.879406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] PATH_INFO: `/v3/projects/9fed781cf7e74c96883738ab77973bd8` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:12.881309 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fed781cf7e74c96883738ab77973bd8)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:12.884870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf13fd-7f37-4b20-b8e1-7f86114a9e92 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:12.886820 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-17cf13fd-7f37-4b20-b8e1-7f86114a9e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:12.888091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:12.908181 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf13fd-7f37-4b20-b8e1-7f86114a9e92 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:12.920744 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec1703-a26c-49d9-a42e-ce385607ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:12.924032 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec1703-a26c-49d9-a42e-ce385607ce0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:12.924659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec1703-a26c-49d9-a42e-ce385607ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:12.925192 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec1703-a26c-49d9-a42e-ce385607ce0e admin admin] PATH_INFO: `/v3/projects/9f400c829ff04a3cb0d71e4628ef2417` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:12.926931 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec1703-a26c-49d9-a42e-ce385607ce0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f400c829ff04a3cb0d71e4628ef2417)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:12.929313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec1703-a26c-49d9-a42e-ce385607ce0e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:12.971380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fed781cf7e74c96883738ab77973bd8', 'request_id': 'req-940edbf6-4125-4f71-8e49-c55c632d7c56'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.976192 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fed781cf7e74c96883738ab77973bd8', 'request_id': 'req-940edbf6-4125-4f71-8e49-c55c632d7c56'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.982933 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fed781cf7e74c96883738ab77973bd8', 'request_id': 'req-940edbf6-4125-4f71-8e49-c55c632d7c56'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.996851 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] The token cache is being invalidate because project 9fed781cf7e74c96883738ab77973bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:32:12.997137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.997826 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.998765 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-47ec1703-a26c-49d9-a42e-ce385607ce0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f400c829ff04a3cb0d71e4628ef2417', 'request_id': 'req-47ec1703-a26c-49d9-a42e-ce385607ce0e'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:12.999516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1010/2033] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:32:12 2021] DELETE /identity/v3/projects/9fed781cf7e74c96883738ab77973bd8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:13.007048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.007048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:13.011462 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-47ec1703-a26c-49d9-a42e-ce385607ce0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f400c829ff04a3cb0d71e4628ef2417', 'request_id': 'req-47ec1703-a26c-49d9-a42e-ce385607ce0e'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:13.018084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-47ec1703-a26c-49d9-a42e-ce385607ce0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f400c829ff04a3cb0d71e4628ef2417', 'request_id': 'req-47ec1703-a26c-49d9-a42e-ce385607ce0e'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:13.028732 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-47ec1703-a26c-49d9-a42e-ce385607ce0e admin admin] The token cache is being invalidate because project 9f400c829ff04a3cb0d71e4628ef2417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:32:13.028982 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-47ec1703-a26c-49d9-a42e-ce385607ce0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:13.029614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-47ec1703-a26c-49d9-a42e-ce385607ce0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:13.031182 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1024/2034] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:32:12 2021] DELETE /identity/v3/projects/9f400c829ff04a3cb0d71e4628ef2417 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:13.032397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae88947-4aeb-4ea8-abaa-8077a950f56b None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.032678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae88947-4aeb-4ea8-abaa-8077a950f56b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.032971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae88947-4aeb-4ea8-abaa-8077a950f56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.051212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-6ae88947-4aeb-4ea8-abaa-8077a950f56b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:13.052427 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-6ae88947-4aeb-4ea8-abaa-8077a950f56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:13.071182 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940edbf6-4125-4f71-8e49-c55c632d7c56 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.110281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1025/2035] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:13.111778 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dfa11-1c0a-479f-a961-0ff1955bcdd4 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.113210 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dfa11-1c0a-479f-a961-0ff1955bcdd4 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.113505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dfa11-1c0a-479f-a961-0ff1955bcdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.125411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9a720-2dda-4625-951a-3567b5a0ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.126263 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9a720-2dda-4625-951a-3567b5a0ddad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.126539 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9a720-2dda-4625-951a-3567b5a0ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.126810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9a720-2dda-4625-951a-3567b5a0ddad admin admin] PATH_INFO: `/v3/projects/b9e3a61581e34208bc62621f010d9d4d` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.128694 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9a720-2dda-4625-951a-3567b5a0ddad admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e3a61581e34208bc62621f010d9d4d)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.130628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9a720-2dda-4625-951a-3567b5a0ddad admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.137236 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-649dfa11-1c0a-479f-a961-0ff1955bcdd4 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:13.138451 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-649dfa11-1c0a-479f-a961-0ff1955bcdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:13.146296 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1026/2036] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:13.147533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90cb74-d083-4a77-bdea-4c383090def8 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.147821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90cb74-d083-4a77-bdea-4c383090def8 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.148107 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90cb74-d083-4a77-bdea-4c383090def8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.165816 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-cb90cb74-d083-4a77-bdea-4c383090def8 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:13.167026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-cb90cb74-d083-4a77-bdea-4c383090def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:13.176587 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-47b9a720-2dda-4625-951a-3567b5a0ddad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e3a61581e34208bc62621f010d9d4d', 'request_id': 'req-47b9a720-2dda-4625-951a-3567b5a0ddad'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:13.183163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-47b9a720-2dda-4625-951a-3567b5a0ddad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e3a61581e34208bc62621f010d9d4d', 'request_id': 'req-47b9a720-2dda-4625-951a-3567b5a0ddad'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:13.188500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-47b9a720-2dda-4625-951a-3567b5a0ddad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e3a61581e34208bc62621f010d9d4d', 'request_id': 'req-47b9a720-2dda-4625-951a-3567b5a0ddad'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:13.199857 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-47b9a720-2dda-4625-951a-3567b5a0ddad admin admin] The token cache is being invalidate because project b9e3a61581e34208bc62621f010d9d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:32:13.200138 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-47b9a720-2dda-4625-951a-3567b5a0ddad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:13.200778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-47b9a720-2dda-4625-951a-3567b5a0ddad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:13.202314 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1011/2037] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:32:12 2021] DELETE /identity/v3/projects/b9e3a61581e34208bc62621f010d9d4d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:13.203817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91e2d0-c0a4-4105-96b0-36971f5c3820 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.204099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91e2d0-c0a4-4105-96b0-36971f5c3820 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.204372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91e2d0-c0a4-4105-96b0-36971f5c3820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.221771 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-0c91e2d0-c0a4-4105-96b0-36971f5c3820 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:13.223113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0c91e2d0-c0a4-4105-96b0-36971f5c3820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:13.224966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1027/2038] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:13.226066 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bceb3e-c3fc-49bc-8cd1-bb5cdcc129ba None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.226338 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bceb3e-c3fc-49bc-8cd1-bb5cdcc129ba None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.226648 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bceb3e-c3fc-49bc-8cd1-bb5cdcc129ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.231078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1012/2039] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:13.231846 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91e2d0-c0a4-4105-96b0-36971f5c3820 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.241409 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91e2d0-c0a4-4105-96b0-36971f5c3820 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.244750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-84bceb3e-c3fc-49bc-8cd1-bb5cdcc129ba None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:13.245940 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-84bceb3e-c3fc-49bc-8cd1-bb5cdcc129ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:13.246098 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef9dda-a12d-4bee-9b19-f3428fe0e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.246838 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef9dda-a12d-4bee-9b19-f3428fe0e799 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.247152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef9dda-a12d-4bee-9b19-f3428fe0e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.247426 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef9dda-a12d-4bee-9b19-f3428fe0e799 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.248159 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef9dda-a12d-4bee-9b19-f3428fe0e799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:32:13.248491 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef9dda-a12d-4bee-9b19-f3428fe0e799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.250137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef9dda-a12d-4bee-9b19-f3428fe0e799 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.254725 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1028/2040] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:13.255348 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bceb3e-c3fc-49bc-8cd1-bb5cdcc129ba None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.262704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1013/2041] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:32:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:32:13.263836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce03bf-9442-4aa6-828e-8e716352d9b4 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.264120 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce03bf-9442-4aa6-828e-8e716352d9b4 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.264399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce03bf-9442-4aa6-828e-8e716352d9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.264494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bceb3e-c3fc-49bc-8cd1-bb5cdcc129ba None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.270146 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d3e4c-e26b-4e86-a483-5659acc30423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.270791 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d3e4c-e26b-4e86-a483-5659acc30423 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.271210 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d3e4c-e26b-4e86-a483-5659acc30423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.271490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d3e4c-e26b-4e86-a483-5659acc30423 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.272226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d3e4c-e26b-4e86-a483-5659acc30423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:32:13.272534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d3e4c-e26b-4e86-a483-5659acc30423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.274143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d3e4c-e26b-4e86-a483-5659acc30423 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.281788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-f8ce03bf-9442-4aa6-828e-8e716352d9b4 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:13.282953 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f8ce03bf-9442-4aa6-828e-8e716352d9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:13.287707 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1029/2042] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:32:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:32:13.288504 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d3e4c-e26b-4e86-a483-5659acc30423 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.292633 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1014/2043] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:13.293402 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce03bf-9442-4aa6-828e-8e716352d9b4 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.301458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d3e4c-e26b-4e86-a483-5659acc30423 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.303182 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce03bf-9442-4aa6-828e-8e716352d9b4 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.305950 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60c73c-a5d3-436c-b9d4-2ecb553b4a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.306584 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60c73c-a5d3-436c-b9d4-2ecb553b4a46 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.306885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60c73c-a5d3-436c-b9d4-2ecb553b4a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.307169 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60c73c-a5d3-436c-b9d4-2ecb553b4a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.307745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a244be3-1e9b-43e5-9645-f7f7571ada94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.307894 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60c73c-a5d3-436c-b9d4-2ecb553b4a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.308406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244be3-1e9b-43e5-9645-f7f7571ada94 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.308692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244be3-1e9b-43e5-9645-f7f7571ada94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.308972 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244be3-1e9b-43e5-9645-f7f7571ada94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.309675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a244be3-1e9b-43e5-9645-f7f7571ada94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.309788 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60c73c-a5d3-436c-b9d4-2ecb553b4a46 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.311627 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a244be3-1e9b-43e5-9645-f7f7571ada94 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.335942 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1030/2044] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:13.339582 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1015/2045] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:13.339663 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60c73c-a5d3-436c-b9d4-2ecb553b4a46 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.340545 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a244be3-1e9b-43e5-9645-f7f7571ada94 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.400524 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60c73c-a5d3-436c-b9d4-2ecb553b4a46 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.405540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a244be3-1e9b-43e5-9645-f7f7571ada94 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.405681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662d2e4-f7cf-4b5f-876e-9bfc2e6ee15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.406271 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662d2e4-f7cf-4b5f-876e-9bfc2e6ee15b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.406553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662d2e4-f7cf-4b5f-876e-9bfc2e6ee15b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.407013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662d2e4-f7cf-4b5f-876e-9bfc2e6ee15b admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.407753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662d2e4-f7cf-4b5f-876e-9bfc2e6ee15b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:32:13.408062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662d2e4-f7cf-4b5f-876e-9bfc2e6ee15b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.409734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662d2e4-f7cf-4b5f-876e-9bfc2e6ee15b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.410860 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f6f7d-5f0e-4a72-9845-12ce41073c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.411530 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f6f7d-5f0e-4a72-9845-12ce41073c96 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.412089 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f6f7d-5f0e-4a72-9845-12ce41073c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.412219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f6f7d-5f0e-4a72-9845-12ce41073c96 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.412926 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f6f7d-5f0e-4a72-9845-12ce41073c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.415012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f6f7d-5f0e-4a72-9845-12ce41073c96 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.431680 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1031/2046] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:32:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:32:13.432599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662d2e4-f7cf-4b5f-876e-9bfc2e6ee15b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.442756 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1016/2047] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:32:13.446607 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662d2e4-f7cf-4b5f-876e-9bfc2e6ee15b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.446759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f6f7d-5f0e-4a72-9845-12ce41073c96 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.451404 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3015ac3-6845-4ed0-9f7a-927a43b34e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.452105 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3015ac3-6845-4ed0-9f7a-927a43b34e9d admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.452391 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3015ac3-6845-4ed0-9f7a-927a43b34e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.452674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3015ac3-6845-4ed0-9f7a-927a43b34e9d admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.453654 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3015ac3-6845-4ed0-9f7a-927a43b34e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.456262 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3015ac3-6845-4ed0-9f7a-927a43b34e9d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.456780 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f6f7d-5f0e-4a72-9845-12ce41073c96 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.462177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16265d65-d5be-46c2-ae95-740b6a7cc314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.462823 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16265d65-d5be-46c2-ae95-740b6a7cc314 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.463308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16265d65-d5be-46c2-ae95-740b6a7cc314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.463588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16265d65-d5be-46c2-ae95-740b6a7cc314 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.464296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16265d65-d5be-46c2-ae95-740b6a7cc314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.466388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16265d65-d5be-46c2-ae95-740b6a7cc314 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.477822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1032/2048] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:13.478541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3015ac3-6845-4ed0-9f7a-927a43b34e9d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.489706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3015ac3-6845-4ed0-9f7a-927a43b34e9d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.494205 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1017/2049] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:13.494659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915512a-7b55-4d7e-90ae-df9dee591182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.495411 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915512a-7b55-4d7e-90ae-df9dee591182 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.495695 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915512a-7b55-4d7e-90ae-df9dee591182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.495973 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915512a-7b55-4d7e-90ae-df9dee591182 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.496262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16265d65-d5be-46c2-ae95-740b6a7cc314 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.496709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915512a-7b55-4d7e-90ae-df9dee591182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.498398 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915512a-7b55-4d7e-90ae-df9dee591182 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.509448 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1033/2050] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:13.510209 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915512a-7b55-4d7e-90ae-df9dee591182 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.519386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915512a-7b55-4d7e-90ae-df9dee591182 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.559661 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16265d65-d5be-46c2-ae95-740b6a7cc314 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.566224 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226de9d-2dad-4ce4-a6f2-0e06528bd0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.567196 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226de9d-2dad-4ce4-a6f2-0e06528bd0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.567498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226de9d-2dad-4ce4-a6f2-0e06528bd0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.567907 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226de9d-2dad-4ce4-a6f2-0e06528bd0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.569803 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226de9d-2dad-4ce4-a6f2-0e06528bd0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.570609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226de9d-2dad-4ce4-a6f2-0e06528bd0f0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.577300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8547fc8-9338-4def-a2a9-909a4cef0df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.577973 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547fc8-9338-4def-a2a9-909a4cef0df2 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.578509 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547fc8-9338-4def-a2a9-909a4cef0df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.578787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547fc8-9338-4def-a2a9-909a4cef0df2 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.579609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8547fc8-9338-4def-a2a9-909a4cef0df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.581861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8547fc8-9338-4def-a2a9-909a4cef0df2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.581974 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1018/2051] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:13 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:13.582485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226de9d-2dad-4ce4-a6f2-0e06528bd0f0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.592930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226de9d-2dad-4ce4-a6f2-0e06528bd0f0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.599125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf74aba-0e45-444c-b99e-12b96c765109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.599817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf74aba-0e45-444c-b99e-12b96c765109 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.600104 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf74aba-0e45-444c-b99e-12b96c765109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.600390 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf74aba-0e45-444c-b99e-12b96c765109 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.601138 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf74aba-0e45-444c-b99e-12b96c765109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.602904 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf74aba-0e45-444c-b99e-12b96c765109 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.604380 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1034/2052] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:13.609571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8547fc8-9338-4def-a2a9-909a4cef0df2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.614481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1019/2053] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:13.615565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf74aba-0e45-444c-b99e-12b96c765109 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.622731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8547fc8-9338-4def-a2a9-909a4cef0df2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.625938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf74aba-0e45-444c-b99e-12b96c765109 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.627426 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8949f-e0ee-48b2-86d5-c438e67b026b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.628119 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8949f-e0ee-48b2-86d5-c438e67b026b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.628402 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8949f-e0ee-48b2-86d5-c438e67b026b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.628842 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8949f-e0ee-48b2-86d5-c438e67b026b admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.629585 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8949f-e0ee-48b2-86d5-c438e67b026b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.631041 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe7f60-9eef-4733-a1ca-8c27059054d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.631690 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe7f60-9eef-4733-a1ca-8c27059054d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.631973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe7f60-9eef-4733-a1ca-8c27059054d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.632161 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8949f-e0ee-48b2-86d5-c438e67b026b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.632399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe7f60-9eef-4733-a1ca-8c27059054d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.633164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe7f60-9eef-4733-a1ca-8c27059054d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.634781 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe7f60-9eef-4733-a1ca-8c27059054d1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.643674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1035/2054] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:13 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:13.644644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8949f-e0ee-48b2-86d5-c438e67b026b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.645352 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1020/2055] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:13.650296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe7f60-9eef-4733-a1ca-8c27059054d1 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.655355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8949f-e0ee-48b2-86d5-c438e67b026b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.662546 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe7f60-9eef-4733-a1ca-8c27059054d1 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.667314 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54764dbc-ad84-4371-91df-d552f5e0cbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.667970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54764dbc-ad84-4371-91df-d552f5e0cbeb admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.668188 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d9f3b-13d5-4d69-b0a5-f8f1b34548db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.668303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54764dbc-ad84-4371-91df-d552f5e0cbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.668521 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54764dbc-ad84-4371-91df-d552f5e0cbeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.669079 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d9f3b-13d5-4d69-b0a5-f8f1b34548db admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.669270 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54764dbc-ad84-4371-91df-d552f5e0cbeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.669366 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d9f3b-13d5-4d69-b0a5-f8f1b34548db admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.669621 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d9f3b-13d5-4d69-b0a5-f8f1b34548db admin admin] PATH_INFO: `/v3/projects/49e0bfabf6884c7baee87ee0d4820bf5/users/d8323a0faaca4e748e8b1ed86cb813d5/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.670909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54764dbc-ad84-4371-91df-d552f5e0cbeb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.685975 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1021/2056] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:13 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:32:13.686161 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d9f3b-13d5-4d69-b0a5-f8f1b34548db admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e0bfabf6884c7baee87ee0d4820bf5, user_id=d8323a0faaca4e748e8b1ed86cb813d5, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.686921 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54764dbc-ad84-4371-91df-d552f5e0cbeb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.689461 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d9f3b-13d5-4d69-b0a5-f8f1b34548db admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.698284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54764dbc-ad84-4371-91df-d552f5e0cbeb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.705240 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1036/2057] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:13 2021] PUT /identity/v3/projects/49e0bfabf6884c7baee87ee0d4820bf5/users/d8323a0faaca4e748e8b1ed86cb813d5/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:13.706063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d9f3b-13d5-4d69-b0a5-f8f1b34548db admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.764779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009aee9e-52ad-47b4-a076-7bf5b1a3967f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.765723 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aee9e-52ad-47b4-a076-7bf5b1a3967f admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.766007 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aee9e-52ad-47b4-a076-7bf5b1a3967f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.766284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aee9e-52ad-47b4-a076-7bf5b1a3967f admin admin] PATH_INFO: `/v3/projects/c38faa56e5864d3aba51e1e8351e3a93/users/5ed1331bcb0e4fe4a53379d1d72f650a/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.771105 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d9f3b-13d5-4d69-b0a5-f8f1b34548db admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:13.775953 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348ae50-784f-4ea8-8943-1c4df6aae45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:13.776832 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348ae50-784f-4ea8-8943-1c4df6aae45e admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.777118 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348ae50-784f-4ea8-8943-1c4df6aae45e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.777397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348ae50-784f-4ea8-8943-1c4df6aae45e admin admin] PATH_INFO: `/v3/projects/64c907521b8f4a8c9411767e09332eb9/users/72b804fe4e3a4af98b41206298b53845/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.780897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009aee9e-52ad-47b4-a076-7bf5b1a3967f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38faa56e5864d3aba51e1e8351e3a93, user_id=5ed1331bcb0e4fe4a53379d1d72f650a, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.784754 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009aee9e-52ad-47b4-a076-7bf5b1a3967f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.792857 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348ae50-784f-4ea8-8943-1c4df6aae45e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c907521b8f4a8c9411767e09332eb9, user_id=72b804fe4e3a4af98b41206298b53845, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:13.795645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348ae50-784f-4ea8-8943-1c4df6aae45e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:13.799932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1022/2058] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:13 2021] PUT /identity/v3/projects/c38faa56e5864d3aba51e1e8351e3a93/users/5ed1331bcb0e4fe4a53379d1d72f650a/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:13.801575 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1419-f2d0-4c0a-bedc-a91315ebd0f4 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.802142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1419-f2d0-4c0a-bedc-a91315ebd0f4 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.802142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1419-f2d0-4c0a-bedc-a91315ebd0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.815107 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1037/2059] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:13 2021] PUT /identity/v3/projects/64c907521b8f4a8c9411767e09332eb9/users/72b804fe4e3a4af98b41206298b53845/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:13.816856 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92267c7-2c78-4560-87c2-300cd8c25119 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.817157 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92267c7-2c78-4560-87c2-300cd8c25119 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.817490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92267c7-2c78-4560-87c2-300cd8c25119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.834943 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-c92267c7-2c78-4560-87c2-300cd8c25119 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:13.836162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c92267c7-2c78-4560-87c2-300cd8c25119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:13.841482 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-fe3a1419-f2d0-4c0a-bedc-a91315ebd0f4 None None] MFA Rules not processed for user `d8323a0faaca4e748e8b1ed86cb813d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:13.842800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-fe3a1419-f2d0-4c0a-bedc-a91315ebd0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:13.901666 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1038/2060] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:13.903282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a302828-0726-4321-89e4-614b89583ae8 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:13.903645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a302828-0726-4321-89e4-614b89583ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:13.904000 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a302828-0726-4321-89e4-614b89583ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:13.920738 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1023/2061] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:13.921750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a1419-f2d0-4c0a-bedc-a91315ebd0f4 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:13.923071 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-fe3a1419-f2d0-4c0a-bedc-a91315ebd0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:13.940606 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-0a302828-0726-4321-89e4-614b89583ae8 None None] MFA Rules not processed for user `72b804fe4e3a4af98b41206298b53845`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:13.941829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-0a302828-0726-4321-89e4-614b89583ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:14.017852 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a1419-f2d0-4c0a-bedc-a91315ebd0f4 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:14.022488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced5fbd-012a-42d5-a7f1-3086b47ceae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:14.023197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced5fbd-012a-42d5-a7f1-3086b47ceae2 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:14.023483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced5fbd-012a-42d5-a7f1-3086b47ceae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:14.023764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced5fbd-012a-42d5-a7f1-3086b47ceae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:14.035906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced5fbd-012a-42d5-a7f1-3086b47ceae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:14.037372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced5fbd-012a-42d5-a7f1-3086b47ceae2 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:14.050296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1024/2062] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:32:14.051124 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced5fbd-012a-42d5-a7f1-3086b47ceae2 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:14.052450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1039/2063] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:13 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:14.055532 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-fced5fbd-012a-42d5-a7f1-3086b47ceae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:14.057708 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a302828-0726-4321-89e4-614b89583ae8 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:14.075199 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a302828-0726-4321-89e4-614b89583ae8 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:14.081759 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36341581-5c14-44ee-83cf-9b501244306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:14.083743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36341581-5c14-44ee-83cf-9b501244306c admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:14.083887 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36341581-5c14-44ee-83cf-9b501244306c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:14.084212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36341581-5c14-44ee-83cf-9b501244306c admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:14.084946 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36341581-5c14-44ee-83cf-9b501244306c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:14.087120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36341581-5c14-44ee-83cf-9b501244306c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:14.125625 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1040/2064] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:32:14 2021] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:14.129670 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36341581-5c14-44ee-83cf-9b501244306c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:14.137687 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced5fbd-012a-42d5-a7f1-3086b47ceae2 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:14.192243 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0e6d7-1b30-4097-b768-fb8c02e974f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:14.192938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0e6d7-1b30-4097-b768-fb8c02e974f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:14.193228 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0e6d7-1b30-4097-b768-fb8c02e974f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:14.193502 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0e6d7-1b30-4097-b768-fb8c02e974f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:14.199575 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36341581-5c14-44ee-83cf-9b501244306c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:14.204812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c6dd9-aef0-4683-a6da-78f2c6e3729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:14.205606 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c6dd9-aef0-4683-a6da-78f2c6e3729d admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:14.206655 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c6dd9-aef0-4683-a6da-78f2c6e3729d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:14.206944 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c6dd9-aef0-4683-a6da-78f2c6e3729d admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:14.207741 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c6dd9-aef0-4683-a6da-78f2c6e3729d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:14.209834 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c6dd9-aef0-4683-a6da-78f2c6e3729d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:14.234742 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1041/2065] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:32:14 2021] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:32:14.241496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c6dd9-aef0-4683-a6da-78f2c6e3729d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:14.251306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c6dd9-aef0-4683-a6da-78f2c6e3729d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:14.256609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2265c-5700-4ec8-ad12-739dd1a7a2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:14.257280 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2265c-5700-4ec8-ad12-739dd1a7a2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:14.257553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2265c-5700-4ec8-ad12-739dd1a7a2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:14.257835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2265c-5700-4ec8-ad12-739dd1a7a2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:14.258737 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2265c-5700-4ec8-ad12-739dd1a7a2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:14.260382 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2265c-5700-4ec8-ad12-739dd1a7a2a6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:14.272445 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1042/2066] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:32:14.274722 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0e6d7-1b30-4097-b768-fb8c02e974f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:14.276451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0e6d7-1b30-4097-b768-fb8c02e974f3 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:14.278410 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2265c-5700-4ec8-ad12-739dd1a7a2a6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:14.287870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1025/2067] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:14 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:32:14.289467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2265c-5700-4ec8-ad12-739dd1a7a2a6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:14.296019 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bf70f-4d19-4c99-b71c-9d9ccf0c59ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:14.297134 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bf70f-4d19-4c99-b71c-9d9ccf0c59ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:14.297504 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bf70f-4d19-4c99-b71c-9d9ccf0c59ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:14.297870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bf70f-4d19-4c99-b71c-9d9ccf0c59ad admin admin] PATH_INFO: `/v3/projects/ed72e442ae0747e6bae149f54b8e6e21/users/3a23658262f34f1db05b023bc8cca81c/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:14.323735 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bf70f-4d19-4c99-b71c-9d9ccf0c59ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed72e442ae0747e6bae149f54b8e6e21, user_id=3a23658262f34f1db05b023bc8cca81c, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:14.326404 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bf70f-4d19-4c99-b71c-9d9ccf0c59ad admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:14.341651 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1043/2068] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:14 2021] PUT /identity/v3/projects/ed72e442ae0747e6bae149f54b8e6e21/users/3a23658262f34f1db05b023bc8cca81c/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:32:14.346469 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0e6d7-1b30-4097-b768-fb8c02e974f3 service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:14.357820 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0e6d7-1b30-4097-b768-fb8c02e974f3 service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:14.428378 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01659cd6-4f9b-474d-8be5-fc5d20aca286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:14.429126 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01659cd6-4f9b-474d-8be5-fc5d20aca286 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:14.429448 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01659cd6-4f9b-474d-8be5-fc5d20aca286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:14.429759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01659cd6-4f9b-474d-8be5-fc5d20aca286 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:14.430543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01659cd6-4f9b-474d-8be5-fc5d20aca286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:14.435956 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01659cd6-4f9b-474d-8be5-fc5d20aca286 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:14.449140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1026/2069] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:14 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:14.453914 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bf70f-4d19-4c99-b71c-9d9ccf0c59ad admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:14.476190 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bf70f-4d19-4c99-b71c-9d9ccf0c59ad admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:14.483248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7e30b-93fe-4127-be1f-e1b33ce0ad69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:14.487352 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7e30b-93fe-4127-be1f-e1b33ce0ad69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:14.487653 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7e30b-93fe-4127-be1f-e1b33ce0ad69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:14.487940 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7e30b-93fe-4127-be1f-e1b33ce0ad69 admin admin] PATH_INFO: `/v3/projects/ed72e442ae0747e6bae149f54b8e6e21/users/3a23658262f34f1db05b023bc8cca81c/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:14.490743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7e30b-93fe-4127-be1f-e1b33ce0ad69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed72e442ae0747e6bae149f54b8e6e21, user_id=3a23658262f34f1db05b023bc8cca81c, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:14.494056 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7e30b-93fe-4127-be1f-e1b33ce0ad69 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:14.510979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1044/2070] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:14 2021] PUT /identity/v3/projects/ed72e442ae0747e6bae149f54b8e6e21/users/3a23658262f34f1db05b023bc8cca81c/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:14.525597 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ba5e8-84c7-4447-8e6b-6493a09d5259 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:14.525942 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ba5e8-84c7-4447-8e6b-6493a09d5259 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:14.526198 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ba5e8-84c7-4447-8e6b-6493a09d5259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:14.556461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-2a1ba5e8-84c7-4447-8e6b-6493a09d5259 None None] MFA Rules not processed for user `3a23658262f34f1db05b023bc8cca81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:14.557792 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-2a1ba5e8-84c7-4447-8e6b-6493a09d5259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:14.673314 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1027/2071] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:14 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:14.685784 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7e30b-93fe-4127-be1f-e1b33ce0ad69 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:14.770237 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7e30b-93fe-4127-be1f-e1b33ce0ad69 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:14.776630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c06b1a-79c9-4556-9590-fb48a554daed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:14.777593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06b1a-79c9-4556-9590-fb48a554daed service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:14.778062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06b1a-79c9-4556-9590-fb48a554daed service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:14.778886 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06b1a-79c9-4556-9590-fb48a554daed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:14.792840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c06b1a-79c9-4556-9590-fb48a554daed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:14.794975 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c06b1a-79c9-4556-9590-fb48a554daed service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:14.807961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1045/2072] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:14 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:32:14.893435 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ba5e8-84c7-4447-8e6b-6493a09d5259 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:14.904784 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ba5e8-84c7-4447-8e6b-6493a09d5259 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:14.908464 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6861b-0ac7-4cb1-8612-73424c45f5d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:14.909176 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6861b-0ac7-4cb1-8612-73424c45f5d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:14.909445 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6861b-0ac7-4cb1-8612-73424c45f5d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:14.909719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6861b-0ac7-4cb1-8612-73424c45f5d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:14.994125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6861b-0ac7-4cb1-8612-73424c45f5d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:14.995646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6861b-0ac7-4cb1-8612-73424c45f5d6 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:15.005175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1028/2073] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:14 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:32:18.615555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf49b5b-3fef-40c0-b5ad-90868e2777c0 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:18.616051 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf49b5b-3fef-40c0-b5ad-90868e2777c0 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:18.616157 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf49b5b-3fef-40c0-b5ad-90868e2777c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:18.648210 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-3bf49b5b-3fef-40c0-b5ad-90868e2777c0 None None] MFA Rules not processed for user `5ed1331bcb0e4fe4a53379d1d72f650a`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:18.649433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3bf49b5b-3fef-40c0-b5ad-90868e2777c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:18.734963 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1046/2074] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:18 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:18.738441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6861b-0ac7-4cb1-8612-73424c45f5d6 service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:18.821077 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6861b-0ac7-4cb1-8612-73424c45f5d6 service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:18.825947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9c923-1be2-433a-a2d4-e2a2d191eed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:18.826607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c923-1be2-433a-a2d4-e2a2d191eed0 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:18.826985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c923-1be2-433a-a2d4-e2a2d191eed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:18.827349 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c923-1be2-433a-a2d4-e2a2d191eed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:18.828341 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9c923-1be2-433a-a2d4-e2a2d191eed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:18.830261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9c923-1be2-433a-a2d4-e2a2d191eed0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:18.862395 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1029/2075] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:32:18 2021] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:18.863570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf49b5b-3fef-40c0-b5ad-90868e2777c0 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:18.875693 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf49b5b-3fef-40c0-b5ad-90868e2777c0 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:18.942979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b0b9f-8294-41af-ac4c-51573272264f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:18.944019 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b0b9f-8294-41af-ac4c-51573272264f admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:18.944309 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b0b9f-8294-41af-ac4c-51573272264f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:18.944594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b0b9f-8294-41af-ac4c-51573272264f admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:18.945326 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b0b9f-8294-41af-ac4c-51573272264f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:18.947449 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b0b9f-8294-41af-ac4c-51573272264f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:18.973366 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1047/2076] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:32:18 2021] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:32:18.977387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9c923-1be2-433a-a2d4-e2a2d191eed0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:18.989873 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9c923-1be2-433a-a2d4-e2a2d191eed0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:18.994690 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb13602-b6c1-4851-9cec-10f94f9bea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:18.995527 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb13602-b6c1-4851-9cec-10f94f9bea4a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:18.995817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb13602-b6c1-4851-9cec-10f94f9bea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:18.996096 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb13602-b6c1-4851-9cec-10f94f9bea4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:18.996857 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb13602-b6c1-4851-9cec-10f94f9bea4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:18.998717 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb13602-b6c1-4851-9cec-10f94f9bea4a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:19.012399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1030/2077] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:18 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:19.016467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b0b9f-8294-41af-ac4c-51573272264f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:19.028011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b0b9f-8294-41af-ac4c-51573272264f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:19.033680 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ead79-a451-4c64-8b99-5b1e2ef6c6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:19.035026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ead79-a451-4c64-8b99-5b1e2ef6c6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:19.035167 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ead79-a451-4c64-8b99-5b1e2ef6c6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:19.035549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ead79-a451-4c64-8b99-5b1e2ef6c6a3 admin admin] PATH_INFO: `/v3/projects/bad08717445b4feeb99a5015417b271c/users/ff8e646555cd4696be2d23a31f2476d9/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:19.053245 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ead79-a451-4c64-8b99-5b1e2ef6c6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad08717445b4feeb99a5015417b271c, user_id=ff8e646555cd4696be2d23a31f2476d9, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:19.057485 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ead79-a451-4c64-8b99-5b1e2ef6c6a3 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:19.078287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1048/2078] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:19 2021] PUT /identity/v3/projects/bad08717445b4feeb99a5015417b271c/users/ff8e646555cd4696be2d23a31f2476d9/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:19.082902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb13602-b6c1-4851-9cec-10f94f9bea4a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:19.093413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb13602-b6c1-4851-9cec-10f94f9bea4a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:19.150636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999dc0aa-7e96-4002-9246-3f7723a4eeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:19.151337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dc0aa-7e96-4002-9246-3f7723a4eeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:19.151618 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dc0aa-7e96-4002-9246-3f7723a4eeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:19.151890 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dc0aa-7e96-4002-9246-3f7723a4eeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:19.152631 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999dc0aa-7e96-4002-9246-3f7723a4eeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:19.154254 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999dc0aa-7e96-4002-9246-3f7723a4eeb6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:19.164439 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1031/2079] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:19 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:32:19.168420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ead79-a451-4c64-8b99-5b1e2ef6c6a3 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:19.180873 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ead79-a451-4c64-8b99-5b1e2ef6c6a3 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:19.185604 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f1417-3fb7-4032-aa13-babd06bac481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:19.186477 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f1417-3fb7-4032-aa13-babd06bac481 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:19.186765 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f1417-3fb7-4032-aa13-babd06bac481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:19.187083 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f1417-3fb7-4032-aa13-babd06bac481 admin admin] PATH_INFO: `/v3/projects/bad08717445b4feeb99a5015417b271c/users/ff8e646555cd4696be2d23a31f2476d9/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:19.189090 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f1417-3fb7-4032-aa13-babd06bac481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad08717445b4feeb99a5015417b271c, user_id=ff8e646555cd4696be2d23a31f2476d9, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:19.192358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f1417-3fb7-4032-aa13-babd06bac481 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:19.202375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1049/2080] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:19 2021] PUT /identity/v3/projects/bad08717445b4feeb99a5015417b271c/users/ff8e646555cd4696be2d23a31f2476d9/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:24.270186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34af29d-80bc-450c-aea7-892d53650635 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:24.270695 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34af29d-80bc-450c-aea7-892d53650635 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:24.270695 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34af29d-80bc-450c-aea7-892d53650635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:24.297155 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-d34af29d-80bc-450c-aea7-892d53650635 None None] MFA Rules not processed for user `ff8e646555cd4696be2d23a31f2476d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:24.298360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-d34af29d-80bc-450c-aea7-892d53650635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:24.378275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1032/2081] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:24 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:24.390354 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f1417-3fb7-4032-aa13-babd06bac481 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:24.392141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e26f1417-3fb7-4032-aa13-babd06bac481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:24.459904 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f1417-3fb7-4032-aa13-babd06bac481 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:24.467760 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0016-7edd-4188-bfd6-da664696eba0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9aff45fefe408fa1667e5298f8ff6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:24.468577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0016-7edd-4188-bfd6-da664696eba0 service glance] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:24.468933 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0016-7edd-4188-bfd6-da664696eba0 service glance] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:24.469279 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0016-7edd-4188-bfd6-da664696eba0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:24.525439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b0016-7edd-4188-bfd6-da664696eba0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:24.526918 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b0016-7edd-4188-bfd6-da664696eba0 service glance] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:24.537182 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1050/2082] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:24 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:32:24.680105 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a34035-d85e-4816-a6b6-46a4d71e88a3 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:24.680396 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a34035-d85e-4816-a6b6-46a4d71e88a3 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:24.680678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a34035-d85e-4816-a6b6-46a4d71e88a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:24.699914 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-99a34035-d85e-4816-a6b6-46a4d71e88a3 None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:24.701175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-99a34035-d85e-4816-a6b6-46a4d71e88a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:24.757786 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1033/2083] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:32:24 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:24.801002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0016-7edd-4188-bfd6-da664696eba0 service glance] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:24.802398 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-1c8b0016-7edd-4188-bfd6-da664696eba0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:24.873214 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0016-7edd-4188-bfd6-da664696eba0 service glance] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:24.878640 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfccfaf-24a4-4e48-a9d8-ba2ec4fe2f98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:24.879314 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfccfaf-24a4-4e48-a9d8-ba2ec4fe2f98 service swift] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:24.879596 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfccfaf-24a4-4e48-a9d8-ba2ec4fe2f98 service swift] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:24.879871 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfccfaf-24a4-4e48-a9d8-ba2ec4fe2f98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:24.887868 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfccfaf-24a4-4e48-a9d8-ba2ec4fe2f98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:24.889429 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfccfaf-24a4-4e48-a9d8-ba2ec4fe2f98 service swift] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:24.897848 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1051/2084] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:32:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:32:34.566617 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07215b15-c4f0-470d-b042-dce1930d9201 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:34.567237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07215b15-c4f0-470d-b042-dce1930d9201 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:34.567237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07215b15-c4f0-470d-b042-dce1930d9201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:34.585271 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-07215b15-c4f0-470d-b042-dce1930d9201 None None] MFA Rules not processed for user `5ed1331bcb0e4fe4a53379d1d72f650a`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:34.586489 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-07215b15-c4f0-470d-b042-dce1930d9201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:34.594886 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1034/2085] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:34 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:35.508338 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502ff9-36f5-4b2b-9ae6-7ca08437a256 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:35.509256 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502ff9-36f5-4b2b-9ae6-7ca08437a256 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:35.510060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502ff9-36f5-4b2b-9ae6-7ca08437a256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:35.536888 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-22502ff9-36f5-4b2b-9ae6-7ca08437a256 None None] MFA Rules not processed for user `df94523ab7c545f2a17a2cafe936d2ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:35.538554 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-22502ff9-36f5-4b2b-9ae6-7ca08437a256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:35.616101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1052/2086] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:35 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:36.809497 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82303c5a-f0a5-4577-9535-0482c9178bfa None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:36.811275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82303c5a-f0a5-4577-9535-0482c9178bfa None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:36.811745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82303c5a-f0a5-4577-9535-0482c9178bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:36.839918 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-82303c5a-f0a5-4577-9535-0482c9178bfa None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:36.841163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-82303c5a-f0a5-4577-9535-0482c9178bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:36.871079 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1035/2087] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:32:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:32:36.888496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22502ff9-36f5-4b2b-9ae6-7ca08437a256 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:36.910763 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22502ff9-36f5-4b2b-9ae6-7ca08437a256 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:36.932202 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe8d7-9bcb-4dc1-a496-b849b378ae28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:36.933914 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe8d7-9bcb-4dc1-a496-b849b378ae28 service swift] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:36.934207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe8d7-9bcb-4dc1-a496-b849b378ae28 service swift] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:36.934541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe8d7-9bcb-4dc1-a496-b849b378ae28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:36.978014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe8d7-9bcb-4dc1-a496-b849b378ae28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:36.979903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe8d7-9bcb-4dc1-a496-b849b378ae28 service swift] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:37.000592 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1053/2088] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:32:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:32:49.068763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82303c5a-f0a5-4577-9535-0482c9178bfa None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:49.136275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82303c5a-f0a5-4577-9535-0482c9178bfa None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:49.141428 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ca790-3f20-4cc0-ba0d-14883a8550ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:49.142327 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ca790-3f20-4cc0-ba0d-14883a8550ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:49.142618 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ca790-3f20-4cc0-ba0d-14883a8550ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:49.142886 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ca790-3f20-4cc0-ba0d-14883a8550ed admin admin] PATH_INFO: `/v3/users/d8323a0faaca4e748e8b1ed86cb813d5` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:49.144122 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ca790-3f20-4cc0-ba0d-14883a8550ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8323a0faaca4e748e8b1ed86cb813d5)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:49.146083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ca790-3f20-4cc0-ba0d-14883a8550ed admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:49.192144 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b23ca790-3f20-4cc0-ba0d-14883a8550ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8323a0faaca4e748e8b1ed86cb813d5'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:49.203684 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b23ca790-3f20-4cc0-ba0d-14883a8550ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8323a0faaca4e748e8b1ed86cb813d5'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:49.210823 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b23ca790-3f20-4cc0-ba0d-14883a8550ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8323a0faaca4e748e8b1ed86cb813d5'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:49.219731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b23ca790-3f20-4cc0-ba0d-14883a8550ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8323a0faaca4e748e8b1ed86cb813d5'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:49.220561 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b23ca790-3f20-4cc0-ba0d-14883a8550ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8323a0faaca4e748e8b1ed86cb813d5'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:49.226796 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1036/2089] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:32:49 2021] DELETE /identity/v3/users/d8323a0faaca4e748e8b1ed86cb813d5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:49.232733 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577875df-f6ed-42cc-a311-08e2ea4e270c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:49.233294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577875df-f6ed-42cc-a311-08e2ea4e270c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:49.233403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577875df-f6ed-42cc-a311-08e2ea4e270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:49.256049 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-577875df-f6ed-42cc-a311-08e2ea4e270c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:49.257435 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-577875df-f6ed-42cc-a311-08e2ea4e270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:49.322120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1054/2090] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:32:49.332710 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ca790-3f20-4cc0-ba0d-14883a8550ed admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:49.334406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b23ca790-3f20-4cc0-ba0d-14883a8550ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:49.395667 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ca790-3f20-4cc0-ba0d-14883a8550ed admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:49.400681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e482e6-39ec-4b6a-b2f7-398cf9be1666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:49.401366 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e482e6-39ec-4b6a-b2f7-398cf9be1666 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:49.401810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e482e6-39ec-4b6a-b2f7-398cf9be1666 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:49.402196 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e482e6-39ec-4b6a-b2f7-398cf9be1666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:49.412275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e482e6-39ec-4b6a-b2f7-398cf9be1666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:49.413796 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e482e6-39ec-4b6a-b2f7-398cf9be1666 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:49.426208 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1037/2091] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:32:49.731524 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577875df-f6ed-42cc-a311-08e2ea4e270c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:49.732947 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-577875df-f6ed-42cc-a311-08e2ea4e270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:49.746840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577875df-f6ed-42cc-a311-08e2ea4e270c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:49.753274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a65d51-a3b5-4d32-ba37-223ff2050fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:49.754176 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a65d51-a3b5-4d32-ba37-223ff2050fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:49.754455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a65d51-a3b5-4d32-ba37-223ff2050fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:49.754727 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a65d51-a3b5-4d32-ba37-223ff2050fc2 admin admin] PATH_INFO: `/v3/projects/49e0bfabf6884c7baee87ee0d4820bf5` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:49.755958 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a65d51-a3b5-4d32-ba37-223ff2050fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e0bfabf6884c7baee87ee0d4820bf5)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:49.757960 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a65d51-a3b5-4d32-ba37-223ff2050fc2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:49.837139 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-09a65d51-a3b5-4d32-ba37-223ff2050fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e0bfabf6884c7baee87ee0d4820bf5', 'request_id': 'req-09a65d51-a3b5-4d32-ba37-223ff2050fc2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:49.845580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-09a65d51-a3b5-4d32-ba37-223ff2050fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e0bfabf6884c7baee87ee0d4820bf5', 'request_id': 'req-09a65d51-a3b5-4d32-ba37-223ff2050fc2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:49.853412 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-09a65d51-a3b5-4d32-ba37-223ff2050fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e0bfabf6884c7baee87ee0d4820bf5', 'request_id': 'req-09a65d51-a3b5-4d32-ba37-223ff2050fc2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:49.864936 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-09a65d51-a3b5-4d32-ba37-223ff2050fc2 admin admin] The token cache is being invalidate because project 49e0bfabf6884c7baee87ee0d4820bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:32:49.865224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-09a65d51-a3b5-4d32-ba37-223ff2050fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:49.866082 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-09a65d51-a3b5-4d32-ba37-223ff2050fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:49.868149 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1055/2092] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:32:49 2021] DELETE /identity/v3/projects/49e0bfabf6884c7baee87ee0d4820bf5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:49.874033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d14fc-350f-45b5-930b-c79035d94d04 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:49.874535 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d14fc-350f-45b5-930b-c79035d94d04 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:49.875033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d14fc-350f-45b5-930b-c79035d94d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:49.893406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a89d14fc-350f-45b5-930b-c79035d94d04 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:49.894604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a89d14fc-350f-45b5-930b-c79035d94d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:49.976264 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1038/2093] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:32:49.984237 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697a9c5-6e03-4bce-ab68-22b45b5262c2 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:49.984528 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697a9c5-6e03-4bce-ab68-22b45b5262c2 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:49.984808 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697a9c5-6e03-4bce-ab68-22b45b5262c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.003028 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-9697a9c5-6e03-4bce-ab68-22b45b5262c2 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:50.004223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9697a9c5-6e03-4bce-ab68-22b45b5262c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:50.012217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1056/2094] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:50.016786 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d14fc-350f-45b5-930b-c79035d94d04 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:50.026411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d14fc-350f-45b5-930b-c79035d94d04 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:50.038947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa705c4-39c4-4672-ab4e-291d34aee07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:50.039846 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa705c4-39c4-4672-ab4e-291d34aee07c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:50.040133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa705c4-39c4-4672-ab4e-291d34aee07c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:50.041179 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa705c4-39c4-4672-ab4e-291d34aee07c admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.042039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa705c4-39c4-4672-ab4e-291d34aee07c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:32:50.042355 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa705c4-39c4-4672-ab4e-291d34aee07c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:50.044251 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa705c4-39c4-4672-ab4e-291d34aee07c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:50.060535 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1039/2095] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:32:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:32:50.061672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697a9c5-6e03-4bce-ab68-22b45b5262c2 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:50.071235 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697a9c5-6e03-4bce-ab68-22b45b5262c2 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:50.076293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401f625-6eab-420c-b5d6-46e66de826e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:50.076955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401f625-6eab-420c-b5d6-46e66de826e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:50.077928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401f625-6eab-420c-b5d6-46e66de826e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:50.078257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401f625-6eab-420c-b5d6-46e66de826e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.079021 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401f625-6eab-420c-b5d6-46e66de826e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:50.081073 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401f625-6eab-420c-b5d6-46e66de826e4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:50.106405 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1057/2096] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:32:50 2021] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:32:50.110531 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa705c4-39c4-4672-ab4e-291d34aee07c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:50.120254 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa705c4-39c4-4672-ab4e-291d34aee07c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:50.173530 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3365c2-f442-4a6f-b7ef-ec8aa945f0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:50.174183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3365c2-f442-4a6f-b7ef-ec8aa945f0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:50.174469 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3365c2-f442-4a6f-b7ef-ec8aa945f0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:50.174746 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3365c2-f442-4a6f-b7ef-ec8aa945f0d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.175483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3365c2-f442-4a6f-b7ef-ec8aa945f0d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:50.177395 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3365c2-f442-4a6f-b7ef-ec8aa945f0d8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:50.202069 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1040/2097] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:32:50 2021] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:50.207580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401f625-6eab-420c-b5d6-46e66de826e4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:50.225242 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401f625-6eab-420c-b5d6-46e66de826e4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:50.233132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7e67f-f8e7-45e9-9f12-aa7bf223dbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:50.233963 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7e67f-f8e7-45e9-9f12-aa7bf223dbdc admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:50.234196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7e67f-f8e7-45e9-9f12-aa7bf223dbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:50.234481 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7e67f-f8e7-45e9-9f12-aa7bf223dbdc admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.235354 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7e67f-f8e7-45e9-9f12-aa7bf223dbdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:50.237027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7e67f-f8e7-45e9-9f12-aa7bf223dbdc admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:50.248290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1058/2098] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:50 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:50.252817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3365c2-f442-4a6f-b7ef-ec8aa945f0d8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:50.262594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3365c2-f442-4a6f-b7ef-ec8aa945f0d8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:50.267811 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35d258-0742-4989-ba39-557142c10be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:50.268453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35d258-0742-4989-ba39-557142c10be3 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:50.268731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35d258-0742-4989-ba39-557142c10be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:50.269005 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35d258-0742-4989-ba39-557142c10be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.269740 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35d258-0742-4989-ba39-557142c10be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:50.271365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35d258-0742-4989-ba39-557142c10be3 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:50.281021 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1041/2099] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:50.285153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7e67f-f8e7-45e9-9f12-aa7bf223dbdc admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:50.301752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7e67f-f8e7-45e9-9f12-aa7bf223dbdc admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:50.306546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1a820-5319-48e1-be75-1af239321a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:50.307476 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a820-5319-48e1-be75-1af239321a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:50.307763 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a820-5319-48e1-be75-1af239321a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:50.308043 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a820-5319-48e1-be75-1af239321a87 admin admin] PATH_INFO: `/v3/projects/4520f53c8e614b8e9bf69c47ce0becd0/users/74a471f2f4a44bc9b6ff64b76985365a/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.323780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1a820-5319-48e1-be75-1af239321a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4520f53c8e614b8e9bf69c47ce0becd0, user_id=74a471f2f4a44bc9b6ff64b76985365a, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:50.326721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1a820-5319-48e1-be75-1af239321a87 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:50.343758 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1059/2100] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:50 2021] PUT /identity/v3/projects/4520f53c8e614b8e9bf69c47ce0becd0/users/74a471f2f4a44bc9b6ff64b76985365a/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:50.353837 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d94004-1daf-4c70-9c1b-41d138688cdd None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:50.354417 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d94004-1daf-4c70-9c1b-41d138688cdd None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:50.354825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d94004-1daf-4c70-9c1b-41d138688cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.384306 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-b3d94004-1daf-4c70-9c1b-41d138688cdd None None] MFA Rules not processed for user `74a471f2f4a44bc9b6ff64b76985365a`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:50.385525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b3d94004-1daf-4c70-9c1b-41d138688cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:50.447366 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1042/2101] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:50 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:32:50.452068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1a820-5319-48e1-be75-1af239321a87 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:50.513533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1a820-5319-48e1-be75-1af239321a87 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:50.519137 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110a077-88a1-46dc-9f85-b8a1c411d59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:50.519980 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110a077-88a1-46dc-9f85-b8a1c411d59b admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:50.520310 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110a077-88a1-46dc-9f85-b8a1c411d59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:50.520558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110a077-88a1-46dc-9f85-b8a1c411d59b admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.521353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110a077-88a1-46dc-9f85-b8a1c411d59b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:50.523341 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110a077-88a1-46dc-9f85-b8a1c411d59b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:50.549994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1060/2102] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:32:50 2021] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:50.553859 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d94004-1daf-4c70-9c1b-41d138688cdd None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:50.565013 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d94004-1daf-4c70-9c1b-41d138688cdd None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:50.622326 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0f16-1ec4-4a37-955b-e4881fc0b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:50.623035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0f16-1ec4-4a37-955b-e4881fc0b413 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:50.623322 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0f16-1ec4-4a37-955b-e4881fc0b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:50.623600 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0f16-1ec4-4a37-955b-e4881fc0b413 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.624987 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b0f16-1ec4-4a37-955b-e4881fc0b413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:50.626928 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b0f16-1ec4-4a37-955b-e4881fc0b413 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:50.645673 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1043/2103] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:32:50 2021] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:50.649630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110a077-88a1-46dc-9f85-b8a1c411d59b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:50.660037 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110a077-88a1-46dc-9f85-b8a1c411d59b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:50.666952 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b56e2-d0bf-4ed7-9af2-621620cb61a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:50.667860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b56e2-d0bf-4ed7-9af2-621620cb61a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:50.668177 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b56e2-d0bf-4ed7-9af2-621620cb61a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:50.668526 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b56e2-d0bf-4ed7-9af2-621620cb61a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.669489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b56e2-d0bf-4ed7-9af2-621620cb61a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:50.671833 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b56e2-d0bf-4ed7-9af2-621620cb61a3 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:50.686341 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1061/2104] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:50 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:50.688137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0f16-1ec4-4a37-955b-e4881fc0b413 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:50.699662 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0f16-1ec4-4a37-955b-e4881fc0b413 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:50.704725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80fb45-063f-47a4-935e-7d5b29db97df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:50.705391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80fb45-063f-47a4-935e-7d5b29db97df admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:50.705679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80fb45-063f-47a4-935e-7d5b29db97df admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:50.705960 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80fb45-063f-47a4-935e-7d5b29db97df admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.706721 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80fb45-063f-47a4-935e-7d5b29db97df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:50.708416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80fb45-063f-47a4-935e-7d5b29db97df admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:50.719248 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1044/2105] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:50.723414 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b56e2-d0bf-4ed7-9af2-621620cb61a3 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:50.733158 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b56e2-d0bf-4ed7-9af2-621620cb61a3 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:50.738294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466aa72d-10ee-49e6-b879-02a4dc5585f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:50.739199 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aa72d-10ee-49e6-b879-02a4dc5585f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:50.739486 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aa72d-10ee-49e6-b879-02a4dc5585f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:50.739769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aa72d-10ee-49e6-b879-02a4dc5585f6 admin admin] PATH_INFO: `/v3/projects/442689fc96914ec1b2e6c31c55887b17/users/de9eebbd899a4785943418489d4536d6/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.754994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466aa72d-10ee-49e6-b879-02a4dc5585f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=442689fc96914ec1b2e6c31c55887b17, user_id=de9eebbd899a4785943418489d4536d6, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:50.758417 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466aa72d-10ee-49e6-b879-02a4dc5585f6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:50.774277 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1062/2106] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:50 2021] PUT /identity/v3/projects/442689fc96914ec1b2e6c31c55887b17/users/de9eebbd899a4785943418489d4536d6/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:32:50.785094 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dea9a-735a-49f3-93b4-bb2a63ff096c None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:50.785627 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dea9a-735a-49f3-93b4-bb2a63ff096c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:50.786054 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dea9a-735a-49f3-93b4-bb2a63ff096c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.816978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-dc6dea9a-735a-49f3-93b4-bb2a63ff096c None None] MFA Rules not processed for user `de9eebbd899a4785943418489d4536d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:50.818196 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-dc6dea9a-735a-49f3-93b4-bb2a63ff096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:50.899692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1045/2107] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:50 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:32:50.904163 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466aa72d-10ee-49e6-b879-02a4dc5585f6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:50.971229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466aa72d-10ee-49e6-b879-02a4dc5585f6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:50.976508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311231f-fc29-404e-9d28-f0fdaeb13022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:50.977177 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311231f-fc29-404e-9d28-f0fdaeb13022 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:50.977466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311231f-fc29-404e-9d28-f0fdaeb13022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:50.977958 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311231f-fc29-404e-9d28-f0fdaeb13022 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:50.979044 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311231f-fc29-404e-9d28-f0fdaeb13022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:50.980992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311231f-fc29-404e-9d28-f0fdaeb13022 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:51.012404 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1063/2108] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:32:50 2021] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:51.017139 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dea9a-735a-49f3-93b4-bb2a63ff096c None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:51.032039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dea9a-735a-49f3-93b4-bb2a63ff096c None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:51.098152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fd07b-5359-4d25-abb4-771b9bda69ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:51.098814 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fd07b-5359-4d25-abb4-771b9bda69ab admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:51.099133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fd07b-5359-4d25-abb4-771b9bda69ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:51.099412 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fd07b-5359-4d25-abb4-771b9bda69ab admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:51.100128 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fd07b-5359-4d25-abb4-771b9bda69ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:51.102044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fd07b-5359-4d25-abb4-771b9bda69ab admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:51.121380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1046/2109] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:32:51 2021] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:32:51.125349 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311231f-fc29-404e-9d28-f0fdaeb13022 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:51.135553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311231f-fc29-404e-9d28-f0fdaeb13022 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:51.140302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920cc72-1ac4-4caa-b5b9-2a088ece9584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:51.141146 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920cc72-1ac4-4caa-b5b9-2a088ece9584 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:51.141457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920cc72-1ac4-4caa-b5b9-2a088ece9584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:51.141741 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920cc72-1ac4-4caa-b5b9-2a088ece9584 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:51.142486 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920cc72-1ac4-4caa-b5b9-2a088ece9584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:51.144113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920cc72-1ac4-4caa-b5b9-2a088ece9584 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:51.155705 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1064/2110] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:51.159612 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fd07b-5359-4d25-abb4-771b9bda69ab admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:51.170477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fd07b-5359-4d25-abb4-771b9bda69ab admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:51.185063 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab28312-fdd2-4dd6-ad37-4c3dbd5266f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:51.185967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab28312-fdd2-4dd6-ad37-4c3dbd5266f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:51.186244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab28312-fdd2-4dd6-ad37-4c3dbd5266f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:51.186516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab28312-fdd2-4dd6-ad37-4c3dbd5266f2 admin admin] PATH_INFO: `/v3/projects/80a7ec40584f41869b97a6929c8e7e01/users/36c3bc4c6cc14374b7f15403af2b9f73/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:51.202799 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab28312-fdd2-4dd6-ad37-4c3dbd5266f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a7ec40584f41869b97a6929c8e7e01, user_id=36c3bc4c6cc14374b7f15403af2b9f73, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:51.205549 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab28312-fdd2-4dd6-ad37-4c3dbd5266f2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:51.218965 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1047/2111] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:51 2021] PUT /identity/v3/projects/80a7ec40584f41869b97a6929c8e7e01/users/36c3bc4c6cc14374b7f15403af2b9f73/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:32:51.223040 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920cc72-1ac4-4caa-b5b9-2a088ece9584 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:51.232771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920cc72-1ac4-4caa-b5b9-2a088ece9584 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:51.288706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141907a-d66f-4ca0-b732-93a5366a0efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:51.289383 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141907a-d66f-4ca0-b732-93a5366a0efd admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:51.289580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141907a-d66f-4ca0-b732-93a5366a0efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:51.289861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141907a-d66f-4ca0-b732-93a5366a0efd admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:51.290612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141907a-d66f-4ca0-b732-93a5366a0efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:51.292250 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141907a-d66f-4ca0-b732-93a5366a0efd admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:51.306503 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1065/2112] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:51 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:51.308167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab28312-fdd2-4dd6-ad37-4c3dbd5266f2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:51.319262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab28312-fdd2-4dd6-ad37-4c3dbd5266f2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:51.324042 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992fc07-ea21-4037-900a-e889e8bf07b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:51.325195 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992fc07-ea21-4037-900a-e889e8bf07b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:51.325472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992fc07-ea21-4037-900a-e889e8bf07b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:51.325746 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992fc07-ea21-4037-900a-e889e8bf07b5 admin admin] PATH_INFO: `/v3/projects/80a7ec40584f41869b97a6929c8e7e01/users/36c3bc4c6cc14374b7f15403af2b9f73/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:51.327870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992fc07-ea21-4037-900a-e889e8bf07b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a7ec40584f41869b97a6929c8e7e01, user_id=36c3bc4c6cc14374b7f15403af2b9f73, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:51.330518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992fc07-ea21-4037-900a-e889e8bf07b5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:51.341495 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1048/2113] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:51 2021] PUT /identity/v3/projects/80a7ec40584f41869b97a6929c8e7e01/users/36c3bc4c6cc14374b7f15403af2b9f73/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:32:51.352511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f15332-e328-446a-834f-d6f634a2a66c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:51.352801 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f15332-e328-446a-834f-d6f634a2a66c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:51.353083 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f15332-e328-446a-834f-d6f634a2a66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:51.379048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b5f15332-e328-446a-834f-d6f634a2a66c None None] MFA Rules not processed for user `36c3bc4c6cc14374b7f15403af2b9f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:51.380238 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b5f15332-e328-446a-834f-d6f634a2a66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:51.452961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1066/2114] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:32:51 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:51.464040 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992fc07-ea21-4037-900a-e889e8bf07b5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:51.465818 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-7992fc07-ea21-4037-900a-e889e8bf07b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:51.522993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992fc07-ea21-4037-900a-e889e8bf07b5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:51.526546 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8393d20-0603-4897-8096-948aca95c872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:51.527203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8393d20-0603-4897-8096-948aca95c872 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:51.527485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8393d20-0603-4897-8096-948aca95c872 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:51.527761 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8393d20-0603-4897-8096-948aca95c872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:51.593841 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8393d20-0603-4897-8096-948aca95c872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:51.595352 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8393d20-0603-4897-8096-948aca95c872 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:51.605752 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1049/2115] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:51 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:32:53.106579 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f15332-e328-446a-834f-d6f634a2a66c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:53.117201 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f15332-e328-446a-834f-d6f634a2a66c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:53.121427 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9823941-f4fd-41a6-a4b1-4eadfca020e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:53.122078 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9823941-f4fd-41a6-a4b1-4eadfca020e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:53.122364 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9823941-f4fd-41a6-a4b1-4eadfca020e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:53.122644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9823941-f4fd-41a6-a4b1-4eadfca020e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:53.179333 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9823941-f4fd-41a6-a4b1-4eadfca020e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:53.180755 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9823941-f4fd-41a6-a4b1-4eadfca020e9 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:53.189843 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1067/2116] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:53 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:32:53.750825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8393d20-0603-4897-8096-948aca95c872 service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:53.759097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8393d20-0603-4897-8096-948aca95c872 service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:53.762645 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca70dc4-992b-4eb2-927b-5c15d3b7047c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:53.763305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70dc4-992b-4eb2-927b-5c15d3b7047c service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:53.763586 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70dc4-992b-4eb2-927b-5c15d3b7047c service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:53.763862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70dc4-992b-4eb2-927b-5c15d3b7047c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:53.772591 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca70dc4-992b-4eb2-927b-5c15d3b7047c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:53.774022 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca70dc4-992b-4eb2-927b-5c15d3b7047c service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:53.783210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1050/2117] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:53 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:33:01.752865 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9823941-f4fd-41a6-a4b1-4eadfca020e9 service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:01.818254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9823941-f4fd-41a6-a4b1-4eadfca020e9 service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:01.823198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895d429-1c58-460e-b55b-86c2a60c377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:01.824362 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895d429-1c58-460e-b55b-86c2a60c377b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:01.824648 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895d429-1c58-460e-b55b-86c2a60c377b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:01.824925 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895d429-1c58-460e-b55b-86c2a60c377b admin admin] PATH_INFO: `/v3/users/74a471f2f4a44bc9b6ff64b76985365a` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:01.826138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895d429-1c58-460e-b55b-86c2a60c377b admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a471f2f4a44bc9b6ff64b76985365a)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:01.828124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895d429-1c58-460e-b55b-86c2a60c377b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:01.876375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-0895d429-1c58-460e-b55b-86c2a60c377b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a471f2f4a44bc9b6ff64b76985365a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:01.888096 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-0895d429-1c58-460e-b55b-86c2a60c377b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a471f2f4a44bc9b6ff64b76985365a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:01.896229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-0895d429-1c58-460e-b55b-86c2a60c377b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a471f2f4a44bc9b6ff64b76985365a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:01.903133 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-0895d429-1c58-460e-b55b-86c2a60c377b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a471f2f4a44bc9b6ff64b76985365a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:01.903786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-0895d429-1c58-460e-b55b-86c2a60c377b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a471f2f4a44bc9b6ff64b76985365a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:01.910637 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1068/2118] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:33:01 2021] DELETE /identity/v3/users/74a471f2f4a44bc9b6ff64b76985365a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:33:01.915172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5dd6c-ec43-4bea-bc35-cebfd7edcb83 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:01.915695 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5dd6c-ec43-4bea-bc35-cebfd7edcb83 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:01.915793 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5dd6c-ec43-4bea-bc35-cebfd7edcb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:01.933399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-f5d5dd6c-ec43-4bea-bc35-cebfd7edcb83 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:01.934767 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f5d5dd6c-ec43-4bea-bc35-cebfd7edcb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:01.995743 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1051/2119] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:33:02.007836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895d429-1c58-460e-b55b-86c2a60c377b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:02.009253 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-0895d429-1c58-460e-b55b-86c2a60c377b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:02.069164 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895d429-1c58-460e-b55b-86c2a60c377b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:02.072983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb58a9-c710-4e37-8efd-84f5eda94ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:02.073631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb58a9-c710-4e37-8efd-84f5eda94ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:02.074166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb58a9-c710-4e37-8efd-84f5eda94ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:02.074460 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb58a9-c710-4e37-8efd-84f5eda94ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:02.084282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb58a9-c710-4e37-8efd-84f5eda94ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:02.085719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb58a9-c710-4e37-8efd-84f5eda94ca5 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:02.095784 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1069/2120] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:33:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:33:02.359604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5dd6c-ec43-4bea-bc35-cebfd7edcb83 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:02.361547 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f5d5dd6c-ec43-4bea-bc35-cebfd7edcb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:02.376182 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5dd6c-ec43-4bea-bc35-cebfd7edcb83 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:02.381016 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:02.381873 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:02.382155 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:02.382432 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] PATH_INFO: `/v3/projects/4520f53c8e614b8e9bf69c47ce0becd0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:02.384177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4520f53c8e614b8e9bf69c47ce0becd0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:02.386092 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:02.434228 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4520f53c8e614b8e9bf69c47ce0becd0', 'request_id': 'req-49125ea3-5368-417e-8d0c-e8788d764e3a'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:02.441526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4520f53c8e614b8e9bf69c47ce0becd0', 'request_id': 'req-49125ea3-5368-417e-8d0c-e8788d764e3a'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:02.446987 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4520f53c8e614b8e9bf69c47ce0becd0', 'request_id': 'req-49125ea3-5368-417e-8d0c-e8788d764e3a'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:02.458621 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] The token cache is being invalidate because project 4520f53c8e614b8e9bf69c47ce0becd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:33:02.458944 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:02.459646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:02.461272 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1052/2121] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:33:02 2021] DELETE /identity/v3/projects/4520f53c8e614b8e9bf69c47ce0becd0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:02.465205 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb58a9-c710-4e37-8efd-84f5eda94ca5 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:02.474649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb58a9-c710-4e37-8efd-84f5eda94ca5 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:02.528389 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04096d-59aa-4ee4-a6f4-4b5e1ebd9bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:02.529251 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04096d-59aa-4ee4-a6f4-4b5e1ebd9bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:02.529536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04096d-59aa-4ee4-a6f4-4b5e1ebd9bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:02.529824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04096d-59aa-4ee4-a6f4-4b5e1ebd9bea admin admin] PATH_INFO: `/v3/users/de9eebbd899a4785943418489d4536d6` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:02.531053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04096d-59aa-4ee4-a6f4-4b5e1ebd9bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=de9eebbd899a4785943418489d4536d6)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:02.533006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04096d-59aa-4ee4-a6f4-4b5e1ebd9bea admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:02.577776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7f04096d-59aa-4ee4-a6f4-4b5e1ebd9bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9eebbd899a4785943418489d4536d6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:02.589857 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7f04096d-59aa-4ee4-a6f4-4b5e1ebd9bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9eebbd899a4785943418489d4536d6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:02.597125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7f04096d-59aa-4ee4-a6f4-4b5e1ebd9bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9eebbd899a4785943418489d4536d6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:02.603871 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7f04096d-59aa-4ee4-a6f4-4b5e1ebd9bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9eebbd899a4785943418489d4536d6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:02.604505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7f04096d-59aa-4ee4-a6f4-4b5e1ebd9bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9eebbd899a4785943418489d4536d6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:02.610743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1070/2122] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:33:02 2021] DELETE /identity/v3/users/de9eebbd899a4785943418489d4536d6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:02.868780 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:02.870321 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:02.884851 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49125ea3-5368-417e-8d0c-e8788d764e3a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:02.941347 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:02.942187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:02.942466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:02.942736 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] PATH_INFO: `/v3/projects/442689fc96914ec1b2e6c31c55887b17` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:02.943965 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] RBAC: Authorizing `identity:delete_project(project_id=442689fc96914ec1b2e6c31c55887b17)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:02.945858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:02.989934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '442689fc96914ec1b2e6c31c55887b17', 'request_id': 'req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:02.995926 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '442689fc96914ec1b2e6c31c55887b17', 'request_id': 'req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:03.001146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '442689fc96914ec1b2e6c31c55887b17', 'request_id': 'req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:03.011483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] The token cache is being invalidate because project 442689fc96914ec1b2e6c31c55887b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:33:03.011766 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:03.012381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:03.013874 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1053/2123] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:33:02 2021] DELETE /identity/v3/projects/442689fc96914ec1b2e6c31c55887b17 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:33:03.017835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04096d-59aa-4ee4-a6f4-4b5e1ebd9bea admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:03.019271 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-7f04096d-59aa-4ee4-a6f4-4b5e1ebd9bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:03.032328 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04096d-59aa-4ee4-a6f4-4b5e1ebd9bea admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:03.086416 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259a090-c3a4-4c48-a497-fde7a0033610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:03.087304 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259a090-c3a4-4c48-a497-fde7a0033610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:03.087587 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259a090-c3a4-4c48-a497-fde7a0033610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:03.087860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259a090-c3a4-4c48-a497-fde7a0033610 admin admin] PATH_INFO: `/v3/users/36c3bc4c6cc14374b7f15403af2b9f73` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:03.089036 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259a090-c3a4-4c48-a497-fde7a0033610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c3bc4c6cc14374b7f15403af2b9f73)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:03.090957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259a090-c3a4-4c48-a497-fde7a0033610 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:03.136133 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-8259a090-c3a4-4c48-a497-fde7a0033610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c3bc4c6cc14374b7f15403af2b9f73'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:03.147089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-8259a090-c3a4-4c48-a497-fde7a0033610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c3bc4c6cc14374b7f15403af2b9f73'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:03.153944 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-8259a090-c3a4-4c48-a497-fde7a0033610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c3bc4c6cc14374b7f15403af2b9f73'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:03.161085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-8259a090-c3a4-4c48-a497-fde7a0033610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c3bc4c6cc14374b7f15403af2b9f73'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:03.161745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-8259a090-c3a4-4c48-a497-fde7a0033610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c3bc4c6cc14374b7f15403af2b9f73'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:03.167580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1071/2124] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:33:03 2021] DELETE /identity/v3/users/36c3bc4c6cc14374b7f15403af2b9f73 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:03.429832 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:03.431388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:03.443900 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b6142-dcbc-4d7b-af6b-f3060cb6b94f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:03.501226 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2a15a-23fd-4af4-a900-507a091bb836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:03.502078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2a15a-23fd-4af4-a900-507a091bb836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:03.502361 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2a15a-23fd-4af4-a900-507a091bb836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:03.502639 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2a15a-23fd-4af4-a900-507a091bb836 admin admin] PATH_INFO: `/v3/projects/80a7ec40584f41869b97a6929c8e7e01` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:03.503869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2a15a-23fd-4af4-a900-507a091bb836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a7ec40584f41869b97a6929c8e7e01)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:03.505794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2a15a-23fd-4af4-a900-507a091bb836 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:03.551398 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2ba2a15a-23fd-4af4-a900-507a091bb836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a7ec40584f41869b97a6929c8e7e01', 'request_id': 'req-2ba2a15a-23fd-4af4-a900-507a091bb836'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:03.559875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2ba2a15a-23fd-4af4-a900-507a091bb836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a7ec40584f41869b97a6929c8e7e01', 'request_id': 'req-2ba2a15a-23fd-4af4-a900-507a091bb836'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:03.565439 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2ba2a15a-23fd-4af4-a900-507a091bb836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a7ec40584f41869b97a6929c8e7e01', 'request_id': 'req-2ba2a15a-23fd-4af4-a900-507a091bb836'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:03.577015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2ba2a15a-23fd-4af4-a900-507a091bb836 admin admin] The token cache is being invalidate because project 80a7ec40584f41869b97a6929c8e7e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:33:03.577302 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2ba2a15a-23fd-4af4-a900-507a091bb836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:03.577947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2ba2a15a-23fd-4af4-a900-507a091bb836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:03.580027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1054/2125] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:33:03 2021] DELETE /identity/v3/projects/80a7ec40584f41869b97a6929c8e7e01 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:21.732280 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259a090-c3a4-4c48-a497-fde7a0033610 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:21.733699 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8259a090-c3a4-4c48-a497-fde7a0033610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:21.746393 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259a090-c3a4-4c48-a497-fde7a0033610 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:21.800284 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ba7b6-8bb0-44f3-a034-70c87ce637ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:21.801243 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ba7b6-8bb0-44f3-a034-70c87ce637ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:21.801639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ba7b6-8bb0-44f3-a034-70c87ce637ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:21.801869 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ba7b6-8bb0-44f3-a034-70c87ce637ac admin admin] PATH_INFO: `/v3/users/72b804fe4e3a4af98b41206298b53845` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:21.803408 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ba7b6-8bb0-44f3-a034-70c87ce637ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b804fe4e3a4af98b41206298b53845)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:21.805315 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ba7b6-8bb0-44f3-a034-70c87ce637ac admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:21.848317 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fc2ba7b6-8bb0-44f3-a034-70c87ce637ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b804fe4e3a4af98b41206298b53845'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:21.860497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fc2ba7b6-8bb0-44f3-a034-70c87ce637ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b804fe4e3a4af98b41206298b53845'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:21.868804 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fc2ba7b6-8bb0-44f3-a034-70c87ce637ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b804fe4e3a4af98b41206298b53845'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:21.876739 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fc2ba7b6-8bb0-44f3-a034-70c87ce637ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b804fe4e3a4af98b41206298b53845'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:21.877616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-fc2ba7b6-8bb0-44f3-a034-70c87ce637ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b804fe4e3a4af98b41206298b53845'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:21.886969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1072/2126] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:33:21 2021] DELETE /identity/v3/users/72b804fe4e3a4af98b41206298b53845 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:21.888746 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fe108-85fd-4dc6-a645-86a000af01f6 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:21.889210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fe108-85fd-4dc6-a645-86a000af01f6 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:21.890012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fe108-85fd-4dc6-a645-86a000af01f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:21.910113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-6d1fe108-85fd-4dc6-a645-86a000af01f6 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:21.911348 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-6d1fe108-85fd-4dc6-a645-86a000af01f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:21.973215 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1055/2127] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:33:21.980103 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ba7b6-8bb0-44f3-a034-70c87ce637ac admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:21.981541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-fc2ba7b6-8bb0-44f3-a034-70c87ce637ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:22.047994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ba7b6-8bb0-44f3-a034-70c87ce637ac admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:22.051626 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26efb1-0092-4dc0-88f8-43203dca385b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:22.052292 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26efb1-0092-4dc0-88f8-43203dca385b service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:22.052573 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26efb1-0092-4dc0-88f8-43203dca385b service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:22.052850 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26efb1-0092-4dc0-88f8-43203dca385b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:22.062622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26efb1-0092-4dc0-88f8-43203dca385b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:22.064079 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26efb1-0092-4dc0-88f8-43203dca385b service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:22.074641 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1073/2128] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:33:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:33:22.348264 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fe108-85fd-4dc6-a645-86a000af01f6 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:22.351266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-6d1fe108-85fd-4dc6-a645-86a000af01f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:22.361920 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fe108-85fd-4dc6-a645-86a000af01f6 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:22.367271 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:22.368198 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:22.368540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:22.368825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] PATH_INFO: `/v3/projects/64c907521b8f4a8c9411767e09332eb9` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:22.370053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c907521b8f4a8c9411767e09332eb9)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:22.372067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:22.434120 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c907521b8f4a8c9411767e09332eb9', 'request_id': 'req-dc301931-4c9a-4311-ae2e-5744fde42f4f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:22.443542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c907521b8f4a8c9411767e09332eb9', 'request_id': 'req-dc301931-4c9a-4311-ae2e-5744fde42f4f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:22.449985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c907521b8f4a8c9411767e09332eb9', 'request_id': 'req-dc301931-4c9a-4311-ae2e-5744fde42f4f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:22.467413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] The token cache is being invalidate because project 64c907521b8f4a8c9411767e09332eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:33:22.467725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:22.468412 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:22.470144 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1056/2129] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:33:22 2021] DELETE /identity/v3/projects/64c907521b8f4a8c9411767e09332eb9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:22.473920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26efb1-0092-4dc0-88f8-43203dca385b service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:22.495678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26efb1-0092-4dc0-88f8-43203dca385b service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:22.560377 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e40638-5e71-4c9f-99c3-aa2b53bbe975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:22.561246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e40638-5e71-4c9f-99c3-aa2b53bbe975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:22.561528 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e40638-5e71-4c9f-99c3-aa2b53bbe975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:22.561801 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e40638-5e71-4c9f-99c3-aa2b53bbe975 admin admin] PATH_INFO: `/v3/users/3a23658262f34f1db05b023bc8cca81c` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:22.563556 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e40638-5e71-4c9f-99c3-aa2b53bbe975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a23658262f34f1db05b023bc8cca81c)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:22.565461 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e40638-5e71-4c9f-99c3-aa2b53bbe975 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:22.621226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d7e40638-5e71-4c9f-99c3-aa2b53bbe975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a23658262f34f1db05b023bc8cca81c'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:22.646180 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d7e40638-5e71-4c9f-99c3-aa2b53bbe975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a23658262f34f1db05b023bc8cca81c'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:22.653664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d7e40638-5e71-4c9f-99c3-aa2b53bbe975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a23658262f34f1db05b023bc8cca81c'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:22.661982 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d7e40638-5e71-4c9f-99c3-aa2b53bbe975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a23658262f34f1db05b023bc8cca81c'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:22.662874 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d7e40638-5e71-4c9f-99c3-aa2b53bbe975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a23658262f34f1db05b023bc8cca81c'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:22.669204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1074/2130] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:33:22 2021] DELETE /identity/v3/users/3a23658262f34f1db05b023bc8cca81c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:22.931538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:22.933049 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:22.948118 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc301931-4c9a-4311-ae2e-5744fde42f4f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:23.003912 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5db50-8016-412e-9123-f4f0b21fb1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:23.004761 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5db50-8016-412e-9123-f4f0b21fb1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:23.005044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5db50-8016-412e-9123-f4f0b21fb1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:23.005322 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5db50-8016-412e-9123-f4f0b21fb1d7 admin admin] PATH_INFO: `/v3/projects/ed72e442ae0747e6bae149f54b8e6e21` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:23.006502 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5db50-8016-412e-9123-f4f0b21fb1d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed72e442ae0747e6bae149f54b8e6e21)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:23.008551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5db50-8016-412e-9123-f4f0b21fb1d7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:23.052943 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e0b5db50-8016-412e-9123-f4f0b21fb1d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed72e442ae0747e6bae149f54b8e6e21', 'request_id': 'req-e0b5db50-8016-412e-9123-f4f0b21fb1d7'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:23.059399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e0b5db50-8016-412e-9123-f4f0b21fb1d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed72e442ae0747e6bae149f54b8e6e21', 'request_id': 'req-e0b5db50-8016-412e-9123-f4f0b21fb1d7'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:23.064855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e0b5db50-8016-412e-9123-f4f0b21fb1d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed72e442ae0747e6bae149f54b8e6e21', 'request_id': 'req-e0b5db50-8016-412e-9123-f4f0b21fb1d7'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:23.075509 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e0b5db50-8016-412e-9123-f4f0b21fb1d7 admin admin] The token cache is being invalidate because project ed72e442ae0747e6bae149f54b8e6e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:33:23.075792 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e0b5db50-8016-412e-9123-f4f0b21fb1d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:23.076416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e0b5db50-8016-412e-9123-f4f0b21fb1d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:23.077907 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1057/2131] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:33:22 2021] DELETE /identity/v3/projects/ed72e442ae0747e6bae149f54b8e6e21 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:23.084681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465ed6d-5851-426e-bc8e-83064a2c5ea6 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:23.085166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465ed6d-5851-426e-bc8e-83064a2c5ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:23.085282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465ed6d-5851-426e-bc8e-83064a2c5ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:23.103676 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-3465ed6d-5851-426e-bc8e-83064a2c5ea6 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:23.104868 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3465ed6d-5851-426e-bc8e-83064a2c5ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:23.161118 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1075/2132] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:33:23.168660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f1f5-6b8f-403e-8953-1b8569ed3008 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:23.168950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f1f5-6b8f-403e-8953-1b8569ed3008 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:23.169230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f1f5-6b8f-403e-8953-1b8569ed3008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:23.186673 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-f376f1f5-6b8f-403e-8953-1b8569ed3008 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:23.188385 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f376f1f5-6b8f-403e-8953-1b8569ed3008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:23.196320 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1058/2133] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:33:23.200544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465ed6d-5851-426e-bc8e-83064a2c5ea6 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:23.210479 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465ed6d-5851-426e-bc8e-83064a2c5ea6 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:23.215033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd35803-71ef-4d16-979c-8d9a049a73e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:23.215673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd35803-71ef-4d16-979c-8d9a049a73e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:23.215956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd35803-71ef-4d16-979c-8d9a049a73e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:23.216235 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd35803-71ef-4d16-979c-8d9a049a73e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:23.216968 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd35803-71ef-4d16-979c-8d9a049a73e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:33:23.217278 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd35803-71ef-4d16-979c-8d9a049a73e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:23.218969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd35803-71ef-4d16-979c-8d9a049a73e3 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:23.230174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1076/2134] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:33:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:33:23.234543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f1f5-6b8f-403e-8953-1b8569ed3008 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:23.243906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f1f5-6b8f-403e-8953-1b8569ed3008 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:23.248469 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370491e-479b-4c42-be6d-7054844768c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:23.249099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370491e-479b-4c42-be6d-7054844768c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:23.249377 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370491e-479b-4c42-be6d-7054844768c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:23.249652 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370491e-479b-4c42-be6d-7054844768c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:23.250924 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370491e-479b-4c42-be6d-7054844768c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:23.252804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370491e-479b-4c42-be6d-7054844768c5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:23.281431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1059/2135] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:33:23 2021] POST /identity/v3/projects => generated 357 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:33:23.282831 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd35803-71ef-4d16-979c-8d9a049a73e3 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:23.293605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd35803-71ef-4d16-979c-8d9a049a73e3 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:23.354572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d056964-23e2-468e-91be-7d12b3d8c01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:23.355284 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d056964-23e2-468e-91be-7d12b3d8c01d admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:23.355632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d056964-23e2-468e-91be-7d12b3d8c01d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:23.355977 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d056964-23e2-468e-91be-7d12b3d8c01d admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:23.356771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d056964-23e2-468e-91be-7d12b3d8c01d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:23.358750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d056964-23e2-468e-91be-7d12b3d8c01d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:23.380280 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1077/2136] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:33:23 2021] POST /identity/v3/users => generated 279 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:33:23.384259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370491e-479b-4c42-be6d-7054844768c5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:23.394980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370491e-479b-4c42-be6d-7054844768c5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:23.400064 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104c024-a2ae-424c-90fc-9420a3913191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:23.400777 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104c024-a2ae-424c-90fc-9420a3913191 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:23.401183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104c024-a2ae-424c-90fc-9420a3913191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:23.401576 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104c024-a2ae-424c-90fc-9420a3913191 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:23.402663 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104c024-a2ae-424c-90fc-9420a3913191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:23.404856 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104c024-a2ae-424c-90fc-9420a3913191 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:23.416314 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1060/2137] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:33:23.420084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d056964-23e2-468e-91be-7d12b3d8c01d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:23.429729 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d056964-23e2-468e-91be-7d12b3d8c01d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:23.434283 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5396864-9da4-4ce0-8ba1-0dee16619ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:23.434972 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5396864-9da4-4ce0-8ba1-0dee16619ddf admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:23.435255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5396864-9da4-4ce0-8ba1-0dee16619ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:23.435546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5396864-9da4-4ce0-8ba1-0dee16619ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:23.436297 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5396864-9da4-4ce0-8ba1-0dee16619ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:23.438419 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5396864-9da4-4ce0-8ba1-0dee16619ddf admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:23.448911 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1078/2138] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:33:23.453027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104c024-a2ae-424c-90fc-9420a3913191 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:23.463632 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104c024-a2ae-424c-90fc-9420a3913191 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:23.469540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945df88-2af2-49f0-9b3c-3d8a46c21a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:23.470421 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945df88-2af2-49f0-9b3c-3d8a46c21a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:23.470711 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945df88-2af2-49f0-9b3c-3d8a46c21a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:23.471038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945df88-2af2-49f0-9b3c-3d8a46c21a5c admin admin] PATH_INFO: `/v3/projects/01151ffc39324ad093994acdab220e54/users/3d10636f50cc4bac9256823e4b7e4107/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:23.486001 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945df88-2af2-49f0-9b3c-3d8a46c21a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01151ffc39324ad093994acdab220e54, user_id=3d10636f50cc4bac9256823e4b7e4107, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:23.488728 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945df88-2af2-49f0-9b3c-3d8a46c21a5c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:23.504879 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1061/2139] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:33:23 2021] PUT /identity/v3/projects/01151ffc39324ad093994acdab220e54/users/3d10636f50cc4bac9256823e4b7e4107/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:33:23.522892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27147edb-5b51-49a8-94cb-73481e0b709d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:23.523185 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27147edb-5b51-49a8-94cb-73481e0b709d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:23.523461 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27147edb-5b51-49a8-94cb-73481e0b709d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:23.549553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-27147edb-5b51-49a8-94cb-73481e0b709d None None] MFA Rules not processed for user `3d10636f50cc4bac9256823e4b7e4107`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:23.550740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-27147edb-5b51-49a8-94cb-73481e0b709d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:23.627492 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1079/2140] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:23 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:33:23.632087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945df88-2af2-49f0-9b3c-3d8a46c21a5c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:23.714318 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945df88-2af2-49f0-9b3c-3d8a46c21a5c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:23.720322 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6a4da-9562-477b-8646-f67491f04043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:23.721115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6a4da-9562-477b-8646-f67491f04043 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:23.721465 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6a4da-9562-477b-8646-f67491f04043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:23.721809 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6a4da-9562-477b-8646-f67491f04043 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:23.722732 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6a4da-9562-477b-8646-f67491f04043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:23.724855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6a4da-9562-477b-8646-f67491f04043 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:23.760046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1062/2141] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:33:23 2021] POST /identity/v3/projects => generated 357 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:33:23.766729 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27147edb-5b51-49a8-94cb-73481e0b709d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:23.780326 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27147edb-5b51-49a8-94cb-73481e0b709d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:23.847921 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e1bf7-919f-4a57-9a7e-e2bb15129810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:23.848580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1bf7-919f-4a57-9a7e-e2bb15129810 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:23.848860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1bf7-919f-4a57-9a7e-e2bb15129810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:23.849135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1bf7-919f-4a57-9a7e-e2bb15129810 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:23.849836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e1bf7-919f-4a57-9a7e-e2bb15129810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:23.851776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e1bf7-919f-4a57-9a7e-e2bb15129810 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:23.870610 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1080/2142] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:33:23 2021] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:33:23.874576 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6a4da-9562-477b-8646-f67491f04043 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:23.885607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6a4da-9562-477b-8646-f67491f04043 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:23.890374 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1d582-18fa-422d-ae15-aeee9c994efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:23.891095 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1d582-18fa-422d-ae15-aeee9c994efb admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:23.891378 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1d582-18fa-422d-ae15-aeee9c994efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:23.891660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1d582-18fa-422d-ae15-aeee9c994efb admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:23.892446 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1d582-18fa-422d-ae15-aeee9c994efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:23.894076 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1d582-18fa-422d-ae15-aeee9c994efb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:23.904649 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1063/2143] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:33:23.909270 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e1bf7-919f-4a57-9a7e-e2bb15129810 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:23.919197 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e1bf7-919f-4a57-9a7e-e2bb15129810 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:23.924711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d18796-e3f4-4e75-8d8f-587b1b04b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:23.925604 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d18796-e3f4-4e75-8d8f-587b1b04b14f admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:23.925891 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d18796-e3f4-4e75-8d8f-587b1b04b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:23.926193 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d18796-e3f4-4e75-8d8f-587b1b04b14f admin admin] PATH_INFO: `/v3/projects/0dc5966482474a9cb956e411c7a3c634/users/40a98b9d691542a0b12b511093438884/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:23.943026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d18796-e3f4-4e75-8d8f-587b1b04b14f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc5966482474a9cb956e411c7a3c634, user_id=40a98b9d691542a0b12b511093438884, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:23.945766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d18796-e3f4-4e75-8d8f-587b1b04b14f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:23.957975 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1081/2144] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:33:23 2021] PUT /identity/v3/projects/0dc5966482474a9cb956e411c7a3c634/users/40a98b9d691542a0b12b511093438884/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:23.961863 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1d582-18fa-422d-ae15-aeee9c994efb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:23.972222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1d582-18fa-422d-ae15-aeee9c994efb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:24.026562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910f93b-2ed0-4ee9-8f63-f1e5e5bf001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:24.027266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910f93b-2ed0-4ee9-8f63-f1e5e5bf001a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:24.027553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910f93b-2ed0-4ee9-8f63-f1e5e5bf001a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:24.027833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910f93b-2ed0-4ee9-8f63-f1e5e5bf001a admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:24.028578 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910f93b-2ed0-4ee9-8f63-f1e5e5bf001a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:24.030186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910f93b-2ed0-4ee9-8f63-f1e5e5bf001a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:24.040270 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1064/2145] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:33:24.044455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d18796-e3f4-4e75-8d8f-587b1b04b14f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:24.055050 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d18796-e3f4-4e75-8d8f-587b1b04b14f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:24.059682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798b7fa-dfb3-4830-a31f-7c266c604e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:24.060545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798b7fa-dfb3-4830-a31f-7c266c604e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:24.060834 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798b7fa-dfb3-4830-a31f-7c266c604e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:24.061114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798b7fa-dfb3-4830-a31f-7c266c604e17 admin admin] PATH_INFO: `/v3/projects/0dc5966482474a9cb956e411c7a3c634/users/40a98b9d691542a0b12b511093438884/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:24.063272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798b7fa-dfb3-4830-a31f-7c266c604e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc5966482474a9cb956e411c7a3c634, user_id=40a98b9d691542a0b12b511093438884, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:24.065748 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798b7fa-dfb3-4830-a31f-7c266c604e17 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:24.075956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1082/2146] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:33:24 2021] PUT /identity/v3/projects/0dc5966482474a9cb956e411c7a3c634/users/40a98b9d691542a0b12b511093438884/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:24.085755 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb365b7-3c4b-4214-8a2b-b410273cc19a None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:24.086038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb365b7-3c4b-4214-8a2b-b410273cc19a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:24.086343 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb365b7-3c4b-4214-8a2b-b410273cc19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:24.112993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-7eb365b7-3c4b-4214-8a2b-b410273cc19a None None] MFA Rules not processed for user `40a98b9d691542a0b12b511093438884`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:24.114173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-7eb365b7-3c4b-4214-8a2b-b410273cc19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:24.178415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1065/2147] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:24 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:33:24.188718 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798b7fa-dfb3-4830-a31f-7c266c604e17 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:24.190459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b798b7fa-dfb3-4830-a31f-7c266c604e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:24.244835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798b7fa-dfb3-4830-a31f-7c266c604e17 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:24.248494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1d3c8-4d18-48dd-9b2c-d811e05370ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:24.249124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1d3c8-4d18-48dd-9b2c-d811e05370ee service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:24.249401 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1d3c8-4d18-48dd-9b2c-d811e05370ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:24.249675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1d3c8-4d18-48dd-9b2c-d811e05370ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:24.258412 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1d3c8-4d18-48dd-9b2c-d811e05370ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:24.259834 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1d3c8-4d18-48dd-9b2c-d811e05370ee service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:24.269626 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1083/2148] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:33:24 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:33:24.339032 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb365b7-3c4b-4214-8a2b-b410273cc19a None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:24.349169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb365b7-3c4b-4214-8a2b-b410273cc19a None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:24.353091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084e7be-4879-4178-aa3d-ed2d14de8446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:24.353853 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084e7be-4879-4178-aa3d-ed2d14de8446 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:24.354133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084e7be-4879-4178-aa3d-ed2d14de8446 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:24.354407 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084e7be-4879-4178-aa3d-ed2d14de8446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:24.411289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084e7be-4879-4178-aa3d-ed2d14de8446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:24.412772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084e7be-4879-4178-aa3d-ed2d14de8446 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:24.421501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1066/2149] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:33:24 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:33:39.009981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1d3c8-4d18-48dd-9b2c-d811e05370ee service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:39.072229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1d3c8-4d18-48dd-9b2c-d811e05370ee service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:39.076889 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446503d-cd31-4821-baaf-8e2573c996bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:39.077875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446503d-cd31-4821-baaf-8e2573c996bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:39.078159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446503d-cd31-4821-baaf-8e2573c996bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:39.078434 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446503d-cd31-4821-baaf-8e2573c996bb admin admin] PATH_INFO: `/v3/users/3d10636f50cc4bac9256823e4b7e4107` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:39.080337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446503d-cd31-4821-baaf-8e2573c996bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d10636f50cc4bac9256823e4b7e4107)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:39.082416 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446503d-cd31-4821-baaf-8e2573c996bb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:39.129244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e446503d-cd31-4821-baaf-8e2573c996bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d10636f50cc4bac9256823e4b7e4107'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.140362 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e446503d-cd31-4821-baaf-8e2573c996bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d10636f50cc4bac9256823e4b7e4107'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.147296 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e446503d-cd31-4821-baaf-8e2573c996bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d10636f50cc4bac9256823e4b7e4107'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.153843 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e446503d-cd31-4821-baaf-8e2573c996bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d10636f50cc4bac9256823e4b7e4107'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.154457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e446503d-cd31-4821-baaf-8e2573c996bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d10636f50cc4bac9256823e4b7e4107'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.160660 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1084/2150] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:33:39 2021] DELETE /identity/v3/users/3d10636f50cc4bac9256823e4b7e4107 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:39.165265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c99f7-c030-4fc1-8081-25cd2fa86590 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:39.165745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c99f7-c030-4fc1-8081-25cd2fa86590 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:39.165844 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c99f7-c030-4fc1-8081-25cd2fa86590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:39.183184 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-974c99f7-c030-4fc1-8081-25cd2fa86590 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:39.184380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-974c99f7-c030-4fc1-8081-25cd2fa86590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:39.245536 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1067/2151] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:33:39.255271 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446503d-cd31-4821-baaf-8e2573c996bb admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:39.257760 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e446503d-cd31-4821-baaf-8e2573c996bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:39.317648 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446503d-cd31-4821-baaf-8e2573c996bb admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:39.321357 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f2e77-e66a-4a4c-828d-bafb849364e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:39.322309 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f2e77-e66a-4a4c-828d-bafb849364e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:39.322534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f2e77-e66a-4a4c-828d-bafb849364e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:39.322807 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f2e77-e66a-4a4c-828d-bafb849364e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:39.332538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f2e77-e66a-4a4c-828d-bafb849364e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:39.333955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f2e77-e66a-4a4c-828d-bafb849364e6 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:39.343747 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1085/2152] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:33:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:33:39.595768 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c99f7-c030-4fc1-8081-25cd2fa86590 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:39.597327 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-974c99f7-c030-4fc1-8081-25cd2fa86590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:39.609470 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c99f7-c030-4fc1-8081-25cd2fa86590 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:39.614183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:39.615146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:39.615451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:39.615729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] PATH_INFO: `/v3/projects/01151ffc39324ad093994acdab220e54` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:39.617413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01151ffc39324ad093994acdab220e54)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:39.626641 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:39.675422 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01151ffc39324ad093994acdab220e54', 'request_id': 'req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.682679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01151ffc39324ad093994acdab220e54', 'request_id': 'req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.688682 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01151ffc39324ad093994acdab220e54', 'request_id': 'req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.700080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] The token cache is being invalidate because project 01151ffc39324ad093994acdab220e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:33:39.700365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.700992 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.703111 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1068/2153] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:33:39 2021] DELETE /identity/v3/projects/01151ffc39324ad093994acdab220e54 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:39.707068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f2e77-e66a-4a4c-828d-bafb849364e6 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:39.716599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f2e77-e66a-4a4c-828d-bafb849364e6 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:39.773526 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9674b-42d4-448d-9bf5-acd05a998ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:39.774401 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9674b-42d4-448d-9bf5-acd05a998ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:39.774679 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9674b-42d4-448d-9bf5-acd05a998ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:39.774985 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9674b-42d4-448d-9bf5-acd05a998ac2 admin admin] PATH_INFO: `/v3/users/40a98b9d691542a0b12b511093438884` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:39.776183 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9674b-42d4-448d-9bf5-acd05a998ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a98b9d691542a0b12b511093438884)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:39.778323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9674b-42d4-448d-9bf5-acd05a998ac2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:39.822756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-abc9674b-42d4-448d-9bf5-acd05a998ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a98b9d691542a0b12b511093438884'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.834685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-abc9674b-42d4-448d-9bf5-acd05a998ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a98b9d691542a0b12b511093438884'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.841652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-abc9674b-42d4-448d-9bf5-acd05a998ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a98b9d691542a0b12b511093438884'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.851446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-abc9674b-42d4-448d-9bf5-acd05a998ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a98b9d691542a0b12b511093438884'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.851924 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-abc9674b-42d4-448d-9bf5-acd05a998ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a98b9d691542a0b12b511093438884'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:39.857840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1086/2154] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:33:39 2021] DELETE /identity/v3/users/40a98b9d691542a0b12b511093438884 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:40.150367 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:40.151930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:40.176801 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e9fa6-8d23-437b-ad1c-31fc8c590c08 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:40.197731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9674b-42d4-448d-9bf5-acd05a998ac2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:40.199253 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-abc9674b-42d4-448d-9bf5-acd05a998ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:40.234746 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6925d85-5e30-4379-aa10-2075750a786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:40.235706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6925d85-5e30-4379-aa10-2075750a786c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:40.235986 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6925d85-5e30-4379-aa10-2075750a786c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:40.236261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6925d85-5e30-4379-aa10-2075750a786c admin admin] PATH_INFO: `/v3/projects/0dc5966482474a9cb956e411c7a3c634` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:40.237628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6925d85-5e30-4379-aa10-2075750a786c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc5966482474a9cb956e411c7a3c634)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:40.239599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6925d85-5e30-4379-aa10-2075750a786c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:40.255378 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9674b-42d4-448d-9bf5-acd05a998ac2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:40.259701 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b64782-b9fc-4379-ba42-de45806b003e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:40.260345 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b64782-b9fc-4379-ba42-de45806b003e service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:40.260623 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b64782-b9fc-4379-ba42-de45806b003e service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:40.260894 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b64782-b9fc-4379-ba42-de45806b003e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:40.262604 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-54b64782-b9fc-4379-ba42-de45806b003e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:40.283824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a6925d85-5e30-4379-aa10-2075750a786c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc5966482474a9cb956e411c7a3c634', 'request_id': 'req-a6925d85-5e30-4379-aa10-2075750a786c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:40.290935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a6925d85-5e30-4379-aa10-2075750a786c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc5966482474a9cb956e411c7a3c634', 'request_id': 'req-a6925d85-5e30-4379-aa10-2075750a786c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:40.297248 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a6925d85-5e30-4379-aa10-2075750a786c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc5966482474a9cb956e411c7a3c634', 'request_id': 'req-a6925d85-5e30-4379-aa10-2075750a786c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:40.308498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a6925d85-5e30-4379-aa10-2075750a786c admin admin] The token cache is being invalidate because project 0dc5966482474a9cb956e411c7a3c634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:33:40.308789 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a6925d85-5e30-4379-aa10-2075750a786c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:40.309858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a6925d85-5e30-4379-aa10-2075750a786c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:40.312151 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1069/2155] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:33:40 2021] DELETE /identity/v3/projects/0dc5966482474a9cb956e411c7a3c634 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:40.317675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4639b0-0f16-4c89-8ca7-fc7e90e84c66 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:40.318035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4639b0-0f16-4c89-8ca7-fc7e90e84c66 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:40.318384 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4639b0-0f16-4c89-8ca7-fc7e90e84c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:40.328653 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b64782-b9fc-4379-ba42-de45806b003e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:40.330174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b64782-b9fc-4379-ba42-de45806b003e service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:40.338775 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-9e4639b0-0f16-4c89-8ca7-fc7e90e84c66 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:40.340125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9e4639b0-0f16-4c89-8ca7-fc7e90e84c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:40.340966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1087/2156] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:33:40 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:33:40.412914 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1070/2157] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:33:40.416150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee6396-9ab2-4b06-80c5-35b95319946b None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:40.416150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee6396-9ab2-4b06-80c5-35b95319946b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:40.416150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee6396-9ab2-4b06-80c5-35b95319946b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:40.434757 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-3fee6396-9ab2-4b06-80c5-35b95319946b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:40.436069 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3fee6396-9ab2-4b06-80c5-35b95319946b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:40.444584 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1088/2158] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:33:40.449048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4639b0-0f16-4c89-8ca7-fc7e90e84c66 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:40.459340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4639b0-0f16-4c89-8ca7-fc7e90e84c66 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:40.464274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bd5f9-dc5d-42d6-8974-40e1f3e14dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:40.464931 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bd5f9-dc5d-42d6-8974-40e1f3e14dfa admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:40.465216 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bd5f9-dc5d-42d6-8974-40e1f3e14dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:40.465496 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bd5f9-dc5d-42d6-8974-40e1f3e14dfa admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:40.466394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bd5f9-dc5d-42d6-8974-40e1f3e14dfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:33:40.466714 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bd5f9-dc5d-42d6-8974-40e1f3e14dfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:40.468911 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bd5f9-dc5d-42d6-8974-40e1f3e14dfa admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:40.483096 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1071/2159] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:33:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:33:40.488762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee6396-9ab2-4b06-80c5-35b95319946b None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:40.503426 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee6396-9ab2-4b06-80c5-35b95319946b None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:40.510558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39a668-6177-40fd-a18a-5e72b8104118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:40.511265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39a668-6177-40fd-a18a-5e72b8104118 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:40.511555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39a668-6177-40fd-a18a-5e72b8104118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:40.512482 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39a668-6177-40fd-a18a-5e72b8104118 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:40.514863 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39a668-6177-40fd-a18a-5e72b8104118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:40.515549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39a668-6177-40fd-a18a-5e72b8104118 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:40.542748 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1089/2160] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:33:40 2021] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:33:40.547786 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bd5f9-dc5d-42d6-8974-40e1f3e14dfa admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:40.563055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd15b7-0204-4297-8ea9-3b9ca466e6e2 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:40.563677 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd15b7-0204-4297-8ea9-3b9ca466e6e2 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:40.564145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd15b7-0204-4297-8ea9-3b9ca466e6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:40.566524 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bd5f9-dc5d-42d6-8974-40e1f3e14dfa admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:40.582883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-15dd15b7-0204-4297-8ea9-3b9ca466e6e2 None None] MFA Rules not processed for user `df94523ab7c545f2a17a2cafe936d2ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:40.584124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-15dd15b7-0204-4297-8ea9-3b9ca466e6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:40.654148 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1090/2161] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:40 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:33:40.662628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f32743-1765-4599-bd46-954b35b51444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:40.663380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f32743-1765-4599-bd46-954b35b51444 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:40.663665 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f32743-1765-4599-bd46-954b35b51444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:40.663933 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f32743-1765-4599-bd46-954b35b51444 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:40.664655 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f32743-1765-4599-bd46-954b35b51444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:40.666589 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f32743-1765-4599-bd46-954b35b51444 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:40.711595 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1072/2162] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:33:40 2021] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:33:40.712793 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd15b7-0204-4297-8ea9-3b9ca466e6e2 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:40.724579 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd15b7-0204-4297-8ea9-3b9ca466e6e2 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:40.729333 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7211a-9e80-4968-aff8-7242000098b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:40.729989 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7211a-9e80-4968-aff8-7242000098b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:40.730339 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7211a-9e80-4968-aff8-7242000098b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:40.730623 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7211a-9e80-4968-aff8-7242000098b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:40.731406 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7211a-9e80-4968-aff8-7242000098b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:40.733052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7211a-9e80-4968-aff8-7242000098b7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:40.748289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1091/2163] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:33:40 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:33:40.752170 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f32743-1765-4599-bd46-954b35b51444 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:40.763629 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f32743-1765-4599-bd46-954b35b51444 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:40.771588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6aa58-4bac-44db-8ba6-40483af62030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:40.772519 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6aa58-4bac-44db-8ba6-40483af62030 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:40.772800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6aa58-4bac-44db-8ba6-40483af62030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:40.773081 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6aa58-4bac-44db-8ba6-40483af62030 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:40.773891 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6aa58-4bac-44db-8ba6-40483af62030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:40.775544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6aa58-4bac-44db-8ba6-40483af62030 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:40.789078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1073/2164] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:33:40 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:33:40.794130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7211a-9e80-4968-aff8-7242000098b7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:40.810166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7211a-9e80-4968-aff8-7242000098b7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:40.818023 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df215197-c180-4313-8294-2595f51242f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:40.819048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df215197-c180-4313-8294-2595f51242f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:40.819334 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df215197-c180-4313-8294-2595f51242f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:40.819613 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df215197-c180-4313-8294-2595f51242f2 admin admin] PATH_INFO: `/v3/projects/23ddd8c13d984053a3ba20b0d1f655ec/users/497cba3d83fd44ecb414f9473aa094e9/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:40.838880 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df215197-c180-4313-8294-2595f51242f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ddd8c13d984053a3ba20b0d1f655ec, user_id=497cba3d83fd44ecb414f9473aa094e9, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:40.841392 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df215197-c180-4313-8294-2595f51242f2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:40.857765 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1092/2165] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:33:40 2021] PUT /identity/v3/projects/23ddd8c13d984053a3ba20b0d1f655ec/users/497cba3d83fd44ecb414f9473aa094e9/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:33:40.869069 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e7e7f-a7e0-4b9a-acc6-9604113a0d79 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:40.869410 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e7e7f-a7e0-4b9a-acc6-9604113a0d79 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:40.869695 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e7e7f-a7e0-4b9a-acc6-9604113a0d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:40.899482 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-f38e7e7f-a7e0-4b9a-acc6-9604113a0d79 None None] MFA Rules not processed for user `497cba3d83fd44ecb414f9473aa094e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:40.900688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f38e7e7f-a7e0-4b9a-acc6-9604113a0d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:40.974078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1074/2166] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:40 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:33:40.975330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df215197-c180-4313-8294-2595f51242f2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:41.036422 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df215197-c180-4313-8294-2595f51242f2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:41.041148 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5a9ed-87c5-4901-ad69-bea84f4f689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:41.041811 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5a9ed-87c5-4901-ad69-bea84f4f689d admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:41.042096 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5a9ed-87c5-4901-ad69-bea84f4f689d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:41.042376 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5a9ed-87c5-4901-ad69-bea84f4f689d admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:41.043117 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5a9ed-87c5-4901-ad69-bea84f4f689d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:41.045019 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5a9ed-87c5-4901-ad69-bea84f4f689d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:41.073526 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1093/2167] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:33:40 2021] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:33:41.074875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e7e7f-a7e0-4b9a-acc6-9604113a0d79 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:41.085727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e7e7f-a7e0-4b9a-acc6-9604113a0d79 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:41.143929 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2b46-08fd-4550-86e7-20d2a24eac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:41.144595 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2b46-08fd-4550-86e7-20d2a24eac70 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:41.144881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2b46-08fd-4550-86e7-20d2a24eac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:41.145274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2b46-08fd-4550-86e7-20d2a24eac70 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:41.145988 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f2b46-08fd-4550-86e7-20d2a24eac70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:41.147952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f2b46-08fd-4550-86e7-20d2a24eac70 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:41.168009 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1075/2168] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:33:41 2021] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:33:41.172059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5a9ed-87c5-4901-ad69-bea84f4f689d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:41.183340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5a9ed-87c5-4901-ad69-bea84f4f689d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:41.196542 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282886a-93f4-4d38-a3e7-83f731b40f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:41.197418 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282886a-93f4-4d38-a3e7-83f731b40f09 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:41.197704 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282886a-93f4-4d38-a3e7-83f731b40f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:41.197978 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282886a-93f4-4d38-a3e7-83f731b40f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:41.198735 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282886a-93f4-4d38-a3e7-83f731b40f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:41.201379 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282886a-93f4-4d38-a3e7-83f731b40f09 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:41.213116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1094/2169] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:33:41 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:33:41.217647 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2b46-08fd-4550-86e7-20d2a24eac70 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:41.230444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2b46-08fd-4550-86e7-20d2a24eac70 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:41.234822 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6540e68-eee5-45d1-b075-d74a9a6136fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:41.235726 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6540e68-eee5-45d1-b075-d74a9a6136fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:41.236017 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6540e68-eee5-45d1-b075-d74a9a6136fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:41.236292 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6540e68-eee5-45d1-b075-d74a9a6136fa admin admin] PATH_INFO: `/v3/projects/bbe967d142ce404bb5ee8e9562bcd714/users/4df3396310e44e40976a0fa6cfc821af/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:41.252712 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6540e68-eee5-45d1-b075-d74a9a6136fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe967d142ce404bb5ee8e9562bcd714, user_id=4df3396310e44e40976a0fa6cfc821af, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:41.255407 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6540e68-eee5-45d1-b075-d74a9a6136fa admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:41.269191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1076/2170] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:33:41 2021] PUT /identity/v3/projects/bbe967d142ce404bb5ee8e9562bcd714/users/4df3396310e44e40976a0fa6cfc821af/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:41.273191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282886a-93f4-4d38-a3e7-83f731b40f09 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:41.283128 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282886a-93f4-4d38-a3e7-83f731b40f09 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:41.338288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5bf55-f1fa-4c2c-8640-7f25fac87961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:41.338992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5bf55-f1fa-4c2c-8640-7f25fac87961 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:41.339275 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5bf55-f1fa-4c2c-8640-7f25fac87961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:41.339551 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5bf55-f1fa-4c2c-8640-7f25fac87961 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:41.340287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5bf55-f1fa-4c2c-8640-7f25fac87961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:41.341863 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5bf55-f1fa-4c2c-8640-7f25fac87961 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:41.351649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1095/2171] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:33:41 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:33:41.355934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6540e68-eee5-45d1-b075-d74a9a6136fa admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:41.366401 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6540e68-eee5-45d1-b075-d74a9a6136fa admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:41.371100 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bddd7d-1e4a-4d86-8673-54c32bc9fcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:41.371977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bddd7d-1e4a-4d86-8673-54c32bc9fcdd admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:41.372257 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bddd7d-1e4a-4d86-8673-54c32bc9fcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:41.372530 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bddd7d-1e4a-4d86-8673-54c32bc9fcdd admin admin] PATH_INFO: `/v3/projects/bbe967d142ce404bb5ee8e9562bcd714/users/4df3396310e44e40976a0fa6cfc821af/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:41.375236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bddd7d-1e4a-4d86-8673-54c32bc9fcdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe967d142ce404bb5ee8e9562bcd714, user_id=4df3396310e44e40976a0fa6cfc821af, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:41.377844 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bddd7d-1e4a-4d86-8673-54c32bc9fcdd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:41.388275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1077/2172] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:33:41 2021] PUT /identity/v3/projects/bbe967d142ce404bb5ee8e9562bcd714/users/4df3396310e44e40976a0fa6cfc821af/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:41.399120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c38c77-a8b7-463f-a42d-740e1ba0acb4 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:41.399120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c38c77-a8b7-463f-a42d-740e1ba0acb4 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:41.399120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c38c77-a8b7-463f-a42d-740e1ba0acb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:41.434961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b9c38c77-a8b7-463f-a42d-740e1ba0acb4 None None] MFA Rules not processed for user `4df3396310e44e40976a0fa6cfc821af`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:41.437122 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b9c38c77-a8b7-463f-a42d-740e1ba0acb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:41.540231 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1096/2173] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:41 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:33:41.550384 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bddd7d-1e4a-4d86-8673-54c32bc9fcdd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:41.552238 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-02bddd7d-1e4a-4d86-8673-54c32bc9fcdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:41.635049 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bddd7d-1e4a-4d86-8673-54c32bc9fcdd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:41.648913 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770d5b1-a0d5-45a1-8571-54ddd2916392 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:41.650882 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770d5b1-a0d5-45a1-8571-54ddd2916392 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:41.651182 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770d5b1-a0d5-45a1-8571-54ddd2916392 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:41.651460 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770d5b1-a0d5-45a1-8571-54ddd2916392 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:41.671846 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770d5b1-a0d5-45a1-8571-54ddd2916392 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:41.673315 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770d5b1-a0d5-45a1-8571-54ddd2916392 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:41.684117 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1078/2174] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:33:41 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:33:41.735077 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c38c77-a8b7-463f-a42d-740e1ba0acb4 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:41.736489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b9c38c77-a8b7-463f-a42d-740e1ba0acb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:41.759138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c38c77-a8b7-463f-a42d-740e1ba0acb4 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:41.763304 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc222-fcdd-4314-ae42-6286a922427b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:41.764061 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc222-fcdd-4314-ae42-6286a922427b service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:41.764518 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc222-fcdd-4314-ae42-6286a922427b service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:41.764890 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc222-fcdd-4314-ae42-6286a922427b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:41.831602 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc222-fcdd-4314-ae42-6286a922427b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:41.833261 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc222-fcdd-4314-ae42-6286a922427b service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:41.843235 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1097/2175] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:33:41 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:33:46.389606 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770d5b1-a0d5-45a1-8571-54ddd2916392 service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:46.456110 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770d5b1-a0d5-45a1-8571-54ddd2916392 service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:46.460642 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f45fdf-7e52-46e7-8b64-813fcfc73ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:46.461505 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f45fdf-7e52-46e7-8b64-813fcfc73ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:46.461787 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f45fdf-7e52-46e7-8b64-813fcfc73ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:46.462066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f45fdf-7e52-46e7-8b64-813fcfc73ba5 admin admin] PATH_INFO: `/v3/users/497cba3d83fd44ecb414f9473aa094e9` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:46.463414 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f45fdf-7e52-46e7-8b64-813fcfc73ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=497cba3d83fd44ecb414f9473aa094e9)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:46.465440 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f45fdf-7e52-46e7-8b64-813fcfc73ba5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:46.511057 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-48f45fdf-7e52-46e7-8b64-813fcfc73ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497cba3d83fd44ecb414f9473aa094e9'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:46.524007 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-48f45fdf-7e52-46e7-8b64-813fcfc73ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497cba3d83fd44ecb414f9473aa094e9'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:46.531965 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-48f45fdf-7e52-46e7-8b64-813fcfc73ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497cba3d83fd44ecb414f9473aa094e9'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:46.539657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-48f45fdf-7e52-46e7-8b64-813fcfc73ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497cba3d83fd44ecb414f9473aa094e9'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:46.540306 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-48f45fdf-7e52-46e7-8b64-813fcfc73ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497cba3d83fd44ecb414f9473aa094e9'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:46.546635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1079/2176] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:33:46 2021] DELETE /identity/v3/users/497cba3d83fd44ecb414f9473aa094e9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:46.551184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b405b0-c54f-4aec-a040-4c7d4fdacf2d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:46.551700 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b405b0-c54f-4aec-a040-4c7d4fdacf2d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:46.551799 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b405b0-c54f-4aec-a040-4c7d4fdacf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:46.569489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-16b405b0-c54f-4aec-a040-4c7d4fdacf2d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:46.570707 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-16b405b0-c54f-4aec-a040-4c7d4fdacf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:46.636969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1098/2177] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:33:46.659586 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f45fdf-7e52-46e7-8b64-813fcfc73ba5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:46.663491 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-48f45fdf-7e52-46e7-8b64-813fcfc73ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:46.719382 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f45fdf-7e52-46e7-8b64-813fcfc73ba5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:46.723349 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbcd84-be6d-442e-84c2-f910b89da6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:46.723981 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbcd84-be6d-442e-84c2-f910b89da6ae service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:46.724260 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbcd84-be6d-442e-84c2-f910b89da6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:46.724532 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbcd84-be6d-442e-84c2-f910b89da6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:46.734004 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bbcd84-be6d-442e-84c2-f910b89da6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:46.736052 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bbcd84-be6d-442e-84c2-f910b89da6ae service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:46.747345 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1080/2178] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:33:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:33:47.005392 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b405b0-c54f-4aec-a040-4c7d4fdacf2d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:47.006823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-16b405b0-c54f-4aec-a040-4c7d4fdacf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:47.021074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b405b0-c54f-4aec-a040-4c7d4fdacf2d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:47.026300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:47.027202 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:47.027487 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:47.027793 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] PATH_INFO: `/v3/projects/23ddd8c13d984053a3ba20b0d1f655ec` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:47.029000 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ddd8c13d984053a3ba20b0d1f655ec)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:47.031565 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:47.078210 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ddd8c13d984053a3ba20b0d1f655ec', 'request_id': 'req-8644d5e1-15fd-493d-ad06-5d42337f19ad'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.085048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ddd8c13d984053a3ba20b0d1f655ec', 'request_id': 'req-8644d5e1-15fd-493d-ad06-5d42337f19ad'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.091362 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ddd8c13d984053a3ba20b0d1f655ec', 'request_id': 'req-8644d5e1-15fd-493d-ad06-5d42337f19ad'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.101809 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] The token cache is being invalidate because project 23ddd8c13d984053a3ba20b0d1f655ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:33:47.102097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.102726 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.104289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1099/2179] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:33:47 2021] DELETE /identity/v3/projects/23ddd8c13d984053a3ba20b0d1f655ec => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:47.108309 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbcd84-be6d-442e-84c2-f910b89da6ae service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:47.117981 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbcd84-be6d-442e-84c2-f910b89da6ae service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:47.172995 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe4a4f-00b6-4265-b846-c78793e8796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:47.173848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe4a4f-00b6-4265-b846-c78793e8796d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:47.174132 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe4a4f-00b6-4265-b846-c78793e8796d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:47.174406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe4a4f-00b6-4265-b846-c78793e8796d admin admin] PATH_INFO: `/v3/users/4df3396310e44e40976a0fa6cfc821af` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:47.175604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe4a4f-00b6-4265-b846-c78793e8796d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df3396310e44e40976a0fa6cfc821af)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:47.177509 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe4a4f-00b6-4265-b846-c78793e8796d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:47.221385 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4afe4a4f-00b6-4265-b846-c78793e8796d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df3396310e44e40976a0fa6cfc821af'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.232734 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4afe4a4f-00b6-4265-b846-c78793e8796d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df3396310e44e40976a0fa6cfc821af'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.239535 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4afe4a4f-00b6-4265-b846-c78793e8796d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df3396310e44e40976a0fa6cfc821af'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.246041 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4afe4a4f-00b6-4265-b846-c78793e8796d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df3396310e44e40976a0fa6cfc821af'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.246667 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4afe4a4f-00b6-4265-b846-c78793e8796d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df3396310e44e40976a0fa6cfc821af'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.252971 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1081/2180] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:33:47 2021] DELETE /identity/v3/users/4df3396310e44e40976a0fa6cfc821af => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:47.522386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:47.524020 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:47.536897 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644d5e1-15fd-493d-ad06-5d42337f19ad admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:47.593389 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:47.594243 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:47.594522 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:47.594796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a admin admin] PATH_INFO: `/v3/projects/bbe967d142ce404bb5ee8e9562bcd714` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:47.596026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe967d142ce404bb5ee8e9562bcd714)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:47.597908 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:47.642204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe967d142ce404bb5ee8e9562bcd714', 'request_id': 'req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.649150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe967d142ce404bb5ee8e9562bcd714', 'request_id': 'req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.655159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe967d142ce404bb5ee8e9562bcd714', 'request_id': 'req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.665150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a admin admin] The token cache is being invalidate because project bbe967d142ce404bb5ee8e9562bcd714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:33:47.665447 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.666086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4d040cb1-f7e0-46aa-a09a-98bcbea0008a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:33:47.667643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1100/2181] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:33:47 2021] DELETE /identity/v3/projects/bbe967d142ce404bb5ee8e9562bcd714 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:47.673825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeca82-2b5c-4d9b-a3fb-22c37613f2d9 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:47.674292 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeca82-2b5c-4d9b-a3fb-22c37613f2d9 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:47.674384 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeca82-2b5c-4d9b-a3fb-22c37613f2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:47.692786 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-c0aeca82-2b5c-4d9b-a3fb-22c37613f2d9 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:47.694058 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c0aeca82-2b5c-4d9b-a3fb-22c37613f2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:47.754007 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1082/2182] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:33:47.762606 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813d56c-3dfd-45e3-8915-f5aff733915e None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:47.762926 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813d56c-3dfd-45e3-8915-f5aff733915e None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:47.763217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813d56c-3dfd-45e3-8915-f5aff733915e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:47.783509 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-c813d56c-3dfd-45e3-8915-f5aff733915e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:47.784717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c813d56c-3dfd-45e3-8915-f5aff733915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:47.794872 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1101/2183] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:33:47.799426 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeca82-2b5c-4d9b-a3fb-22c37613f2d9 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:47.809379 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeca82-2b5c-4d9b-a3fb-22c37613f2d9 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:47.814886 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4b54-652d-4eab-aecd-2ac05b82c40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:47.815537 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4b54-652d-4eab-aecd-2ac05b82c40f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:47.815820 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4b54-652d-4eab-aecd-2ac05b82c40f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:47.816099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4b54-652d-4eab-aecd-2ac05b82c40f admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:47.816855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c4b54-652d-4eab-aecd-2ac05b82c40f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:33:47.817167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c4b54-652d-4eab-aecd-2ac05b82c40f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:47.818762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c4b54-652d-4eab-aecd-2ac05b82c40f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:47.831106 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1083/2184] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:33:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:33:47.835377 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813d56c-3dfd-45e3-8915-f5aff733915e None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:47.851491 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813d56c-3dfd-45e3-8915-f5aff733915e None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:47.859661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ea72b-fffd-4aef-b518-b80c0899357b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:47.860313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ea72b-fffd-4aef-b518-b80c0899357b admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:47.860592 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ea72b-fffd-4aef-b518-b80c0899357b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:47.860864 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ea72b-fffd-4aef-b518-b80c0899357b admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:47.861586 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ea72b-fffd-4aef-b518-b80c0899357b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:47.863559 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ea72b-fffd-4aef-b518-b80c0899357b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:47.888299 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1102/2185] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:33:47 2021] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:33:47.892526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4b54-652d-4eab-aecd-2ac05b82c40f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:47.902104 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4b54-652d-4eab-aecd-2ac05b82c40f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:47.956481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26d330-ba4a-46df-8374-0de58843b62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:47.957132 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26d330-ba4a-46df-8374-0de58843b62e admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:47.957427 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26d330-ba4a-46df-8374-0de58843b62e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:47.957686 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26d330-ba4a-46df-8374-0de58843b62e admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:47.958389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26d330-ba4a-46df-8374-0de58843b62e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:47.960325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26d330-ba4a-46df-8374-0de58843b62e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:47.980675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1084/2186] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:33:47 2021] POST /identity/v3/users => generated 304 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:33:47.985385 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ea72b-fffd-4aef-b518-b80c0899357b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:47.995492 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ea72b-fffd-4aef-b518-b80c0899357b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:48.000150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716a2b1-a25e-4c2f-8445-a290c0a095f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:48.000799 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716a2b1-a25e-4c2f-8445-a290c0a095f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:48.001083 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716a2b1-a25e-4c2f-8445-a290c0a095f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:48.001361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716a2b1-a25e-4c2f-8445-a290c0a095f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:48.002101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716a2b1-a25e-4c2f-8445-a290c0a095f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:48.003708 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716a2b1-a25e-4c2f-8445-a290c0a095f8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:48.014412 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1103/2187] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:33:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:33:48.018173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26d330-ba4a-46df-8374-0de58843b62e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:48.027679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26d330-ba4a-46df-8374-0de58843b62e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:48.032948 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27399108-f07f-42e1-ad52-b9456e115010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:48.033596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27399108-f07f-42e1-ad52-b9456e115010 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:48.033879 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27399108-f07f-42e1-ad52-b9456e115010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:48.034156 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27399108-f07f-42e1-ad52-b9456e115010 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:48.034934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27399108-f07f-42e1-ad52-b9456e115010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:48.036532 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27399108-f07f-42e1-ad52-b9456e115010 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:48.046821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1085/2188] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:33:48 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:33:48.050721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716a2b1-a25e-4c2f-8445-a290c0a095f8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:48.061031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716a2b1-a25e-4c2f-8445-a290c0a095f8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:48.065951 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56548a54-a27c-4259-ab8b-699df3a2bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:48.066949 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56548a54-a27c-4259-ab8b-699df3a2bf56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:48.067293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56548a54-a27c-4259-ab8b-699df3a2bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:48.067579 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56548a54-a27c-4259-ab8b-699df3a2bf56 admin admin] PATH_INFO: `/v3/projects/9e7824d00d334a8d8479ac6510f64236/users/6f4fb238ba754569b93b7fca7681c9e8/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:48.082817 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56548a54-a27c-4259-ab8b-699df3a2bf56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7824d00d334a8d8479ac6510f64236, user_id=6f4fb238ba754569b93b7fca7681c9e8, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:48.085544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56548a54-a27c-4259-ab8b-699df3a2bf56 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:48.099521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1104/2189] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:33:48 2021] PUT /identity/v3/projects/9e7824d00d334a8d8479ac6510f64236/users/6f4fb238ba754569b93b7fca7681c9e8/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:48.110258 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4eebf-1696-407f-be67-9529daef63ae None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:48.111584 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4eebf-1696-407f-be67-9529daef63ae None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:48.111872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4eebf-1696-407f-be67-9529daef63ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:48.140371 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-02c4eebf-1696-407f-be67-9529daef63ae None None] MFA Rules not processed for user `6f4fb238ba754569b93b7fca7681c9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:48.142080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-02c4eebf-1696-407f-be67-9529daef63ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:48.208343 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1086/2190] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:48 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:33:48.212984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56548a54-a27c-4259-ab8b-699df3a2bf56 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:48.275917 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56548a54-a27c-4259-ab8b-699df3a2bf56 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:48.281877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9c9eb-5e69-4c5b-bd54-9ce671adb143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:48.282535 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9c9eb-5e69-4c5b-bd54-9ce671adb143 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:48.282817 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9c9eb-5e69-4c5b-bd54-9ce671adb143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:48.283126 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9c9eb-5e69-4c5b-bd54-9ce671adb143 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:48.283843 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9c9eb-5e69-4c5b-bd54-9ce671adb143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:48.285884 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9c9eb-5e69-4c5b-bd54-9ce671adb143 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:48.316248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1105/2191] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:33:48 2021] POST /identity/v3/projects => generated 409 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:33:48.320409 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4eebf-1696-407f-be67-9529daef63ae None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:48.331694 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4eebf-1696-407f-be67-9529daef63ae None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:48.384719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8886-832a-4bae-90cd-ec34c267fbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:48.385356 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8886-832a-4bae-90cd-ec34c267fbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:48.385639 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8886-832a-4bae-90cd-ec34c267fbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:48.385917 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8886-832a-4bae-90cd-ec34c267fbc5 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:48.386665 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f8886-832a-4bae-90cd-ec34c267fbc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:48.389217 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f8886-832a-4bae-90cd-ec34c267fbc5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:48.414073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1087/2192] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:33:48 2021] POST /identity/v3/users => generated 311 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:33:48.415594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9c9eb-5e69-4c5b-bd54-9ce671adb143 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:48.426190 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9c9eb-5e69-4c5b-bd54-9ce671adb143 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:48.431735 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27ec36-b179-4718-a1f1-eb204e55d951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:48.432549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27ec36-b179-4718-a1f1-eb204e55d951 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:48.432838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27ec36-b179-4718-a1f1-eb204e55d951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:48.433116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27ec36-b179-4718-a1f1-eb204e55d951 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:48.433859 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27ec36-b179-4718-a1f1-eb204e55d951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:48.435649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27ec36-b179-4718-a1f1-eb204e55d951 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:48.446159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1106/2193] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:33:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:33:48.450421 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8886-832a-4bae-90cd-ec34c267fbc5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:48.460782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8886-832a-4bae-90cd-ec34c267fbc5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:48.465302 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708a7c0-372f-4db7-8007-4b0eea7df150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:48.466162 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708a7c0-372f-4db7-8007-4b0eea7df150 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:48.466440 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708a7c0-372f-4db7-8007-4b0eea7df150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:48.466718 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708a7c0-372f-4db7-8007-4b0eea7df150 admin admin] PATH_INFO: `/v3/projects/2fa4a98efc984aa891e5faf03ce00707/users/d3f42f6a84e24df9be584a5b13c223ee/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:48.485056 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708a7c0-372f-4db7-8007-4b0eea7df150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa4a98efc984aa891e5faf03ce00707, user_id=d3f42f6a84e24df9be584a5b13c223ee, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:48.487947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708a7c0-372f-4db7-8007-4b0eea7df150 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:48.500659 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1088/2194] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:33:48 2021] PUT /identity/v3/projects/2fa4a98efc984aa891e5faf03ce00707/users/d3f42f6a84e24df9be584a5b13c223ee/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:48.504572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27ec36-b179-4718-a1f1-eb204e55d951 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:48.515055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27ec36-b179-4718-a1f1-eb204e55d951 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:48.568084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628a764-1565-4579-857b-875fd82951d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:48.568708 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a764-1565-4579-857b-875fd82951d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:48.568988 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a764-1565-4579-857b-875fd82951d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:48.569264 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a764-1565-4579-857b-875fd82951d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:48.569994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628a764-1565-4579-857b-875fd82951d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:48.571898 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628a764-1565-4579-857b-875fd82951d7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:48.585821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1107/2195] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:33:48 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:33:48.590527 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708a7c0-372f-4db7-8007-4b0eea7df150 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:48.601332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708a7c0-372f-4db7-8007-4b0eea7df150 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:48.605908 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892211e9-2b19-4654-ad52-ae0005004397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:48.606765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892211e9-2b19-4654-ad52-ae0005004397 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:48.607082 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892211e9-2b19-4654-ad52-ae0005004397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:48.607362 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892211e9-2b19-4654-ad52-ae0005004397 admin admin] PATH_INFO: `/v3/projects/2fa4a98efc984aa891e5faf03ce00707/users/d3f42f6a84e24df9be584a5b13c223ee/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:48.609318 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892211e9-2b19-4654-ad52-ae0005004397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa4a98efc984aa891e5faf03ce00707, user_id=d3f42f6a84e24df9be584a5b13c223ee, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:48.612011 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892211e9-2b19-4654-ad52-ae0005004397 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:48.621668 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1089/2196] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:33:48 2021] PUT /identity/v3/projects/2fa4a98efc984aa891e5faf03ce00707/users/d3f42f6a84e24df9be584a5b13c223ee/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:33:48.632066 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09d9b0-1509-4685-b62b-a981296ee801 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:48.632540 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09d9b0-1509-4685-b62b-a981296ee801 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:48.632652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09d9b0-1509-4685-b62b-a981296ee801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:48.659721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-ae09d9b0-1509-4685-b62b-a981296ee801 None None] MFA Rules not processed for user `d3f42f6a84e24df9be584a5b13c223ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:33:48.660928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-ae09d9b0-1509-4685-b62b-a981296ee801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:48.725661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1108/2197] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:33:48 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:33:48.736172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892211e9-2b19-4654-ad52-ae0005004397 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:48.737881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-892211e9-2b19-4654-ad52-ae0005004397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:33:48.792668 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892211e9-2b19-4654-ad52-ae0005004397 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:48.796957 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d52a5-98ab-46fa-9911-18874f98e010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:48.797594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d52a5-98ab-46fa-9911-18874f98e010 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:48.797874 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d52a5-98ab-46fa-9911-18874f98e010 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:48.798150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d52a5-98ab-46fa-9911-18874f98e010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:48.806947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d52a5-98ab-46fa-9911-18874f98e010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:48.808387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d52a5-98ab-46fa-9911-18874f98e010 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:48.817599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1090/2198] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:33:48 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:33:48.954329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09d9b0-1509-4685-b62b-a981296ee801 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:33:48.963546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09d9b0-1509-4685-b62b-a981296ee801 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:33:48.967678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bd98a-cf8d-4780-be2d-064800dbe57f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:33:48.968368 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bd98a-cf8d-4780-be2d-064800dbe57f service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:33:48.968649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bd98a-cf8d-4780-be2d-064800dbe57f service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:33:48.968920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bd98a-cf8d-4780-be2d-064800dbe57f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:33:49.039325 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bd98a-cf8d-4780-be2d-064800dbe57f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:33:49.040755 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bd98a-cf8d-4780-be2d-064800dbe57f service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:33:49.052179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1109/2199] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:33:48 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:00.375848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d52a5-98ab-46fa-9911-18874f98e010 service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:00.484162 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d52a5-98ab-46fa-9911-18874f98e010 service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:00.489284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e3f75-149b-4313-b79e-9276f3157356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:00.490150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e3f75-149b-4313-b79e-9276f3157356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:00.490443 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e3f75-149b-4313-b79e-9276f3157356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:00.490765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e3f75-149b-4313-b79e-9276f3157356 admin admin] PATH_INFO: `/v3/users/6f4fb238ba754569b93b7fca7681c9e8` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:00.491971 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e3f75-149b-4313-b79e-9276f3157356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f4fb238ba754569b93b7fca7681c9e8)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:00.493891 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e3f75-149b-4313-b79e-9276f3157356 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:00.538703 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d55e3f75-149b-4313-b79e-9276f3157356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f4fb238ba754569b93b7fca7681c9e8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:00.550941 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d55e3f75-149b-4313-b79e-9276f3157356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f4fb238ba754569b93b7fca7681c9e8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:00.557824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d55e3f75-149b-4313-b79e-9276f3157356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f4fb238ba754569b93b7fca7681c9e8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:00.565080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d55e3f75-149b-4313-b79e-9276f3157356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f4fb238ba754569b93b7fca7681c9e8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:00.565721 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d55e3f75-149b-4313-b79e-9276f3157356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f4fb238ba754569b93b7fca7681c9e8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:00.571997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1091/2200] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:34:00 2021] DELETE /identity/v3/users/6f4fb238ba754569b93b7fca7681c9e8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:00.576752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63437-ee2b-460c-b213-61eb6fa322bb None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:00.577882 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63437-ee2b-460c-b213-61eb6fa322bb None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:00.578221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63437-ee2b-460c-b213-61eb6fa322bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:00.630233 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-8ff63437-ee2b-460c-b213-61eb6fa322bb None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:00.631417 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8ff63437-ee2b-460c-b213-61eb6fa322bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:00.688063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1110/2201] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:34:00.698444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e3f75-149b-4313-b79e-9276f3157356 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:00.699893 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-d55e3f75-149b-4313-b79e-9276f3157356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:00.790183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e3f75-149b-4313-b79e-9276f3157356 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:00.793792 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7e1d5-5f18-43ca-9731-bb7ab22387c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:00.796174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e1d5-5f18-43ca-9731-bb7ab22387c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:00.796174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e1d5-5f18-43ca-9731-bb7ab22387c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:00.796174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e1d5-5f18-43ca-9731-bb7ab22387c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:00.804681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7e1d5-5f18-43ca-9731-bb7ab22387c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:00.806109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7e1d5-5f18-43ca-9731-bb7ab22387c3 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:00.815613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1092/2202] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:01.099636 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff63437-ee2b-460c-b213-61eb6fa322bb None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:01.101175 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8ff63437-ee2b-460c-b213-61eb6fa322bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:01.113765 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff63437-ee2b-460c-b213-61eb6fa322bb None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:01.118269 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:01.119151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:01.119429 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:01.119702 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] PATH_INFO: `/v3/projects/9e7824d00d334a8d8479ac6510f64236` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:01.121674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7824d00d334a8d8479ac6510f64236)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:01.123537 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:01.173957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7824d00d334a8d8479ac6510f64236', 'request_id': 'req-2c73cc30-ce04-4468-a06c-0d9e12710dd2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.180643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7824d00d334a8d8479ac6510f64236', 'request_id': 'req-2c73cc30-ce04-4468-a06c-0d9e12710dd2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.186675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7824d00d334a8d8479ac6510f64236', 'request_id': 'req-2c73cc30-ce04-4468-a06c-0d9e12710dd2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.196628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] The token cache is being invalidate because project 9e7824d00d334a8d8479ac6510f64236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:34:01.196912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.197521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.199067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1111/2203] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:34:01 2021] DELETE /identity/v3/projects/9e7824d00d334a8d8479ac6510f64236 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:01.203538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7e1d5-5f18-43ca-9731-bb7ab22387c3 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:01.220848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7e1d5-5f18-43ca-9731-bb7ab22387c3 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:01.274415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac96905-934c-4370-b018-605ac05c72f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:01.275316 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac96905-934c-4370-b018-605ac05c72f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:01.275602 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac96905-934c-4370-b018-605ac05c72f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:01.275879 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac96905-934c-4370-b018-605ac05c72f9 admin admin] PATH_INFO: `/v3/users/d3f42f6a84e24df9be584a5b13c223ee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:01.277246 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac96905-934c-4370-b018-605ac05c72f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f42f6a84e24df9be584a5b13c223ee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:01.279913 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac96905-934c-4370-b018-605ac05c72f9 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:01.322082 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-bac96905-934c-4370-b018-605ac05c72f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f42f6a84e24df9be584a5b13c223ee'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.334369 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-bac96905-934c-4370-b018-605ac05c72f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f42f6a84e24df9be584a5b13c223ee'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.341825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-bac96905-934c-4370-b018-605ac05c72f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f42f6a84e24df9be584a5b13c223ee'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.348514 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-bac96905-934c-4370-b018-605ac05c72f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f42f6a84e24df9be584a5b13c223ee'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.349150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-bac96905-934c-4370-b018-605ac05c72f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f42f6a84e24df9be584a5b13c223ee'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.354820 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1093/2204] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:34:01 2021] DELETE /identity/v3/users/d3f42f6a84e24df9be584a5b13c223ee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:01.619330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:01.620885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:01.637112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73cc30-ce04-4468-a06c-0d9e12710dd2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:01.704948 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0217c-293c-423b-83aa-8b16a0737d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:01.705732 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0217c-293c-423b-83aa-8b16a0737d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:01.706007 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0217c-293c-423b-83aa-8b16a0737d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:01.706283 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0217c-293c-423b-83aa-8b16a0737d35 admin admin] PATH_INFO: `/v3/projects/2fa4a98efc984aa891e5faf03ce00707` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:01.707531 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0217c-293c-423b-83aa-8b16a0737d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa4a98efc984aa891e5faf03ce00707)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:01.709417 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0217c-293c-423b-83aa-8b16a0737d35 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:01.756557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4cd0217c-293c-423b-83aa-8b16a0737d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa4a98efc984aa891e5faf03ce00707', 'request_id': 'req-4cd0217c-293c-423b-83aa-8b16a0737d35'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.764809 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4cd0217c-293c-423b-83aa-8b16a0737d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa4a98efc984aa891e5faf03ce00707', 'request_id': 'req-4cd0217c-293c-423b-83aa-8b16a0737d35'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.771291 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4cd0217c-293c-423b-83aa-8b16a0737d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa4a98efc984aa891e5faf03ce00707', 'request_id': 'req-4cd0217c-293c-423b-83aa-8b16a0737d35'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.782181 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4cd0217c-293c-423b-83aa-8b16a0737d35 admin admin] The token cache is being invalidate because project 2fa4a98efc984aa891e5faf03ce00707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:34:01.782469 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4cd0217c-293c-423b-83aa-8b16a0737d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.783132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4cd0217c-293c-423b-83aa-8b16a0737d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:01.784736 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1112/2205] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:34:01 2021] DELETE /identity/v3/projects/2fa4a98efc984aa891e5faf03ce00707 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:01.790510 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031bbda-8977-4d08-a855-84dcff7613c1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:01.791039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031bbda-8977-4d08-a855-84dcff7613c1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:01.791274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031bbda-8977-4d08-a855-84dcff7613c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:01.848180 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-0031bbda-8977-4d08-a855-84dcff7613c1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:01.849381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0031bbda-8977-4d08-a855-84dcff7613c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:01.907536 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1094/2206] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:01.916537 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26aa94-74c2-4b24-a476-eb5f98412b1a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:01.916830 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26aa94-74c2-4b24-a476-eb5f98412b1a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:01.917115 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26aa94-74c2-4b24-a476-eb5f98412b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:01.935788 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-ee26aa94-74c2-4b24-a476-eb5f98412b1a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:01.937103 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-ee26aa94-74c2-4b24-a476-eb5f98412b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:01.947940 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1113/2207] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:34:01.952829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031bbda-8977-4d08-a855-84dcff7613c1 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:01.962838 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031bbda-8977-4d08-a855-84dcff7613c1 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:01.970024 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3056665-24b7-4f23-8089-ed9ea8a13968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:01.970691 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056665-24b7-4f23-8089-ed9ea8a13968 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:01.971011 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056665-24b7-4f23-8089-ed9ea8a13968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:01.971295 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056665-24b7-4f23-8089-ed9ea8a13968 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:01.972047 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3056665-24b7-4f23-8089-ed9ea8a13968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:34:01.972360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3056665-24b7-4f23-8089-ed9ea8a13968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:01.973973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3056665-24b7-4f23-8089-ed9ea8a13968 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:01.986751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1095/2208] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:34:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:34:01.991340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26aa94-74c2-4b24-a476-eb5f98412b1a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:02.001106 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26aa94-74c2-4b24-a476-eb5f98412b1a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:02.005788 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd870d-cd9d-4141-a283-5db7ebc58dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:02.006440 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd870d-cd9d-4141-a283-5db7ebc58dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:02.006725 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd870d-cd9d-4141-a283-5db7ebc58dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:02.007036 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd870d-cd9d-4141-a283-5db7ebc58dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:02.007742 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd870d-cd9d-4141-a283-5db7ebc58dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:02.009770 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd870d-cd9d-4141-a283-5db7ebc58dd0 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:02.040378 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1114/2209] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:34:01 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:02.046561 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3056665-24b7-4f23-8089-ed9ea8a13968 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:02.058213 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3056665-24b7-4f23-8089-ed9ea8a13968 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:02.117116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646560f7-2cd1-4b95-bbe9-2e066df551b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:02.117786 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646560f7-2cd1-4b95-bbe9-2e066df551b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:02.118067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646560f7-2cd1-4b95-bbe9-2e066df551b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:02.118340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646560f7-2cd1-4b95-bbe9-2e066df551b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:02.119092 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646560f7-2cd1-4b95-bbe9-2e066df551b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:02.121174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646560f7-2cd1-4b95-bbe9-2e066df551b3 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:02.141715 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1096/2210] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:34:02 2021] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:02.145889 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd870d-cd9d-4141-a283-5db7ebc58dd0 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:02.157091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd870d-cd9d-4141-a283-5db7ebc58dd0 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:02.167821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fd6d5-99c9-4cdf-96de-dd1402d2d9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:02.168579 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fd6d5-99c9-4cdf-96de-dd1402d2d9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:02.169140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fd6d5-99c9-4cdf-96de-dd1402d2d9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:02.169140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fd6d5-99c9-4cdf-96de-dd1402d2d9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:02.170382 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fd6d5-99c9-4cdf-96de-dd1402d2d9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:02.171488 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fd6d5-99c9-4cdf-96de-dd1402d2d9a2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:02.187112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1115/2211] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:02 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:02.188335 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646560f7-2cd1-4b95-bbe9-2e066df551b3 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:02.199843 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646560f7-2cd1-4b95-bbe9-2e066df551b3 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:02.205375 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d9d9c-1ba5-4197-8880-6fc20e5937c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:02.206044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d9d9c-1ba5-4197-8880-6fc20e5937c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:02.206340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d9d9c-1ba5-4197-8880-6fc20e5937c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:02.206617 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d9d9c-1ba5-4197-8880-6fc20e5937c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:02.207395 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d9d9c-1ba5-4197-8880-6fc20e5937c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:02.208980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d9d9c-1ba5-4197-8880-6fc20e5937c6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:02.218830 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1097/2212] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:02.222967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fd6d5-99c9-4cdf-96de-dd1402d2d9a2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:02.232728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fd6d5-99c9-4cdf-96de-dd1402d2d9a2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:02.238143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b0581-d392-4a46-9e92-5b26e4870a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:02.241931 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b0581-d392-4a46-9e92-5b26e4870a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:02.241931 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b0581-d392-4a46-9e92-5b26e4870a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:02.241931 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b0581-d392-4a46-9e92-5b26e4870a48 admin admin] PATH_INFO: `/v3/projects/050149bd93864d2abd0b342b8062d3d5/users/a52a2c8071134b07bdc222088246a671/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:02.261140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b0581-d392-4a46-9e92-5b26e4870a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=050149bd93864d2abd0b342b8062d3d5, user_id=a52a2c8071134b07bdc222088246a671, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:02.264718 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b0581-d392-4a46-9e92-5b26e4870a48 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:02.279387 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1116/2213] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:02 2021] PUT /identity/v3/projects/050149bd93864d2abd0b342b8062d3d5/users/a52a2c8071134b07bdc222088246a671/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:02.284877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa734c01-2d88-445f-9883-ba5432dbd94c None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:02.285168 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa734c01-2d88-445f-9883-ba5432dbd94c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:02.285452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa734c01-2d88-445f-9883-ba5432dbd94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:02.305929 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-aa734c01-2d88-445f-9883-ba5432dbd94c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:02.307203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-aa734c01-2d88-445f-9883-ba5432dbd94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:02.370055 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1098/2214] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:02.380615 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b0581-d392-4a46-9e92-5b26e4870a48 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:02.382347 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-156b0581-d392-4a46-9e92-5b26e4870a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:02.440578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b0581-d392-4a46-9e92-5b26e4870a48 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:02.444234 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77cb6f-80ea-4154-b718-46a2d8a196a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:02.444870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77cb6f-80ea-4154-b718-46a2d8a196a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:02.445154 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77cb6f-80ea-4154-b718-46a2d8a196a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:02.445430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77cb6f-80ea-4154-b718-46a2d8a196a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:02.455089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77cb6f-80ea-4154-b718-46a2d8a196a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:02.456519 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77cb6f-80ea-4154-b718-46a2d8a196a9 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:02.465809 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1117/2215] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:03.172851 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4924935-7a5e-4a4e-9b72-5557d4f184ab None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:03.173339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4924935-7a5e-4a4e-9b72-5557d4f184ab None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:03.173430 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4924935-7a5e-4a4e-9b72-5557d4f184ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:03.201630 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e4924935-7a5e-4a4e-9b72-5557d4f184ab None None] MFA Rules not processed for user `a52a2c8071134b07bdc222088246a671`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:03.202878 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e4924935-7a5e-4a4e-9b72-5557d4f184ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:03.282999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1099/2216] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:03 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:03.291619 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77cb6f-80ea-4154-b718-46a2d8a196a9 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:03.293815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-bf77cb6f-80ea-4154-b718-46a2d8a196a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:03.364487 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77cb6f-80ea-4154-b718-46a2d8a196a9 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:03.368768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea1364-7139-44fa-b811-83c4d747c0e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:03.369634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea1364-7139-44fa-b811-83c4d747c0e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:03.370075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea1364-7139-44fa-b811-83c4d747c0e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:03.370608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea1364-7139-44fa-b811-83c4d747c0e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:03.379831 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea1364-7139-44fa-b811-83c4d747c0e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:03.383575 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea1364-7139-44fa-b811-83c4d747c0e2 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:03.394972 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1118/2217] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:03 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:04.736329 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398b75-295b-484a-ab65-fe3e3e959f95 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:04.736839 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398b75-295b-484a-ab65-fe3e3e959f95 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:04.736961 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398b75-295b-484a-ab65-fe3e3e959f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:04.754750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-99398b75-295b-484a-ab65-fe3e3e959f95 None None] MFA Rules not processed for user `a52a2c8071134b07bdc222088246a671`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:04.755976 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-99398b75-295b-484a-ab65-fe3e3e959f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:04.762694 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1100/2218] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:04 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:09.192462 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea1364-7139-44fa-b811-83c4d747c0e2 service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:09.193835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9aea1364-7139-44fa-b811-83c4d747c0e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:09.280369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea1364-7139-44fa-b811-83c4d747c0e2 service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:09.285196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94409be-6e65-4fcc-93bb-cc470cbabab1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e05695f0d91463bae1f2a67a58cb54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:09.285823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94409be-6e65-4fcc-93bb-cc470cbabab1 service placement] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:09.286100 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94409be-6e65-4fcc-93bb-cc470cbabab1 service placement] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:09.286375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94409be-6e65-4fcc-93bb-cc470cbabab1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:09.288108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c94409be-6e65-4fcc-93bb-cc470cbabab1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:09.299330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94409be-6e65-4fcc-93bb-cc470cbabab1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:09.300879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94409be-6e65-4fcc-93bb-cc470cbabab1 service placement] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:09.310807 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1119/2219] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:09 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:26.482788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea85741-62c1-4c08-b07a-58ce92f1f45a None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:26.483324 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea85741-62c1-4c08-b07a-58ce92f1f45a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:26.483420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea85741-62c1-4c08-b07a-58ce92f1f45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:26.500928 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-bea85741-62c1-4c08-b07a-58ce92f1f45a None None] MFA Rules not processed for user `a52a2c8071134b07bdc222088246a671`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:26.502117 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-bea85741-62c1-4c08-b07a-58ce92f1f45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:26.508966 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1101/2220] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:26 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:36.049130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94409be-6e65-4fcc-93bb-cc470cbabab1 service placement] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:36.050732 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c94409be-6e65-4fcc-93bb-cc470cbabab1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:36.064484 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94409be-6e65-4fcc-93bb-cc470cbabab1 service placement] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:36.069442 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398cbdd-8e09-40a2-b500-ebece8d2e0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:36.070580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398cbdd-8e09-40a2-b500-ebece8d2e0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:36.071120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398cbdd-8e09-40a2-b500-ebece8d2e0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:36.071382 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398cbdd-8e09-40a2-b500-ebece8d2e0bd admin admin] PATH_INFO: `/v3/users/df94523ab7c545f2a17a2cafe936d2ed` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:36.072654 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398cbdd-8e09-40a2-b500-ebece8d2e0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=df94523ab7c545f2a17a2cafe936d2ed)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:36.075163 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398cbdd-8e09-40a2-b500-ebece8d2e0bd admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:36.126094 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b398cbdd-8e09-40a2-b500-ebece8d2e0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df94523ab7c545f2a17a2cafe936d2ed'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:36.139946 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b398cbdd-8e09-40a2-b500-ebece8d2e0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df94523ab7c545f2a17a2cafe936d2ed'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:36.147484 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b398cbdd-8e09-40a2-b500-ebece8d2e0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df94523ab7c545f2a17a2cafe936d2ed'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:36.155227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b398cbdd-8e09-40a2-b500-ebece8d2e0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df94523ab7c545f2a17a2cafe936d2ed'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:36.155876 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b398cbdd-8e09-40a2-b500-ebece8d2e0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df94523ab7c545f2a17a2cafe936d2ed'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:36.161791 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1120/2221] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:34:36 2021] DELETE /identity/v3/users/df94523ab7c545f2a17a2cafe936d2ed => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:36.338631 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea85741-62c1-4c08-b07a-58ce92f1f45a None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:36.349401 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea85741-62c1-4c08-b07a-58ce92f1f45a None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:36.408938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1e54c-5207-4391-8914-95fb58cffddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:36.409897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1e54c-5207-4391-8914-95fb58cffddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:36.410168 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1e54c-5207-4391-8914-95fb58cffddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:36.410568 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1e54c-5207-4391-8914-95fb58cffddd admin admin] PATH_INFO: `/v3/projects/18c80dfcc63a49f7b54f89f08cd8842f` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:36.411937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1e54c-5207-4391-8914-95fb58cffddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c80dfcc63a49f7b54f89f08cd8842f)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:36.414727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1e54c-5207-4391-8914-95fb58cffddd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:36.508021 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-02d1e54c-5207-4391-8914-95fb58cffddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c80dfcc63a49f7b54f89f08cd8842f', 'request_id': 'req-02d1e54c-5207-4391-8914-95fb58cffddd'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:36.519002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-02d1e54c-5207-4391-8914-95fb58cffddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c80dfcc63a49f7b54f89f08cd8842f', 'request_id': 'req-02d1e54c-5207-4391-8914-95fb58cffddd'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:36.527074 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-02d1e54c-5207-4391-8914-95fb58cffddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c80dfcc63a49f7b54f89f08cd8842f', 'request_id': 'req-02d1e54c-5207-4391-8914-95fb58cffddd'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:36.539275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-02d1e54c-5207-4391-8914-95fb58cffddd admin admin] The token cache is being invalidate because project 18c80dfcc63a49f7b54f89f08cd8842f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:34:36.539609 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-02d1e54c-5207-4391-8914-95fb58cffddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:36.540280 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-02d1e54c-5207-4391-8914-95fb58cffddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:36.542286 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1102/2222] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:34:36 2021] DELETE /identity/v3/projects/18c80dfcc63a49f7b54f89f08cd8842f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:36.549592 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b089ee-a6fb-4ede-a255-5163892c2414 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:36.550353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b089ee-a6fb-4ede-a255-5163892c2414 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:36.551840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b089ee-a6fb-4ede-a255-5163892c2414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:36.577637 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-36b089ee-a6fb-4ede-a255-5163892c2414 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:36.578903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-36b089ee-a6fb-4ede-a255-5163892c2414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:36.647465 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1121/2223] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:36.655472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93efc-13f5-4c4d-85f0-eb79ff392f5e None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:36.655768 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93efc-13f5-4c4d-85f0-eb79ff392f5e None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:36.656053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93efc-13f5-4c4d-85f0-eb79ff392f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:36.675226 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-63c93efc-13f5-4c4d-85f0-eb79ff392f5e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:36.676381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-63c93efc-13f5-4c4d-85f0-eb79ff392f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:36.685269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1103/2224] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:36.689495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b089ee-a6fb-4ede-a255-5163892c2414 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:36.699639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b089ee-a6fb-4ede-a255-5163892c2414 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:36.709595 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2cf80-9967-4922-8af2-7352847db8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:36.710264 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2cf80-9967-4922-8af2-7352847db8fe admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:36.710539 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2cf80-9967-4922-8af2-7352847db8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:36.710813 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2cf80-9967-4922-8af2-7352847db8fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:36.711588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2cf80-9967-4922-8af2-7352847db8fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:34:36.711894 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2cf80-9967-4922-8af2-7352847db8fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:36.713481 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2cf80-9967-4922-8af2-7352847db8fe admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:36.725217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1122/2225] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:34:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:34:36.730284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c93efc-13f5-4c4d-85f0-eb79ff392f5e None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:36.739399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c93efc-13f5-4c4d-85f0-eb79ff392f5e None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:36.744046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afafdcb-977a-4ddc-922b-039beb12ac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:36.744686 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afafdcb-977a-4ddc-922b-039beb12ac9a admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:36.744970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afafdcb-977a-4ddc-922b-039beb12ac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:36.745249 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afafdcb-977a-4ddc-922b-039beb12ac9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:36.746519 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afafdcb-977a-4ddc-922b-039beb12ac9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:36.748469 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afafdcb-977a-4ddc-922b-039beb12ac9a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:36.772707 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1104/2226] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:34:36 2021] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:36.776541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2cf80-9967-4922-8af2-7352847db8fe admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:36.786078 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2cf80-9967-4922-8af2-7352847db8fe admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:36.839310 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a51de6-9d58-4421-adfa-0bd0d150b8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:36.839967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a51de6-9d58-4421-adfa-0bd0d150b8dc admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:36.840247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a51de6-9d58-4421-adfa-0bd0d150b8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:36.840520 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a51de6-9d58-4421-adfa-0bd0d150b8dc admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:36.841250 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a51de6-9d58-4421-adfa-0bd0d150b8dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:36.843236 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a51de6-9d58-4421-adfa-0bd0d150b8dc admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:36.865224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1123/2227] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:34:36 2021] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:34:36.869458 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afafdcb-977a-4ddc-922b-039beb12ac9a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:36.880428 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afafdcb-977a-4ddc-922b-039beb12ac9a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:36.885302 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc7e96-f223-4245-be6b-ab56aa73cc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:36.886091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc7e96-f223-4245-be6b-ab56aa73cc53 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:36.886383 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc7e96-f223-4245-be6b-ab56aa73cc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:36.886660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc7e96-f223-4245-be6b-ab56aa73cc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:36.887473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc7e96-f223-4245-be6b-ab56aa73cc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:36.889734 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc7e96-f223-4245-be6b-ab56aa73cc53 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:36.901691 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1105/2228] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:36 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:34:36.905711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a51de6-9d58-4421-adfa-0bd0d150b8dc admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:36.915498 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a51de6-9d58-4421-adfa-0bd0d150b8dc admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:36.920674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4a12e-f411-4284-b8c5-a1081402b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:36.921330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4a12e-f411-4284-b8c5-a1081402b754 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:36.921620 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4a12e-f411-4284-b8c5-a1081402b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:36.921899 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4a12e-f411-4284-b8c5-a1081402b754 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:36.922637 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4a12e-f411-4284-b8c5-a1081402b754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:36.924267 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4a12e-f411-4284-b8c5-a1081402b754 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:36.934998 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1124/2229] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:36.939287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc7e96-f223-4245-be6b-ab56aa73cc53 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:36.949374 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc7e96-f223-4245-be6b-ab56aa73cc53 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:36.954073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80784d-2344-44aa-a9ce-ba66611560db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:36.955054 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80784d-2344-44aa-a9ce-ba66611560db admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:36.955408 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80784d-2344-44aa-a9ce-ba66611560db admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:36.955752 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80784d-2344-44aa-a9ce-ba66611560db admin admin] PATH_INFO: `/v3/projects/dc28dba849a1477f97a7ec02729047b3/users/88ddbb0ed82c4e61b50a6f7774ceada7/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:36.969971 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80784d-2344-44aa-a9ce-ba66611560db admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc28dba849a1477f97a7ec02729047b3, user_id=88ddbb0ed82c4e61b50a6f7774ceada7, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:36.973240 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80784d-2344-44aa-a9ce-ba66611560db admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:36.987311 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1106/2230] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:36 2021] PUT /identity/v3/projects/dc28dba849a1477f97a7ec02729047b3/users/88ddbb0ed82c4e61b50a6f7774ceada7/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:34:36.999058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aa6a6-9406-4236-aa7e-003f6ee48111 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:36.999349 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aa6a6-9406-4236-aa7e-003f6ee48111 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:36.999652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aa6a6-9406-4236-aa7e-003f6ee48111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:37.027916 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b48aa6a6-9406-4236-aa7e-003f6ee48111 None None] MFA Rules not processed for user `88ddbb0ed82c4e61b50a6f7774ceada7`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:37.032024 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b48aa6a6-9406-4236-aa7e-003f6ee48111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:37.103070 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1125/2231] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:36 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:34:37.108478 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80784d-2344-44aa-a9ce-ba66611560db admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:37.182199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80784d-2344-44aa-a9ce-ba66611560db admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:37.187199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ff3d0-fd4f-41e4-9a06-52fda91a1e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:37.187799 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff3d0-fd4f-41e4-9a06-52fda91a1e6b admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:37.188089 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff3d0-fd4f-41e4-9a06-52fda91a1e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:37.188368 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff3d0-fd4f-41e4-9a06-52fda91a1e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:37.189094 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ff3d0-fd4f-41e4-9a06-52fda91a1e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:37.191249 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ff3d0-fd4f-41e4-9a06-52fda91a1e6b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:37.233771 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1107/2232] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:34:37 2021] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:37.237836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48aa6a6-9406-4236-aa7e-003f6ee48111 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:37.250159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48aa6a6-9406-4236-aa7e-003f6ee48111 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:37.321422 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b74d-2d32-48ad-b4d1-51e53791d56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:37.322106 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b74d-2d32-48ad-b4d1-51e53791d56d admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:37.322391 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b74d-2d32-48ad-b4d1-51e53791d56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:37.322673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b74d-2d32-48ad-b4d1-51e53791d56d admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:37.323433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20b74d-2d32-48ad-b4d1-51e53791d56d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:37.325933 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20b74d-2d32-48ad-b4d1-51e53791d56d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:37.347327 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1126/2233] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:34:37 2021] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:37.351645 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ff3d0-fd4f-41e4-9a06-52fda91a1e6b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:37.362899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ff3d0-fd4f-41e4-9a06-52fda91a1e6b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:37.368134 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a537c1-be6f-4d07-b03a-ccf41a35bd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:37.368815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a537c1-be6f-4d07-b03a-ccf41a35bd7f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:37.369100 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a537c1-be6f-4d07-b03a-ccf41a35bd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:37.369381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a537c1-be6f-4d07-b03a-ccf41a35bd7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:37.370136 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a537c1-be6f-4d07-b03a-ccf41a35bd7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:37.372306 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a537c1-be6f-4d07-b03a-ccf41a35bd7f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:37.384948 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1108/2234] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:37 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:37.389896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b74d-2d32-48ad-b4d1-51e53791d56d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:37.399999 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b74d-2d32-48ad-b4d1-51e53791d56d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:37.404704 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94a382-a177-456a-939c-bec36010e727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:37.405652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94a382-a177-456a-939c-bec36010e727 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:37.405893 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94a382-a177-456a-939c-bec36010e727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:37.406403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94a382-a177-456a-939c-bec36010e727 admin admin] PATH_INFO: `/v3/projects/ae1654370ad144149903c6a952bf7ddc/users/526e2bbdec5349d49d5f5182d16d48bb/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:37.423545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94a382-a177-456a-939c-bec36010e727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1654370ad144149903c6a952bf7ddc, user_id=526e2bbdec5349d49d5f5182d16d48bb, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:37.426178 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94a382-a177-456a-939c-bec36010e727 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:37.442153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1127/2235] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:37 2021] PUT /identity/v3/projects/ae1654370ad144149903c6a952bf7ddc/users/526e2bbdec5349d49d5f5182d16d48bb/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:37.446607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a537c1-be6f-4d07-b03a-ccf41a35bd7f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:37.456964 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a537c1-be6f-4d07-b03a-ccf41a35bd7f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:37.516248 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe8f24-a335-482f-a8ca-e44d54b2e734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:37.516950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe8f24-a335-482f-a8ca-e44d54b2e734 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:37.517231 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe8f24-a335-482f-a8ca-e44d54b2e734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:37.517504 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe8f24-a335-482f-a8ca-e44d54b2e734 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:37.518317 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe8f24-a335-482f-a8ca-e44d54b2e734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:37.520119 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe8f24-a335-482f-a8ca-e44d54b2e734 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:37.534079 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1109/2236] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:37 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:37.535961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94a382-a177-456a-939c-bec36010e727 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:37.547290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94a382-a177-456a-939c-bec36010e727 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:37.560071 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da62c3-4f5d-4ce3-aa74-287f1da5d48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:37.561095 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da62c3-4f5d-4ce3-aa74-287f1da5d48c admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:37.561446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da62c3-4f5d-4ce3-aa74-287f1da5d48c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:37.561850 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da62c3-4f5d-4ce3-aa74-287f1da5d48c admin admin] PATH_INFO: `/v3/projects/ae1654370ad144149903c6a952bf7ddc/users/526e2bbdec5349d49d5f5182d16d48bb/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:37.563966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da62c3-4f5d-4ce3-aa74-287f1da5d48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1654370ad144149903c6a952bf7ddc, user_id=526e2bbdec5349d49d5f5182d16d48bb, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:37.566650 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da62c3-4f5d-4ce3-aa74-287f1da5d48c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:37.578242 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1128/2237] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:37 2021] PUT /identity/v3/projects/ae1654370ad144149903c6a952bf7ddc/users/526e2bbdec5349d49d5f5182d16d48bb/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:37.588460 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f744393-72ba-4eae-9152-d7a3aeb94fa0 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:37.588812 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f744393-72ba-4eae-9152-d7a3aeb94fa0 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:37.589114 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f744393-72ba-4eae-9152-d7a3aeb94fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:37.615207 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-9f744393-72ba-4eae-9152-d7a3aeb94fa0 None None] MFA Rules not processed for user `526e2bbdec5349d49d5f5182d16d48bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:37.616481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9f744393-72ba-4eae-9152-d7a3aeb94fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:37.696413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1110/2238] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:37 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:37.701923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da62c3-4f5d-4ce3-aa74-287f1da5d48c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:37.762623 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da62c3-4f5d-4ce3-aa74-287f1da5d48c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:37.767676 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc076c0f-ce52-4f60-8ef9-836c09439fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:37.768536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc076c0f-ce52-4f60-8ef9-836c09439fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:37.768820 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc076c0f-ce52-4f60-8ef9-836c09439fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:37.769096 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc076c0f-ce52-4f60-8ef9-836c09439fb4 admin admin] PATH_INFO: `/v3/users/88ddbb0ed82c4e61b50a6f7774ceada7` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:37.770294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc076c0f-ce52-4f60-8ef9-836c09439fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ddbb0ed82c4e61b50a6f7774ceada7)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:37.772213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc076c0f-ce52-4f60-8ef9-836c09439fb4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:37.820406 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bc076c0f-ce52-4f60-8ef9-836c09439fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ddbb0ed82c4e61b50a6f7774ceada7'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:37.831489 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bc076c0f-ce52-4f60-8ef9-836c09439fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ddbb0ed82c4e61b50a6f7774ceada7'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:37.838696 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bc076c0f-ce52-4f60-8ef9-836c09439fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ddbb0ed82c4e61b50a6f7774ceada7'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:37.846096 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bc076c0f-ce52-4f60-8ef9-836c09439fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ddbb0ed82c4e61b50a6f7774ceada7'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:37.846746 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bc076c0f-ce52-4f60-8ef9-836c09439fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ddbb0ed82c4e61b50a6f7774ceada7'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:37.852822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1129/2239] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:34:37 2021] DELETE /identity/v3/users/88ddbb0ed82c4e61b50a6f7774ceada7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:37.858815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b38c8-0296-4bb9-91b5-d86fa67cd0d6 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:37.859165 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b38c8-0296-4bb9-91b5-d86fa67cd0d6 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:37.859417 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b38c8-0296-4bb9-91b5-d86fa67cd0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:37.876684 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-035b38c8-0296-4bb9-91b5-d86fa67cd0d6 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:37.877872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-035b38c8-0296-4bb9-91b5-d86fa67cd0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:37.934620 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1111/2240] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:37.944308 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc076c0f-ce52-4f60-8ef9-836c09439fb4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:37.945886 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-bc076c0f-ce52-4f60-8ef9-836c09439fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:38.001582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc076c0f-ce52-4f60-8ef9-836c09439fb4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:38.005236 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa575c-d78e-4100-a96d-d600dc3e369f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:38.005881 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa575c-d78e-4100-a96d-d600dc3e369f service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:38.006170 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa575c-d78e-4100-a96d-d600dc3e369f service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:38.006450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa575c-d78e-4100-a96d-d600dc3e369f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:38.015273 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa575c-d78e-4100-a96d-d600dc3e369f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:38.016688 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa575c-d78e-4100-a96d-d600dc3e369f service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:38.025885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1130/2241] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:38.282521 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b38c8-0296-4bb9-91b5-d86fa67cd0d6 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:38.284140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-035b38c8-0296-4bb9-91b5-d86fa67cd0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:38.296538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b38c8-0296-4bb9-91b5-d86fa67cd0d6 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:38.301215 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:38.302108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:38.302390 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:38.302663 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] PATH_INFO: `/v3/projects/dc28dba849a1477f97a7ec02729047b3` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:38.304574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc28dba849a1477f97a7ec02729047b3)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:38.306507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:38.351857 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc28dba849a1477f97a7ec02729047b3', 'request_id': 'req-b1d40116-e514-434c-8291-8631cfdf8860'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:38.359653 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc28dba849a1477f97a7ec02729047b3', 'request_id': 'req-b1d40116-e514-434c-8291-8631cfdf8860'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:38.365732 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc28dba849a1477f97a7ec02729047b3', 'request_id': 'req-b1d40116-e514-434c-8291-8631cfdf8860'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:38.377305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] The token cache is being invalidate because project dc28dba849a1477f97a7ec02729047b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:34:38.377638 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:38.378250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:38.379780 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1112/2242] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:34:38 2021] DELETE /identity/v3/projects/dc28dba849a1477f97a7ec02729047b3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:38.383733 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa575c-d78e-4100-a96d-d600dc3e369f service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:38.393739 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa575c-d78e-4100-a96d-d600dc3e369f service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:38.448350 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb09c7-45e5-4356-a202-02ca8dfc1c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:38.449747 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb09c7-45e5-4356-a202-02ca8dfc1c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:38.450033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb09c7-45e5-4356-a202-02ca8dfc1c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:38.450309 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb09c7-45e5-4356-a202-02ca8dfc1c6b admin admin] PATH_INFO: `/v3/users/526e2bbdec5349d49d5f5182d16d48bb` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:38.451493 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb09c7-45e5-4356-a202-02ca8dfc1c6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=526e2bbdec5349d49d5f5182d16d48bb)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:38.453420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb09c7-45e5-4356-a202-02ca8dfc1c6b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:38.497780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-98eb09c7-45e5-4356-a202-02ca8dfc1c6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526e2bbdec5349d49d5f5182d16d48bb'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:38.509513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-98eb09c7-45e5-4356-a202-02ca8dfc1c6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526e2bbdec5349d49d5f5182d16d48bb'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:38.517058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-98eb09c7-45e5-4356-a202-02ca8dfc1c6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526e2bbdec5349d49d5f5182d16d48bb'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:38.523778 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-98eb09c7-45e5-4356-a202-02ca8dfc1c6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526e2bbdec5349d49d5f5182d16d48bb'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:38.524396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-98eb09c7-45e5-4356-a202-02ca8dfc1c6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526e2bbdec5349d49d5f5182d16d48bb'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:38.530642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1131/2243] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:34:38 2021] DELETE /identity/v3/users/526e2bbdec5349d49d5f5182d16d48bb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:38.976113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:38.977618 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:39.009144 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d40116-e514-434c-8291-8631cfdf8860 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:39.067929 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:39.068785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:39.069063 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:39.069350 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d admin admin] PATH_INFO: `/v3/projects/ae1654370ad144149903c6a952bf7ddc` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:39.071060 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae1654370ad144149903c6a952bf7ddc)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:39.073017 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:39.119244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae1654370ad144149903c6a952bf7ddc', 'request_id': 'req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:39.127128 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae1654370ad144149903c6a952bf7ddc', 'request_id': 'req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:39.132507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae1654370ad144149903c6a952bf7ddc', 'request_id': 'req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:39.143951 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d admin admin] The token cache is being invalidate because project ae1654370ad144149903c6a952bf7ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:34:39.144260 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:39.144893 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a74d0f41-898b-41d3-86fd-d8440d9c5b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:39.146441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1113/2244] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:34:38 2021] DELETE /identity/v3/projects/ae1654370ad144149903c6a952bf7ddc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:34:39.152150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b441-1f4a-4512-9c3e-95ed76d205f2 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:39.152438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b441-1f4a-4512-9c3e-95ed76d205f2 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:39.152717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b441-1f4a-4512-9c3e-95ed76d205f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:39.173375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-9731b441-1f4a-4512-9c3e-95ed76d205f2 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:39.175738 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9731b441-1f4a-4512-9c3e-95ed76d205f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:39.235814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1132/2245] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:39.243926 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec8f2b-98cc-4feb-a26d-0198472080e2 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:39.244216 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec8f2b-98cc-4feb-a26d-0198472080e2 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:39.244522 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec8f2b-98cc-4feb-a26d-0198472080e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:39.263557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-daec8f2b-98cc-4feb-a26d-0198472080e2 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:39.264751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-daec8f2b-98cc-4feb-a26d-0198472080e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:39.274776 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1114/2246] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:39.278247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b441-1f4a-4512-9c3e-95ed76d205f2 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:39.288178 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b441-1f4a-4512-9c3e-95ed76d205f2 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:39.293340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c403a8-e0f7-4a80-a2b7-fc98bba6a96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:39.294021 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c403a8-e0f7-4a80-a2b7-fc98bba6a96f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:39.294302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c403a8-e0f7-4a80-a2b7-fc98bba6a96f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:39.294574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c403a8-e0f7-4a80-a2b7-fc98bba6a96f admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:39.295340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c403a8-e0f7-4a80-a2b7-fc98bba6a96f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:34:39.295652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c403a8-e0f7-4a80-a2b7-fc98bba6a96f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:39.297271 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c403a8-e0f7-4a80-a2b7-fc98bba6a96f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:39.309354 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1133/2247] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:34:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:34:39.313641 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec8f2b-98cc-4feb-a26d-0198472080e2 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:39.327657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec8f2b-98cc-4feb-a26d-0198472080e2 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:39.333737 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0adbf-946b-4a15-ba4a-e73bea4729be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:39.333737 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0adbf-946b-4a15-ba4a-e73bea4729be admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:39.333737 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0adbf-946b-4a15-ba4a-e73bea4729be admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:39.333737 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0adbf-946b-4a15-ba4a-e73bea4729be admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:39.334460 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0adbf-946b-4a15-ba4a-e73bea4729be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:39.336425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0adbf-946b-4a15-ba4a-e73bea4729be admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:39.365735 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1115/2248] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:34:39 2021] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:34:39.368230 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c403a8-e0f7-4a80-a2b7-fc98bba6a96f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:39.378050 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c403a8-e0f7-4a80-a2b7-fc98bba6a96f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:39.434546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8955b0f-ce06-47e0-b0ed-3acacb30e955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:39.435336 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955b0f-ce06-47e0-b0ed-3acacb30e955 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:39.435588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955b0f-ce06-47e0-b0ed-3acacb30e955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:39.435865 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955b0f-ce06-47e0-b0ed-3acacb30e955 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:39.436586 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8955b0f-ce06-47e0-b0ed-3acacb30e955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:39.438490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8955b0f-ce06-47e0-b0ed-3acacb30e955 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:39.458170 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1134/2249] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:34:39 2021] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:34:39.462555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0adbf-946b-4a15-ba4a-e73bea4729be admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:39.473725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0adbf-946b-4a15-ba4a-e73bea4729be admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:39.478231 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25b7a5-074c-4d9f-8286-168d3b07fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:39.478905 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25b7a5-074c-4d9f-8286-168d3b07fd6f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:39.479187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25b7a5-074c-4d9f-8286-168d3b07fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:39.479459 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25b7a5-074c-4d9f-8286-168d3b07fd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:39.480853 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25b7a5-074c-4d9f-8286-168d3b07fd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:39.482796 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25b7a5-074c-4d9f-8286-168d3b07fd6f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:39.493236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1116/2250] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:39 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:34:39.497461 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8955b0f-ce06-47e0-b0ed-3acacb30e955 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:39.507860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8955b0f-ce06-47e0-b0ed-3acacb30e955 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:39.512670 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1adc7-cb2c-4caf-8aad-6ddb9d46693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:39.513344 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1adc7-cb2c-4caf-8aad-6ddb9d46693f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:39.513632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1adc7-cb2c-4caf-8aad-6ddb9d46693f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:39.513913 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1adc7-cb2c-4caf-8aad-6ddb9d46693f admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:39.514664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1adc7-cb2c-4caf-8aad-6ddb9d46693f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:39.516634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1adc7-cb2c-4caf-8aad-6ddb9d46693f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:39.530295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1135/2251] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:39 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:34:39.531497 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25b7a5-074c-4d9f-8286-168d3b07fd6f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:39.544745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25b7a5-074c-4d9f-8286-168d3b07fd6f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:39.549396 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a784a8-0b79-4d4d-910a-402cab2d55c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:39.550276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a784a8-0b79-4d4d-910a-402cab2d55c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:39.550556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a784a8-0b79-4d4d-910a-402cab2d55c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:39.550828 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a784a8-0b79-4d4d-910a-402cab2d55c2 admin admin] PATH_INFO: `/v3/projects/b50d5a6a80ba41288a25cb30959ee151/users/0d8ca44bd4544e2385dec24dc05a3bd4/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:39.566020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a784a8-0b79-4d4d-910a-402cab2d55c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50d5a6a80ba41288a25cb30959ee151, user_id=0d8ca44bd4544e2385dec24dc05a3bd4, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:39.568703 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a784a8-0b79-4d4d-910a-402cab2d55c2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:39.585265 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1117/2252] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:39 2021] PUT /identity/v3/projects/b50d5a6a80ba41288a25cb30959ee151/users/0d8ca44bd4544e2385dec24dc05a3bd4/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:39.596898 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6a67-3d06-4019-9986-abd6e03d8ba8 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:39.597192 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6a67-3d06-4019-9986-abd6e03d8ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:39.597594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6a67-3d06-4019-9986-abd6e03d8ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:39.633803 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-d01f6a67-3d06-4019-9986-abd6e03d8ba8 None None] MFA Rules not processed for user `0d8ca44bd4544e2385dec24dc05a3bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:39.636289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d01f6a67-3d06-4019-9986-abd6e03d8ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:39.718557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1136/2253] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:39 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:39.723030 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a784a8-0b79-4d4d-910a-402cab2d55c2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:39.786244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a784a8-0b79-4d4d-910a-402cab2d55c2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:39.791256 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0284e-993b-45ca-9685-313997ceddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:39.791968 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0284e-993b-45ca-9685-313997ceddbb admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:39.792275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0284e-993b-45ca-9685-313997ceddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:39.792553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0284e-993b-45ca-9685-313997ceddbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:39.793258 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0284e-993b-45ca-9685-313997ceddbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:39.795210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0284e-993b-45ca-9685-313997ceddbb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:39.824520 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1118/2254] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:34:39 2021] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:39.825605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f6a67-3d06-4019-9986-abd6e03d8ba8 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:39.836186 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f6a67-3d06-4019-9986-abd6e03d8ba8 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:39.892022 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991597b-4d80-49e3-8c52-afbf911bbf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:39.892683 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991597b-4d80-49e3-8c52-afbf911bbf58 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:39.892966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991597b-4d80-49e3-8c52-afbf911bbf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:39.893241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991597b-4d80-49e3-8c52-afbf911bbf58 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:39.893943 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991597b-4d80-49e3-8c52-afbf911bbf58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:39.895882 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991597b-4d80-49e3-8c52-afbf911bbf58 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:39.915207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1137/2255] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:34:39 2021] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:34:39.919309 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0284e-993b-45ca-9685-313997ceddbb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:39.929205 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0284e-993b-45ca-9685-313997ceddbb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:39.933750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f1c41-c65f-42bb-9954-9009431a8348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:39.934389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1c41-c65f-42bb-9954-9009431a8348 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:39.934713 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1c41-c65f-42bb-9954-9009431a8348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:39.935030 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1c41-c65f-42bb-9954-9009431a8348 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:39.935773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f1c41-c65f-42bb-9954-9009431a8348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:39.937380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f1c41-c65f-42bb-9954-9009431a8348 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:39.947330 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1119/2256] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:39 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:39.951836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991597b-4d80-49e3-8c52-afbf911bbf58 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:39.961399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991597b-4d80-49e3-8c52-afbf911bbf58 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:39.966594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cbbca-8fa8-4d23-ba45-fb3645db4190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:39.967511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cbbca-8fa8-4d23-ba45-fb3645db4190 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:39.967796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cbbca-8fa8-4d23-ba45-fb3645db4190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:39.968076 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cbbca-8fa8-4d23-ba45-fb3645db4190 admin admin] PATH_INFO: `/v3/projects/d595c377eff84d5caa94dedc4170713e/users/777fe30cb707401db6061144ac9ef1c0/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:39.983281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cbbca-8fa8-4d23-ba45-fb3645db4190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d595c377eff84d5caa94dedc4170713e, user_id=777fe30cb707401db6061144ac9ef1c0, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:39.985923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cbbca-8fa8-4d23-ba45-fb3645db4190 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:39.998672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1138/2257] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:39 2021] PUT /identity/v3/projects/d595c377eff84d5caa94dedc4170713e/users/777fe30cb707401db6061144ac9ef1c0/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:34:40.003920 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f1c41-c65f-42bb-9954-9009431a8348 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:40.013713 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f1c41-c65f-42bb-9954-9009431a8348 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:40.071436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e84c17-4f46-406f-871b-78d7d60a7a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:40.072104 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e84c17-4f46-406f-871b-78d7d60a7a71 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:40.072384 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e84c17-4f46-406f-871b-78d7d60a7a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:40.072657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e84c17-4f46-406f-871b-78d7d60a7a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:40.073453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e84c17-4f46-406f-871b-78d7d60a7a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:40.075635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e84c17-4f46-406f-871b-78d7d60a7a71 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:40.085559 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1120/2258] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:40 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:40.089846 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cbbca-8fa8-4d23-ba45-fb3645db4190 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:40.100000 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cbbca-8fa8-4d23-ba45-fb3645db4190 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:40.105142 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2754b-cce9-4edb-94f2-58d53deb9087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:40.106014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2754b-cce9-4edb-94f2-58d53deb9087 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:40.106294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2754b-cce9-4edb-94f2-58d53deb9087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:40.106570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2754b-cce9-4edb-94f2-58d53deb9087 admin admin] PATH_INFO: `/v3/projects/d595c377eff84d5caa94dedc4170713e/users/777fe30cb707401db6061144ac9ef1c0/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:40.108562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2754b-cce9-4edb-94f2-58d53deb9087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d595c377eff84d5caa94dedc4170713e, user_id=777fe30cb707401db6061144ac9ef1c0, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:40.111224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2754b-cce9-4edb-94f2-58d53deb9087 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:40.122213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1139/2259] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:40 2021] PUT /identity/v3/projects/d595c377eff84d5caa94dedc4170713e/users/777fe30cb707401db6061144ac9ef1c0/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:34:40.132494 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553ba05-7e3c-4087-9662-8c26c3ce804d None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:40.132906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553ba05-7e3c-4087-9662-8c26c3ce804d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:40.133246 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553ba05-7e3c-4087-9662-8c26c3ce804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:40.159326 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-9553ba05-7e3c-4087-9662-8c26c3ce804d None None] MFA Rules not processed for user `777fe30cb707401db6061144ac9ef1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:40.160534 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9553ba05-7e3c-4087-9662-8c26c3ce804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:40.237380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1121/2260] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:40 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:40.248132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2754b-cce9-4edb-94f2-58d53deb9087 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:40.249790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-38b2754b-cce9-4edb-94f2-58d53deb9087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:40.327052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2754b-cce9-4edb-94f2-58d53deb9087 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:40.330584 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5150e4c-1fbb-4bf9-ad68-8be687667ecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:40.331265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150e4c-1fbb-4bf9-ad68-8be687667ecc service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:40.331547 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150e4c-1fbb-4bf9-ad68-8be687667ecc service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:40.331821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150e4c-1fbb-4bf9-ad68-8be687667ecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:40.340666 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5150e4c-1fbb-4bf9-ad68-8be687667ecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:40.342114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5150e4c-1fbb-4bf9-ad68-8be687667ecc service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:40.351386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1140/2261] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:40 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:40.421183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553ba05-7e3c-4087-9662-8c26c3ce804d None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:40.430463 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553ba05-7e3c-4087-9662-8c26c3ce804d None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:40.434678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a179404-0393-44ea-aa3b-ba692b0a1f47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:40.435462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a179404-0393-44ea-aa3b-ba692b0a1f47 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:40.435748 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a179404-0393-44ea-aa3b-ba692b0a1f47 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:40.436023 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a179404-0393-44ea-aa3b-ba692b0a1f47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:40.491989 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a179404-0393-44ea-aa3b-ba692b0a1f47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:40.493423 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a179404-0393-44ea-aa3b-ba692b0a1f47 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:40.502218 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1122/2262] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:40 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:43.220577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5150e4c-1fbb-4bf9-ad68-8be687667ecc service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:43.289042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5150e4c-1fbb-4bf9-ad68-8be687667ecc service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:43.294337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd4337-9ddd-4d59-81d5-0ff4b8990299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:43.295238 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd4337-9ddd-4d59-81d5-0ff4b8990299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:43.295521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd4337-9ddd-4d59-81d5-0ff4b8990299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:43.295795 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd4337-9ddd-4d59-81d5-0ff4b8990299 admin admin] PATH_INFO: `/v3/users/0d8ca44bd4544e2385dec24dc05a3bd4` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:43.297572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd4337-9ddd-4d59-81d5-0ff4b8990299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8ca44bd4544e2385dec24dc05a3bd4)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:43.299522 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd4337-9ddd-4d59-81d5-0ff4b8990299 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:43.348578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-74fd4337-9ddd-4d59-81d5-0ff4b8990299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8ca44bd4544e2385dec24dc05a3bd4'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:43.364153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-74fd4337-9ddd-4d59-81d5-0ff4b8990299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8ca44bd4544e2385dec24dc05a3bd4'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:43.376397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-74fd4337-9ddd-4d59-81d5-0ff4b8990299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8ca44bd4544e2385dec24dc05a3bd4'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:43.383711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-74fd4337-9ddd-4d59-81d5-0ff4b8990299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8ca44bd4544e2385dec24dc05a3bd4'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:43.384392 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-74fd4337-9ddd-4d59-81d5-0ff4b8990299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8ca44bd4544e2385dec24dc05a3bd4'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:43.397176 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1141/2263] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:34:43 2021] DELETE /identity/v3/users/0d8ca44bd4544e2385dec24dc05a3bd4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:34:43.397292 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4913a3-c348-4f2e-810f-e1dd0f6ae591 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:43.397292 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4913a3-c348-4f2e-810f-e1dd0f6ae591 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:43.397292 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4913a3-c348-4f2e-810f-e1dd0f6ae591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:43.413562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-5a4913a3-c348-4f2e-810f-e1dd0f6ae591 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:43.414831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5a4913a3-c348-4f2e-810f-e1dd0f6ae591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:43.477397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1123/2264] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:43.487389 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd4337-9ddd-4d59-81d5-0ff4b8990299 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:43.489038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-74fd4337-9ddd-4d59-81d5-0ff4b8990299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:43.550670 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd4337-9ddd-4d59-81d5-0ff4b8990299 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:43.554335 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4876530-315c-4727-b351-c48f00debeb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:43.555014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4876530-315c-4727-b351-c48f00debeb6 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:43.555299 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4876530-315c-4727-b351-c48f00debeb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:43.555577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4876530-315c-4727-b351-c48f00debeb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:43.565222 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4876530-315c-4727-b351-c48f00debeb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:43.566687 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4876530-315c-4727-b351-c48f00debeb6 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:43.578521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1142/2265] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:44.075186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4913a3-c348-4f2e-810f-e1dd0f6ae591 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:44.076668 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5a4913a3-c348-4f2e-810f-e1dd0f6ae591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:44.092634 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4913a3-c348-4f2e-810f-e1dd0f6ae591 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:44.097665 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:44.098777 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:44.099106 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:44.099388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] PATH_INFO: `/v3/projects/b50d5a6a80ba41288a25cb30959ee151` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:44.100758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50d5a6a80ba41288a25cb30959ee151)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:44.102970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:44.155481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50d5a6a80ba41288a25cb30959ee151', 'request_id': 'req-6ac06461-8045-46bb-8e5a-8dfd6b3be810'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.162953 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50d5a6a80ba41288a25cb30959ee151', 'request_id': 'req-6ac06461-8045-46bb-8e5a-8dfd6b3be810'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.169708 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50d5a6a80ba41288a25cb30959ee151', 'request_id': 'req-6ac06461-8045-46bb-8e5a-8dfd6b3be810'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.181314 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] The token cache is being invalidate because project b50d5a6a80ba41288a25cb30959ee151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:34:44.181726 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.182469 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.184629 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1124/2266] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:34:44 2021] DELETE /identity/v3/projects/b50d5a6a80ba41288a25cb30959ee151 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:44.188601 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4876530-315c-4727-b351-c48f00debeb6 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:44.198403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4876530-315c-4727-b351-c48f00debeb6 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:44.251642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f025126-165f-4ae1-9f63-d6d72b9fa123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:44.252494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f025126-165f-4ae1-9f63-d6d72b9fa123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:44.252778 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f025126-165f-4ae1-9f63-d6d72b9fa123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:44.253053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f025126-165f-4ae1-9f63-d6d72b9fa123 admin admin] PATH_INFO: `/v3/users/777fe30cb707401db6061144ac9ef1c0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:44.254245 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f025126-165f-4ae1-9f63-d6d72b9fa123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777fe30cb707401db6061144ac9ef1c0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:44.256191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f025126-165f-4ae1-9f63-d6d72b9fa123 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:44.299739 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5f025126-165f-4ae1-9f63-d6d72b9fa123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777fe30cb707401db6061144ac9ef1c0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.311566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5f025126-165f-4ae1-9f63-d6d72b9fa123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777fe30cb707401db6061144ac9ef1c0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.318329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5f025126-165f-4ae1-9f63-d6d72b9fa123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777fe30cb707401db6061144ac9ef1c0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.325154 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5f025126-165f-4ae1-9f63-d6d72b9fa123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777fe30cb707401db6061144ac9ef1c0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.325783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5f025126-165f-4ae1-9f63-d6d72b9fa123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777fe30cb707401db6061144ac9ef1c0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.331471 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1143/2267] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:34:44 2021] DELETE /identity/v3/users/777fe30cb707401db6061144ac9ef1c0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:44.627967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:44.629462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:44.642143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac06461-8045-46bb-8e5a-8dfd6b3be810 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:44.698946 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806843a-f873-42f0-af4c-ad4d3d3229e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:44.699806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806843a-f873-42f0-af4c-ad4d3d3229e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:44.700090 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806843a-f873-42f0-af4c-ad4d3d3229e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:44.700368 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806843a-f873-42f0-af4c-ad4d3d3229e2 admin admin] PATH_INFO: `/v3/projects/d595c377eff84d5caa94dedc4170713e` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:44.701561 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806843a-f873-42f0-af4c-ad4d3d3229e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d595c377eff84d5caa94dedc4170713e)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:44.703524 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806843a-f873-42f0-af4c-ad4d3d3229e2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:44.747392 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0806843a-f873-42f0-af4c-ad4d3d3229e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd595c377eff84d5caa94dedc4170713e', 'request_id': 'req-0806843a-f873-42f0-af4c-ad4d3d3229e2'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.754399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0806843a-f873-42f0-af4c-ad4d3d3229e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd595c377eff84d5caa94dedc4170713e', 'request_id': 'req-0806843a-f873-42f0-af4c-ad4d3d3229e2'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.759700 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0806843a-f873-42f0-af4c-ad4d3d3229e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd595c377eff84d5caa94dedc4170713e', 'request_id': 'req-0806843a-f873-42f0-af4c-ad4d3d3229e2'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.770092 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0806843a-f873-42f0-af4c-ad4d3d3229e2 admin admin] The token cache is being invalidate because project d595c377eff84d5caa94dedc4170713e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:34:44.770368 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0806843a-f873-42f0-af4c-ad4d3d3229e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.771008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0806843a-f873-42f0-af4c-ad4d3d3229e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:44.772510 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1125/2268] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:34:44 2021] DELETE /identity/v3/projects/d595c377eff84d5caa94dedc4170713e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:34:44.778768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb01a9-b0e9-4cf5-8f46-902d36498165 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:44.779483 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb01a9-b0e9-4cf5-8f46-902d36498165 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:44.779767 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb01a9-b0e9-4cf5-8f46-902d36498165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:44.797904 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-23cb01a9-b0e9-4cf5-8f46-902d36498165 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:44.799116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-23cb01a9-b0e9-4cf5-8f46-902d36498165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:44.855385 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1144/2269] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:44.864304 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c173e-ff08-4be6-aed7-b76aefa18bd4 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:44.864591 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c173e-ff08-4be6-aed7-b76aefa18bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:44.864872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c173e-ff08-4be6-aed7-b76aefa18bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:44.882597 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-477c173e-ff08-4be6-aed7-b76aefa18bd4 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:44.883824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-477c173e-ff08-4be6-aed7-b76aefa18bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:44.891538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1126/2270] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:44.895526 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb01a9-b0e9-4cf5-8f46-902d36498165 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:44.905568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb01a9-b0e9-4cf5-8f46-902d36498165 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:44.913227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280105c9-ba3b-43fa-b264-a3393c132f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:44.913892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280105c9-ba3b-43fa-b264-a3393c132f73 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:44.914174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280105c9-ba3b-43fa-b264-a3393c132f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:44.914457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280105c9-ba3b-43fa-b264-a3393c132f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:44.915324 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280105c9-ba3b-43fa-b264-a3393c132f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:34:44.915641 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280105c9-ba3b-43fa-b264-a3393c132f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:44.917913 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280105c9-ba3b-43fa-b264-a3393c132f73 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:44.930261 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1145/2271] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:34:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:34:44.934555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c173e-ff08-4be6-aed7-b76aefa18bd4 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:44.943624 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c173e-ff08-4be6-aed7-b76aefa18bd4 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:44.948981 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cde13-29dc-4add-afbf-592ce64f56d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:44.949625 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cde13-29dc-4add-afbf-592ce64f56d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:44.949906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cde13-29dc-4add-afbf-592ce64f56d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:44.950186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cde13-29dc-4add-afbf-592ce64f56d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:44.950940 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cde13-29dc-4add-afbf-592ce64f56d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:44.952837 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cde13-29dc-4add-afbf-592ce64f56d5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:44.982836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1127/2272] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:34:44 2021] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:44.986869 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280105c9-ba3b-43fa-b264-a3393c132f73 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:44.996527 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280105c9-ba3b-43fa-b264-a3393c132f73 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:45.052452 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea2332-ccb2-4f83-95e4-66205b943ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:45.053210 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea2332-ccb2-4f83-95e4-66205b943ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.053563 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea2332-ccb2-4f83-95e4-66205b943ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.053908 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea2332-ccb2-4f83-95e4-66205b943ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.054758 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea2332-ccb2-4f83-95e4-66205b943ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:45.056962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea2332-ccb2-4f83-95e4-66205b943ad4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:45.082048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1146/2273] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:34:44 2021] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:34:45.083426 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cde13-29dc-4add-afbf-592ce64f56d5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:45.094475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cde13-29dc-4add-afbf-592ce64f56d5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:45.101168 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30bc62-8d2f-4d1a-9417-972fee84897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:45.102673 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30bc62-8d2f-4d1a-9417-972fee84897c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.103000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30bc62-8d2f-4d1a-9417-972fee84897c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.103283 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30bc62-8d2f-4d1a-9417-972fee84897c admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.104819 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30bc62-8d2f-4d1a-9417-972fee84897c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:45.106442 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30bc62-8d2f-4d1a-9417-972fee84897c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:45.117813 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1128/2274] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:45 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:34:45.121722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea2332-ccb2-4f83-95e4-66205b943ad4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:45.131353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea2332-ccb2-4f83-95e4-66205b943ad4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:45.136575 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbe6a5-f622-4624-974b-a2dbb20a5e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:45.137231 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbe6a5-f622-4624-974b-a2dbb20a5e4c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.137513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbe6a5-f622-4624-974b-a2dbb20a5e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.137788 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbe6a5-f622-4624-974b-a2dbb20a5e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.138522 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbe6a5-f622-4624-974b-a2dbb20a5e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:45.140151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbe6a5-f622-4624-974b-a2dbb20a5e4c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:45.150045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1147/2275] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:45 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:45.155002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30bc62-8d2f-4d1a-9417-972fee84897c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:45.164998 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30bc62-8d2f-4d1a-9417-972fee84897c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:45.170457 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349f5a9-2a8c-4635-8fd5-db7db3e33499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:45.171417 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349f5a9-2a8c-4635-8fd5-db7db3e33499 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.171699 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349f5a9-2a8c-4635-8fd5-db7db3e33499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.171973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349f5a9-2a8c-4635-8fd5-db7db3e33499 admin admin] PATH_INFO: `/v3/projects/cc22190957f74695909a1e9eac363c3c/users/9959ed1dd75a44b1bc73a74616858838/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.186519 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349f5a9-2a8c-4635-8fd5-db7db3e33499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc22190957f74695909a1e9eac363c3c, user_id=9959ed1dd75a44b1bc73a74616858838, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:45.189202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349f5a9-2a8c-4635-8fd5-db7db3e33499 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:45.205452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1129/2276] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:45 2021] PUT /identity/v3/projects/cc22190957f74695909a1e9eac363c3c/users/9959ed1dd75a44b1bc73a74616858838/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:34:45.223602 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c062a01-346a-4af0-a6fa-72060bd68a45 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.223894 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c062a01-346a-4af0-a6fa-72060bd68a45 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.224168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c062a01-346a-4af0-a6fa-72060bd68a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.250142 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-3c062a01-346a-4af0-a6fa-72060bd68a45 None None] MFA Rules not processed for user `9959ed1dd75a44b1bc73a74616858838`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:45.251354 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3c062a01-346a-4af0-a6fa-72060bd68a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:45.317371 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1148/2277] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:45 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:45.322085 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349f5a9-2a8c-4635-8fd5-db7db3e33499 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:45.382758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349f5a9-2a8c-4635-8fd5-db7db3e33499 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:45.387977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be15bfd-a862-47ae-b45a-2628b14af967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:45.388619 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be15bfd-a862-47ae-b45a-2628b14af967 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.388898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be15bfd-a862-47ae-b45a-2628b14af967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.389199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be15bfd-a862-47ae-b45a-2628b14af967 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.389899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be15bfd-a862-47ae-b45a-2628b14af967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:45.391912 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be15bfd-a862-47ae-b45a-2628b14af967 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:45.416271 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1130/2278] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:34:45 2021] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:45.420302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c062a01-346a-4af0-a6fa-72060bd68a45 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:45.430664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c062a01-346a-4af0-a6fa-72060bd68a45 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:45.484065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392dd7b-8a1d-4b30-bd07-f78ad790cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:45.484718 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392dd7b-8a1d-4b30-bd07-f78ad790cf84 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.484998 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392dd7b-8a1d-4b30-bd07-f78ad790cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.485271 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392dd7b-8a1d-4b30-bd07-f78ad790cf84 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.486018 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392dd7b-8a1d-4b30-bd07-f78ad790cf84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:45.488169 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392dd7b-8a1d-4b30-bd07-f78ad790cf84 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:45.507428 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1149/2279] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:34:45 2021] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:45.511995 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be15bfd-a862-47ae-b45a-2628b14af967 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:45.521881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be15bfd-a862-47ae-b45a-2628b14af967 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:45.526415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0004a41-ca52-4447-b48b-cb42b8d2a9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:45.527144 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0004a41-ca52-4447-b48b-cb42b8d2a9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.527430 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0004a41-ca52-4447-b48b-cb42b8d2a9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.527706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0004a41-ca52-4447-b48b-cb42b8d2a9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.528454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0004a41-ca52-4447-b48b-cb42b8d2a9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:45.530033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0004a41-ca52-4447-b48b-cb42b8d2a9c2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:45.539618 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1131/2280] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:45 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:45.543422 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392dd7b-8a1d-4b30-bd07-f78ad790cf84 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:45.552957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392dd7b-8a1d-4b30-bd07-f78ad790cf84 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:45.557409 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3d683-7f11-4738-a0d3-5228fec63a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:45.558804 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3d683-7f11-4738-a0d3-5228fec63a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.559119 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3d683-7f11-4738-a0d3-5228fec63a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.559392 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3d683-7f11-4738-a0d3-5228fec63a85 admin admin] PATH_INFO: `/v3/projects/f6b1b8943cf84235a8b83e95edc80e18/users/9726d7d14dee4bc1b11545dd7aeb8fef/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.574207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3d683-7f11-4738-a0d3-5228fec63a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b1b8943cf84235a8b83e95edc80e18, user_id=9726d7d14dee4bc1b11545dd7aeb8fef, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:45.576842 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3d683-7f11-4738-a0d3-5228fec63a85 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:45.589992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1150/2281] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:45 2021] PUT /identity/v3/projects/f6b1b8943cf84235a8b83e95edc80e18/users/9726d7d14dee4bc1b11545dd7aeb8fef/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:34:45.593744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0004a41-ca52-4447-b48b-cb42b8d2a9c2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:45.603650 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0004a41-ca52-4447-b48b-cb42b8d2a9c2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:45.660354 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1683fa-1c23-457b-b615-cbf4c7db1b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:45.661046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1683fa-1c23-457b-b615-cbf4c7db1b61 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.661288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1683fa-1c23-457b-b615-cbf4c7db1b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.661558 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1683fa-1c23-457b-b615-cbf4c7db1b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.662299 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1683fa-1c23-457b-b615-cbf4c7db1b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:45.663920 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1683fa-1c23-457b-b615-cbf4c7db1b61 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:45.674600 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1132/2282] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:45 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:45.678741 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3d683-7f11-4738-a0d3-5228fec63a85 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:45.690535 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3d683-7f11-4738-a0d3-5228fec63a85 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:45.695490 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0bc9c-c921-4dda-b794-da274a0be454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:45.696404 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0bc9c-c921-4dda-b794-da274a0be454 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.696682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0bc9c-c921-4dda-b794-da274a0be454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.696984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0bc9c-c921-4dda-b794-da274a0be454 admin admin] PATH_INFO: `/v3/projects/f6b1b8943cf84235a8b83e95edc80e18/users/9726d7d14dee4bc1b11545dd7aeb8fef/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.698988 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0bc9c-c921-4dda-b794-da274a0be454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b1b8943cf84235a8b83e95edc80e18, user_id=9726d7d14dee4bc1b11545dd7aeb8fef, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:45.701596 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0bc9c-c921-4dda-b794-da274a0be454 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:45.712004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1151/2283] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:45 2021] PUT /identity/v3/projects/f6b1b8943cf84235a8b83e95edc80e18/users/9726d7d14dee4bc1b11545dd7aeb8fef/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:45.722166 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5d3e6-07d4-4439-aa7c-592497340567 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.722453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5d3e6-07d4-4439-aa7c-592497340567 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.722729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5d3e6-07d4-4439-aa7c-592497340567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.749996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-25d5d3e6-07d4-4439-aa7c-592497340567 None None] MFA Rules not processed for user `9726d7d14dee4bc1b11545dd7aeb8fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:45.751213 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-25d5d3e6-07d4-4439-aa7c-592497340567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:45.819142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1133/2284] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:45 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:45.829364 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0bc9c-c921-4dda-b794-da274a0be454 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:45.831070 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5fa0bc9c-c921-4dda-b794-da274a0be454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:45.891621 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0bc9c-c921-4dda-b794-da274a0be454 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:45.895405 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c9f44-3019-41d1-aafe-c613a00388f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:45.896086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c9f44-3019-41d1-aafe-c613a00388f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.896337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c9f44-3019-41d1-aafe-c613a00388f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.896618 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c9f44-3019-41d1-aafe-c613a00388f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.952529 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c9f44-3019-41d1-aafe-c613a00388f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:45.953950 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c9f44-3019-41d1-aafe-c613a00388f1 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:45.962561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1152/2285] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:45 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:49.870282 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfcff2-bcfe-457d-8843-a7ca1be8b085 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:49.870831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfcff2-bcfe-457d-8843-a7ca1be8b085 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:49.870831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfcff2-bcfe-457d-8843-a7ca1be8b085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:49.940803 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-90dfcff2-bcfe-457d-8843-a7ca1be8b085 None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:49.941996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-90dfcff2-bcfe-457d-8843-a7ca1be8b085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:50.011673 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1134/2286] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:34:49 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:50.056701 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c9f44-3019-41d1-aafe-c613a00388f1 service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:50.058154 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a81c9f44-3019-41d1-aafe-c613a00388f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:50.148375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c9f44-3019-41d1-aafe-c613a00388f1 service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:50.154540 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289d063-c25f-4ff5-a8d2-0d90b76dcf6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:50.155241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289d063-c25f-4ff5-a8d2-0d90b76dcf6b service swift] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:50.155533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289d063-c25f-4ff5-a8d2-0d90b76dcf6b service swift] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:50.155816 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289d063-c25f-4ff5-a8d2-0d90b76dcf6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:50.164470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289d063-c25f-4ff5-a8d2-0d90b76dcf6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:50.166128 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289d063-c25f-4ff5-a8d2-0d90b76dcf6b service swift] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:50.175068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1153/2287] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:34:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:34:50.267752 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfcff2-bcfe-457d-8843-a7ca1be8b085 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:50.278565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-90dfcff2-bcfe-457d-8843-a7ca1be8b085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:50.362701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfcff2-bcfe-457d-8843-a7ca1be8b085 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:50.376533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6ac8e-671b-4a50-8bf8-61f12969fe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:50.377720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6ac8e-671b-4a50-8bf8-61f12969fe96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:50.386169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6ac8e-671b-4a50-8bf8-61f12969fe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:50.386689 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6ac8e-671b-4a50-8bf8-61f12969fe96 admin admin] PATH_INFO: `/v3/users/a53d77fd836e4abda2cb59d5ed6c370e` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:50.388498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6ac8e-671b-4a50-8bf8-61f12969fe96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a53d77fd836e4abda2cb59d5ed6c370e)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:50.390883 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6ac8e-671b-4a50-8bf8-61f12969fe96 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:50.452253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-05d6ac8e-671b-4a50-8bf8-61f12969fe96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a53d77fd836e4abda2cb59d5ed6c370e'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:50.482454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-05d6ac8e-671b-4a50-8bf8-61f12969fe96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a53d77fd836e4abda2cb59d5ed6c370e'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:50.501067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-05d6ac8e-671b-4a50-8bf8-61f12969fe96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a53d77fd836e4abda2cb59d5ed6c370e'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:50.521165 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-05d6ac8e-671b-4a50-8bf8-61f12969fe96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a53d77fd836e4abda2cb59d5ed6c370e'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:50.522869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-05d6ac8e-671b-4a50-8bf8-61f12969fe96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a53d77fd836e4abda2cb59d5ed6c370e'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:50.545939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1135/2288] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:34:50 2021] DELETE /identity/v3/users/a53d77fd836e4abda2cb59d5ed6c370e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:34:50.799368 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289d063-c25f-4ff5-a8d2-0d90b76dcf6b service swift] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:50.836226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289d063-c25f-4ff5-a8d2-0d90b76dcf6b service swift] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:50.968283 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f708c-0242-47dd-b81b-bed7d80d6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:50.969178 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f708c-0242-47dd-b81b-bed7d80d6ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:50.969466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f708c-0242-47dd-b81b-bed7d80d6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:50.969747 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f708c-0242-47dd-b81b-bed7d80d6ae4 admin admin] PATH_INFO: `/v3/projects/6898e751314d4e94af3fc6df9b465470` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:50.971090 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f708c-0242-47dd-b81b-bed7d80d6ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6898e751314d4e94af3fc6df9b465470)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:50.972999 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f708c-0242-47dd-b81b-bed7d80d6ae4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:51.036331 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d13f708c-0242-47dd-b81b-bed7d80d6ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6898e751314d4e94af3fc6df9b465470', 'request_id': 'req-d13f708c-0242-47dd-b81b-bed7d80d6ae4'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:51.046053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d13f708c-0242-47dd-b81b-bed7d80d6ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6898e751314d4e94af3fc6df9b465470', 'request_id': 'req-d13f708c-0242-47dd-b81b-bed7d80d6ae4'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:51.053507 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d13f708c-0242-47dd-b81b-bed7d80d6ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6898e751314d4e94af3fc6df9b465470', 'request_id': 'req-d13f708c-0242-47dd-b81b-bed7d80d6ae4'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:51.065404 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d13f708c-0242-47dd-b81b-bed7d80d6ae4 admin admin] The token cache is being invalidate because project 6898e751314d4e94af3fc6df9b465470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:34:51.066372 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d13f708c-0242-47dd-b81b-bed7d80d6ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:51.067240 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-d13f708c-0242-47dd-b81b-bed7d80d6ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:51.069994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1154/2289] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:34:50 2021] DELETE /identity/v3/projects/6898e751314d4e94af3fc6df9b465470 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:51.075904 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd854cc8-bb56-4891-8c6d-47071392c33f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:51.076858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd854cc8-bb56-4891-8c6d-47071392c33f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:51.077244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd854cc8-bb56-4891-8c6d-47071392c33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:51.097244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-dd854cc8-bb56-4891-8c6d-47071392c33f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:51.099035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-dd854cc8-bb56-4891-8c6d-47071392c33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:51.179113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa6641-7e60-49f4-8f6f-98393c048c7e None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:51.179285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1136/2290] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:34:51.182912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa6641-7e60-49f4-8f6f-98393c048c7e None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:51.187256 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa6641-7e60-49f4-8f6f-98393c048c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:51.215183 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-3baa6641-7e60-49f4-8f6f-98393c048c7e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:51.217082 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3baa6641-7e60-49f4-8f6f-98393c048c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:51.225310 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1155/2291] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:51.230202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd854cc8-bb56-4891-8c6d-47071392c33f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:51.261741 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd854cc8-bb56-4891-8c6d-47071392c33f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:51.267196 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5084515-1ea8-46fc-aaea-ec5595a72a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:51.267935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5084515-1ea8-46fc-aaea-ec5595a72a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:51.268290 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5084515-1ea8-46fc-aaea-ec5595a72a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:51.268642 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5084515-1ea8-46fc-aaea-ec5595a72a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:51.269488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5084515-1ea8-46fc-aaea-ec5595a72a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:34:51.269817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5084515-1ea8-46fc-aaea-ec5595a72a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:51.271458 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5084515-1ea8-46fc-aaea-ec5595a72a65 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:51.287848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1137/2292] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:34:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:34:51.289015 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa6641-7e60-49f4-8f6f-98393c048c7e None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:51.300390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa6641-7e60-49f4-8f6f-98393c048c7e None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:51.305241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41236-3ca4-4df4-8226-660a3f51c843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:51.305952 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41236-3ca4-4df4-8226-660a3f51c843 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:51.306241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41236-3ca4-4df4-8226-660a3f51c843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:51.306519 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41236-3ca4-4df4-8226-660a3f51c843 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:51.307347 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c41236-3ca4-4df4-8226-660a3f51c843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:51.309865 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c41236-3ca4-4df4-8226-660a3f51c843 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:51.340749 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1156/2293] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:34:51 2021] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:51.342090 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5084515-1ea8-46fc-aaea-ec5595a72a65 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:51.355731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5084515-1ea8-46fc-aaea-ec5595a72a65 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:51.426595 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf90a8-ec0a-45ab-8bd3-5ece8b5b715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:51.427258 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf90a8-ec0a-45ab-8bd3-5ece8b5b715f admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:51.427561 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf90a8-ec0a-45ab-8bd3-5ece8b5b715f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:51.427842 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf90a8-ec0a-45ab-8bd3-5ece8b5b715f admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:51.428592 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf90a8-ec0a-45ab-8bd3-5ece8b5b715f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:51.431008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf90a8-ec0a-45ab-8bd3-5ece8b5b715f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:51.454825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1138/2294] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:34:51 2021] POST /identity/v3/users => generated 281 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:51.458678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41236-3ca4-4df4-8226-660a3f51c843 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:51.471358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41236-3ca4-4df4-8226-660a3f51c843 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:51.476754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8257bd-855c-4c4f-9f0c-e34317b6438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:51.477459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8257bd-855c-4c4f-9f0c-e34317b6438f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:51.477816 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8257bd-855c-4c4f-9f0c-e34317b6438f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:51.478040 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8257bd-855c-4c4f-9f0c-e34317b6438f admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:51.478810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8257bd-855c-4c4f-9f0c-e34317b6438f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:51.481221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8257bd-855c-4c4f-9f0c-e34317b6438f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:51.493628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1157/2295] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:51 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:51.498220 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf90a8-ec0a-45ab-8bd3-5ece8b5b715f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:51.509340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf90a8-ec0a-45ab-8bd3-5ece8b5b715f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:51.515020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba5d15-537a-4fbf-b64b-ad20f95f2f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:51.515705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba5d15-537a-4fbf-b64b-ad20f95f2f46 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:51.515994 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba5d15-537a-4fbf-b64b-ad20f95f2f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:51.516281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba5d15-537a-4fbf-b64b-ad20f95f2f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:51.517173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba5d15-537a-4fbf-b64b-ad20f95f2f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:51.518946 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba5d15-537a-4fbf-b64b-ad20f95f2f46 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:51.530254 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1139/2296] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:34:51.534366 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8257bd-855c-4c4f-9f0c-e34317b6438f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:51.548147 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8257bd-855c-4c4f-9f0c-e34317b6438f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:51.553381 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc41171-7744-4264-8ba9-2f6d5e9f2984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:51.554287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc41171-7744-4264-8ba9-2f6d5e9f2984 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:51.554567 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc41171-7744-4264-8ba9-2f6d5e9f2984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:51.554883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc41171-7744-4264-8ba9-2f6d5e9f2984 admin admin] PATH_INFO: `/v3/projects/49111e4c117745ce93eb697c25363d4a/users/b4b0c635583a4143b2a0e53ea2f55f74/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:51.575230 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc41171-7744-4264-8ba9-2f6d5e9f2984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49111e4c117745ce93eb697c25363d4a, user_id=b4b0c635583a4143b2a0e53ea2f55f74, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:51.578015 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc41171-7744-4264-8ba9-2f6d5e9f2984 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:51.595434 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1158/2297] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:51 2021] PUT /identity/v3/projects/49111e4c117745ce93eb697c25363d4a/users/b4b0c635583a4143b2a0e53ea2f55f74/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:34:51.605582 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c6a77-9a1f-4c9e-96f7-7ff66f132967 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:51.606385 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c6a77-9a1f-4c9e-96f7-7ff66f132967 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:51.606899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c6a77-9a1f-4c9e-96f7-7ff66f132967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:51.664255 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-148c6a77-9a1f-4c9e-96f7-7ff66f132967 None None] MFA Rules not processed for user `b4b0c635583a4143b2a0e53ea2f55f74`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:51.665628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-148c6a77-9a1f-4c9e-96f7-7ff66f132967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:51.776938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1140/2298] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:51 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:51.780898 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc41171-7744-4264-8ba9-2f6d5e9f2984 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:51.848663 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc41171-7744-4264-8ba9-2f6d5e9f2984 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:51.858355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be746196-7015-4ae3-8270-bf37fd6886a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:51.859497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be746196-7015-4ae3-8270-bf37fd6886a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:51.860055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be746196-7015-4ae3-8270-bf37fd6886a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:51.860632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be746196-7015-4ae3-8270-bf37fd6886a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:51.861710 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be746196-7015-4ae3-8270-bf37fd6886a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:51.864799 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be746196-7015-4ae3-8270-bf37fd6886a6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:51.898233 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1159/2299] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:34:51 2021] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:51.902353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c6a77-9a1f-4c9e-96f7-7ff66f132967 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:51.914013 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c6a77-9a1f-4c9e-96f7-7ff66f132967 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:52.000271 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936b8f6-27a1-42f9-8eb4-079ad7eb2746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:52.001137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936b8f6-27a1-42f9-8eb4-079ad7eb2746 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:52.001509 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936b8f6-27a1-42f9-8eb4-079ad7eb2746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:52.001788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936b8f6-27a1-42f9-8eb4-079ad7eb2746 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:52.002742 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936b8f6-27a1-42f9-8eb4-079ad7eb2746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:52.005604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936b8f6-27a1-42f9-8eb4-079ad7eb2746 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:52.030881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1141/2300] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:34:51 2021] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:52.033713 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be746196-7015-4ae3-8270-bf37fd6886a6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:52.045753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be746196-7015-4ae3-8270-bf37fd6886a6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:52.051260 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b80f74-394b-4ab0-9a3e-cdee0454b1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:52.052023 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b80f74-394b-4ab0-9a3e-cdee0454b1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:52.052381 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b80f74-394b-4ab0-9a3e-cdee0454b1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:52.052741 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b80f74-394b-4ab0-9a3e-cdee0454b1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:52.053570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b80f74-394b-4ab0-9a3e-cdee0454b1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:52.055293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b80f74-394b-4ab0-9a3e-cdee0454b1c1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:52.071322 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1160/2301] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:52 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:52.072286 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936b8f6-27a1-42f9-8eb4-079ad7eb2746 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:52.083250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936b8f6-27a1-42f9-8eb4-079ad7eb2746 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:52.089130 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15014157-b4e9-4651-b143-bc43d598a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:52.090179 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15014157-b4e9-4651-b143-bc43d598a260 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:52.090667 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15014157-b4e9-4651-b143-bc43d598a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:52.091155 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15014157-b4e9-4651-b143-bc43d598a260 admin admin] PATH_INFO: `/v3/projects/5bf83206dad648e788ec9b59487775f3/users/e150cf82e40a47d7ace9011755c28056/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:52.107994 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15014157-b4e9-4651-b143-bc43d598a260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf83206dad648e788ec9b59487775f3, user_id=e150cf82e40a47d7ace9011755c28056, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:52.110678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15014157-b4e9-4651-b143-bc43d598a260 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:52.125336 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1142/2302] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:52 2021] PUT /identity/v3/projects/5bf83206dad648e788ec9b59487775f3/users/e150cf82e40a47d7ace9011755c28056/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:34:52.129484 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b80f74-394b-4ab0-9a3e-cdee0454b1c1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:52.139900 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b80f74-394b-4ab0-9a3e-cdee0454b1c1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:52.203182 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28fc31-c655-4dd3-9a05-1ece408d1f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:52.203856 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28fc31-c655-4dd3-9a05-1ece408d1f8c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:52.204142 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28fc31-c655-4dd3-9a05-1ece408d1f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:52.204423 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28fc31-c655-4dd3-9a05-1ece408d1f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:52.205184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28fc31-c655-4dd3-9a05-1ece408d1f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:52.206780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28fc31-c655-4dd3-9a05-1ece408d1f8c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:52.221783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15014157-b4e9-4651-b143-bc43d598a260 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:52.222129 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1161/2303] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:52 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:52.233545 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15014157-b4e9-4651-b143-bc43d598a260 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:52.240705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0281337-e83a-4502-9d91-6222a9b5c787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:52.241975 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0281337-e83a-4502-9d91-6222a9b5c787 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:52.242442 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0281337-e83a-4502-9d91-6222a9b5c787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:52.242928 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0281337-e83a-4502-9d91-6222a9b5c787 admin admin] PATH_INFO: `/v3/projects/5bf83206dad648e788ec9b59487775f3/users/e150cf82e40a47d7ace9011755c28056/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:52.245173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0281337-e83a-4502-9d91-6222a9b5c787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf83206dad648e788ec9b59487775f3, user_id=e150cf82e40a47d7ace9011755c28056, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:52.247901 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0281337-e83a-4502-9d91-6222a9b5c787 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:52.258527 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1143/2304] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:52 2021] PUT /identity/v3/projects/5bf83206dad648e788ec9b59487775f3/users/e150cf82e40a47d7ace9011755c28056/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:52.268948 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d0615-b3bb-4b5b-b4c3-dea7435fbb3d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:52.268948 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d0615-b3bb-4b5b-b4c3-dea7435fbb3d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:52.269276 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d0615-b3bb-4b5b-b4c3-dea7435fbb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:52.301215 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-137d0615-b3bb-4b5b-b4c3-dea7435fbb3d None None] MFA Rules not processed for user `e150cf82e40a47d7ace9011755c28056`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:52.302930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-137d0615-b3bb-4b5b-b4c3-dea7435fbb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:52.398893 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1162/2305] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:52 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:34:52.409358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0281337-e83a-4502-9d91-6222a9b5c787 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:52.413094 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b0281337-e83a-4502-9d91-6222a9b5c787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:52.500343 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0281337-e83a-4502-9d91-6222a9b5c787 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:52.504492 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3963e-e485-44c6-adcb-2eb140363fec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:52.507593 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3963e-e485-44c6-adcb-2eb140363fec service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:52.507940 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3963e-e485-44c6-adcb-2eb140363fec service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:52.508229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3963e-e485-44c6-adcb-2eb140363fec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:52.519896 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3963e-e485-44c6-adcb-2eb140363fec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:52.521360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3963e-e485-44c6-adcb-2eb140363fec service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:52.532884 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1144/2306] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:52 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:52.710441 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d0615-b3bb-4b5b-b4c3-dea7435fbb3d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:52.793850 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d0615-b3bb-4b5b-b4c3-dea7435fbb3d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:52.802932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf366201-23cc-475a-bf84-750ffe18fa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:52.804139 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf366201-23cc-475a-bf84-750ffe18fa5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:52.804635 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf366201-23cc-475a-bf84-750ffe18fa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:52.804991 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf366201-23cc-475a-bf84-750ffe18fa5d admin admin] PATH_INFO: `/v3/users/b4b0c635583a4143b2a0e53ea2f55f74` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:52.806494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf366201-23cc-475a-bf84-750ffe18fa5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b0c635583a4143b2a0e53ea2f55f74)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:52.809035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf366201-23cc-475a-bf84-750ffe18fa5d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:52.899294 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bf366201-23cc-475a-bf84-750ffe18fa5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b0c635583a4143b2a0e53ea2f55f74'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:52.914422 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bf366201-23cc-475a-bf84-750ffe18fa5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b0c635583a4143b2a0e53ea2f55f74'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:52.924450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bf366201-23cc-475a-bf84-750ffe18fa5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b0c635583a4143b2a0e53ea2f55f74'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:52.933227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bf366201-23cc-475a-bf84-750ffe18fa5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b0c635583a4143b2a0e53ea2f55f74'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:52.934221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bf366201-23cc-475a-bf84-750ffe18fa5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b0c635583a4143b2a0e53ea2f55f74'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:52.944552 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1163/2307] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:34:52 2021] DELETE /identity/v3/users/b4b0c635583a4143b2a0e53ea2f55f74 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:52.946311 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d16ec8-2f27-40c1-a041-615f94574250 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:52.946607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d16ec8-2f27-40c1-a041-615f94574250 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:52.946928 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d16ec8-2f27-40c1-a041-615f94574250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:52.966705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-24d16ec8-2f27-40c1-a041-615f94574250 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:52.968572 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-24d16ec8-2f27-40c1-a041-615f94574250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:53.063966 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1145/2308] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:34:53.074762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf366201-23cc-475a-bf84-750ffe18fa5d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:53.076754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-bf366201-23cc-475a-bf84-750ffe18fa5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:53.144008 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf366201-23cc-475a-bf84-750ffe18fa5d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:53.148276 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e131df1-5a58-472f-bec7-2b5dc34db1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:53.149006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e131df1-5a58-472f-bec7-2b5dc34db1ef service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:53.149359 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e131df1-5a58-472f-bec7-2b5dc34db1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:53.149719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e131df1-5a58-472f-bec7-2b5dc34db1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:53.159232 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e131df1-5a58-472f-bec7-2b5dc34db1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:53.161246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e131df1-5a58-472f-bec7-2b5dc34db1ef service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:53.172509 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1164/2309] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:53.512198 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d16ec8-2f27-40c1-a041-615f94574250 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:53.514354 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-24d16ec8-2f27-40c1-a041-615f94574250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:53.548178 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d16ec8-2f27-40c1-a041-615f94574250 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:53.558261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:53.559501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:53.559849 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:53.560195 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] PATH_INFO: `/v3/projects/49111e4c117745ce93eb697c25363d4a` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:53.561949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49111e4c117745ce93eb697c25363d4a)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:53.564602 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:53.621276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49111e4c117745ce93eb697c25363d4a', 'request_id': 'req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:53.632624 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49111e4c117745ce93eb697c25363d4a', 'request_id': 'req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:53.639958 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49111e4c117745ce93eb697c25363d4a', 'request_id': 'req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:53.653743 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] The token cache is being invalidate because project 49111e4c117745ce93eb697c25363d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:34:53.654038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:53.654798 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:53.657099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1146/2310] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:34:53 2021] DELETE /identity/v3/projects/49111e4c117745ce93eb697c25363d4a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:53.661787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e131df1-5a58-472f-bec7-2b5dc34db1ef service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:53.678979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e131df1-5a58-472f-bec7-2b5dc34db1ef service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:53.776800 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b8c44-9b9e-4833-a423-00649dcb528d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:53.777586 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b8c44-9b9e-4833-a423-00649dcb528d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:53.777861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b8c44-9b9e-4833-a423-00649dcb528d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:53.778129 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b8c44-9b9e-4833-a423-00649dcb528d admin admin] PATH_INFO: `/v3/users/e150cf82e40a47d7ace9011755c28056` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:53.779361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b8c44-9b9e-4833-a423-00649dcb528d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e150cf82e40a47d7ace9011755c28056)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:53.781267 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b8c44-9b9e-4833-a423-00649dcb528d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:53.838060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-457b8c44-9b9e-4833-a423-00649dcb528d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e150cf82e40a47d7ace9011755c28056'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:53.851590 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-457b8c44-9b9e-4833-a423-00649dcb528d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e150cf82e40a47d7ace9011755c28056'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:53.861576 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-457b8c44-9b9e-4833-a423-00649dcb528d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e150cf82e40a47d7ace9011755c28056'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:53.869911 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-457b8c44-9b9e-4833-a423-00649dcb528d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e150cf82e40a47d7ace9011755c28056'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:53.870833 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-457b8c44-9b9e-4833-a423-00649dcb528d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e150cf82e40a47d7ace9011755c28056'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:53.877785 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1165/2311] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:34:53 2021] DELETE /identity/v3/users/e150cf82e40a47d7ace9011755c28056 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:54.285234 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:54.286681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:54.304947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db710f65-e3e4-4c16-83d5-61cb09cdd5b4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:54.372826 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf5b23-041f-4653-bb3e-3693cb157340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:54.373696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf5b23-041f-4653-bb3e-3693cb157340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:54.373983 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf5b23-041f-4653-bb3e-3693cb157340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:54.374266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf5b23-041f-4653-bb3e-3693cb157340 admin admin] PATH_INFO: `/v3/projects/5bf83206dad648e788ec9b59487775f3` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:54.375597 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf5b23-041f-4653-bb3e-3693cb157340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf83206dad648e788ec9b59487775f3)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:54.377618 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf5b23-041f-4653-bb3e-3693cb157340 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:54.436737 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-9ccf5b23-041f-4653-bb3e-3693cb157340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf83206dad648e788ec9b59487775f3', 'request_id': 'req-9ccf5b23-041f-4653-bb3e-3693cb157340'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:54.446415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-9ccf5b23-041f-4653-bb3e-3693cb157340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf83206dad648e788ec9b59487775f3', 'request_id': 'req-9ccf5b23-041f-4653-bb3e-3693cb157340'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:54.453905 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-9ccf5b23-041f-4653-bb3e-3693cb157340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf83206dad648e788ec9b59487775f3', 'request_id': 'req-9ccf5b23-041f-4653-bb3e-3693cb157340'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:54.467280 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-9ccf5b23-041f-4653-bb3e-3693cb157340 admin admin] The token cache is being invalidate because project 5bf83206dad648e788ec9b59487775f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:34:54.467596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-9ccf5b23-041f-4653-bb3e-3693cb157340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:54.468848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-9ccf5b23-041f-4653-bb3e-3693cb157340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:54.470909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1147/2312] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:34:54 2021] DELETE /identity/v3/projects/5bf83206dad648e788ec9b59487775f3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:54.477090 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f4b8d-634c-4ec9-84f6-28045d769257 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:54.477602 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f4b8d-634c-4ec9-84f6-28045d769257 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:54.477715 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f4b8d-634c-4ec9-84f6-28045d769257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:54.498992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-512f4b8d-634c-4ec9-84f6-28045d769257 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:54.500303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-512f4b8d-634c-4ec9-84f6-28045d769257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:54.581672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1166/2313] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:34:54.584516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2218b0-32ae-4b41-88cb-23863f2c7420 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:54.584516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2218b0-32ae-4b41-88cb-23863f2c7420 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:54.584516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2218b0-32ae-4b41-88cb-23863f2c7420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:54.606545 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-de2218b0-32ae-4b41-88cb-23863f2c7420 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:54.609279 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-de2218b0-32ae-4b41-88cb-23863f2c7420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:54.621573 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1148/2314] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:54.625939 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f4b8d-634c-4ec9-84f6-28045d769257 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:54.637234 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f4b8d-634c-4ec9-84f6-28045d769257 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:54.641877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995a52d-5ad2-487f-b340-ac235e02af51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:54.642536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995a52d-5ad2-487f-b340-ac235e02af51 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:54.642815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995a52d-5ad2-487f-b340-ac235e02af51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:54.643125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995a52d-5ad2-487f-b340-ac235e02af51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:54.643867 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995a52d-5ad2-487f-b340-ac235e02af51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:34:54.644169 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995a52d-5ad2-487f-b340-ac235e02af51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:54.645758 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995a52d-5ad2-487f-b340-ac235e02af51 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:54.657841 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1167/2315] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:34:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:34:54.662262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2218b0-32ae-4b41-88cb-23863f2c7420 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:54.671945 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2218b0-32ae-4b41-88cb-23863f2c7420 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:54.676604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1692b-f536-4b8a-a712-54944b972e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:54.677245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1692b-f536-4b8a-a712-54944b972e65 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:54.677526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1692b-f536-4b8a-a712-54944b972e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:54.677804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1692b-f536-4b8a-a712-54944b972e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:54.678512 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1692b-f536-4b8a-a712-54944b972e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:54.680455 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1692b-f536-4b8a-a712-54944b972e65 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:54.713980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1149/2316] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:34:54 2021] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:54.718174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995a52d-5ad2-487f-b340-ac235e02af51 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:54.728446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995a52d-5ad2-487f-b340-ac235e02af51 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:54.792969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94991371-ca0d-4eb8-81e8-a8926e2de796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:54.793716 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94991371-ca0d-4eb8-81e8-a8926e2de796 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:54.793956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94991371-ca0d-4eb8-81e8-a8926e2de796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:54.794237 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94991371-ca0d-4eb8-81e8-a8926e2de796 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:54.795033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94991371-ca0d-4eb8-81e8-a8926e2de796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:54.797012 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94991371-ca0d-4eb8-81e8-a8926e2de796 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:54.817168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1168/2317] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:34:54 2021] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:54.821692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1692b-f536-4b8a-a712-54944b972e65 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:54.832310 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1692b-f536-4b8a-a712-54944b972e65 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:54.837024 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f023b-505f-4083-9788-30a0a9e75b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:54.837786 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f023b-505f-4083-9788-30a0a9e75b16 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:54.838153 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f023b-505f-4083-9788-30a0a9e75b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:54.838550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f023b-505f-4083-9788-30a0a9e75b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:54.839425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f023b-505f-4083-9788-30a0a9e75b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:54.841241 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f023b-505f-4083-9788-30a0a9e75b16 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:54.852727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1150/2318] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:54 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:54.856740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94991371-ca0d-4eb8-81e8-a8926e2de796 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:54.866586 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94991371-ca0d-4eb8-81e8-a8926e2de796 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:54.871914 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4e46d-d2f9-47a6-ab5d-78c420b4d2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:54.872553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4e46d-d2f9-47a6-ab5d-78c420b4d2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:54.872837 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4e46d-d2f9-47a6-ab5d-78c420b4d2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:54.873113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4e46d-d2f9-47a6-ab5d-78c420b4d2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:54.873857 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4e46d-d2f9-47a6-ab5d-78c420b4d2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:54.875470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4e46d-d2f9-47a6-ab5d-78c420b4d2c4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:54.885621 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1169/2319] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:54 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:54.889739 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f023b-505f-4083-9788-30a0a9e75b16 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:54.899663 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f023b-505f-4083-9788-30a0a9e75b16 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:54.904745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522bb39-cc38-4309-856c-83cd50c012f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:54.905643 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522bb39-cc38-4309-856c-83cd50c012f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:54.905928 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522bb39-cc38-4309-856c-83cd50c012f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:54.906205 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522bb39-cc38-4309-856c-83cd50c012f6 admin admin] PATH_INFO: `/v3/projects/aaf5f995207a4f04b52ec25e9908a501/users/131b2100c3784d53867816d6ff37d1df/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:54.920888 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522bb39-cc38-4309-856c-83cd50c012f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf5f995207a4f04b52ec25e9908a501, user_id=131b2100c3784d53867816d6ff37d1df, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:54.923580 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522bb39-cc38-4309-856c-83cd50c012f6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:54.936815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1151/2320] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:54 2021] PUT /identity/v3/projects/aaf5f995207a4f04b52ec25e9908a501/users/131b2100c3784d53867816d6ff37d1df/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:54.947256 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa107e-2569-49c3-8cad-67ca3d84b890 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:54.947553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa107e-2569-49c3-8cad-67ca3d84b890 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:54.947861 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa107e-2569-49c3-8cad-67ca3d84b890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:54.973442 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b9aa107e-2569-49c3-8cad-67ca3d84b890 None None] MFA Rules not processed for user `131b2100c3784d53867816d6ff37d1df`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:54.974691 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b9aa107e-2569-49c3-8cad-67ca3d84b890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:55.050315 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1170/2321] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:54 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:55.054992 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522bb39-cc38-4309-856c-83cd50c012f6 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:55.118778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522bb39-cc38-4309-856c-83cd50c012f6 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:55.123819 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409b3c9-1efe-4f5f-a8c3-e4d7a54873d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:55.124456 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409b3c9-1efe-4f5f-a8c3-e4d7a54873d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:55.124734 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409b3c9-1efe-4f5f-a8c3-e4d7a54873d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:55.125006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409b3c9-1efe-4f5f-a8c3-e4d7a54873d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:55.125706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409b3c9-1efe-4f5f-a8c3-e4d7a54873d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:55.127610 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409b3c9-1efe-4f5f-a8c3-e4d7a54873d4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:55.151698 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1152/2322] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:34:55 2021] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:55.155773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa107e-2569-49c3-8cad-67ca3d84b890 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:55.166225 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa107e-2569-49c3-8cad-67ca3d84b890 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:55.221552 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbd4c6-d648-486a-821c-943bffc5c6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:55.222220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbd4c6-d648-486a-821c-943bffc5c6bb admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:55.222506 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbd4c6-d648-486a-821c-943bffc5c6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:55.222785 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbd4c6-d648-486a-821c-943bffc5c6bb admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:55.223575 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbd4c6-d648-486a-821c-943bffc5c6bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:55.225474 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbd4c6-d648-486a-821c-943bffc5c6bb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:55.248952 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1171/2323] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:34:55 2021] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:55.250124 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409b3c9-1efe-4f5f-a8c3-e4d7a54873d4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:55.260340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409b3c9-1efe-4f5f-a8c3-e4d7a54873d4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:55.277598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa3158-081e-4988-b75b-337018e62e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:55.278364 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa3158-081e-4988-b75b-337018e62e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:55.278717 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa3158-081e-4988-b75b-337018e62e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:55.279090 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa3158-081e-4988-b75b-337018e62e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:55.279913 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa3158-081e-4988-b75b-337018e62e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:55.281855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa3158-081e-4988-b75b-337018e62e13 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:55.291962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1153/2324] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:55 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:55.296219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbd4c6-d648-486a-821c-943bffc5c6bb admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:55.306874 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbd4c6-d648-486a-821c-943bffc5c6bb admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:55.312840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd67a32-b617-4e47-baa9-9fca9224b64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:55.313955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67a32-b617-4e47-baa9-9fca9224b64b admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:55.314247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67a32-b617-4e47-baa9-9fca9224b64b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:55.314638 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67a32-b617-4e47-baa9-9fca9224b64b admin admin] PATH_INFO: `/v3/projects/d969549f6c3e44f9b5cd089bc78a9b18/users/ebaf8faab13f40c0abe4f25e1a2a3708/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:55.333374 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd67a32-b617-4e47-baa9-9fca9224b64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d969549f6c3e44f9b5cd089bc78a9b18, user_id=ebaf8faab13f40c0abe4f25e1a2a3708, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:55.336069 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd67a32-b617-4e47-baa9-9fca9224b64b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:55.349365 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1172/2325] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:55 2021] PUT /identity/v3/projects/d969549f6c3e44f9b5cd089bc78a9b18/users/ebaf8faab13f40c0abe4f25e1a2a3708/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:34:55.353172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa3158-081e-4988-b75b-337018e62e13 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:55.362820 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa3158-081e-4988-b75b-337018e62e13 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:55.422869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f1e14-12c6-4057-9687-af09c58b39f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:55.423822 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f1e14-12c6-4057-9687-af09c58b39f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:55.424264 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f1e14-12c6-4057-9687-af09c58b39f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:55.424875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f1e14-12c6-4057-9687-af09c58b39f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:55.425846 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f1e14-12c6-4057-9687-af09c58b39f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:55.427993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f1e14-12c6-4057-9687-af09c58b39f1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:55.445261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1154/2326] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:55 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:55.446951 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd67a32-b617-4e47-baa9-9fca9224b64b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:55.457744 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd67a32-b617-4e47-baa9-9fca9224b64b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:55.462779 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e2339-a471-48a7-9f52-5a28a0d3b708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:55.463930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e2339-a471-48a7-9f52-5a28a0d3b708 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:55.464390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e2339-a471-48a7-9f52-5a28a0d3b708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:55.464823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e2339-a471-48a7-9f52-5a28a0d3b708 admin admin] PATH_INFO: `/v3/projects/d969549f6c3e44f9b5cd089bc78a9b18/users/ebaf8faab13f40c0abe4f25e1a2a3708/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:55.467174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e2339-a471-48a7-9f52-5a28a0d3b708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d969549f6c3e44f9b5cd089bc78a9b18, user_id=ebaf8faab13f40c0abe4f25e1a2a3708, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:55.469956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e2339-a471-48a7-9f52-5a28a0d3b708 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:55.481636 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1173/2327] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:55 2021] PUT /identity/v3/projects/d969549f6c3e44f9b5cd089bc78a9b18/users/ebaf8faab13f40c0abe4f25e1a2a3708/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:55.493719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da18d0c-a595-4cc1-8d79-e58a35027257 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:55.494170 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da18d0c-a595-4cc1-8d79-e58a35027257 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:55.494623 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da18d0c-a595-4cc1-8d79-e58a35027257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:55.538284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-6da18d0c-a595-4cc1-8d79-e58a35027257 None None] MFA Rules not processed for user `ebaf8faab13f40c0abe4f25e1a2a3708`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:55.540084 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-6da18d0c-a595-4cc1-8d79-e58a35027257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:55.630913 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1155/2328] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:55 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:34:55.640548 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e2339-a471-48a7-9f52-5a28a0d3b708 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:55.642351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-be7e2339-a471-48a7-9f52-5a28a0d3b708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:55.709937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e2339-a471-48a7-9f52-5a28a0d3b708 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:55.716439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c0bd0-2791-4e53-bc65-42cf837a5f60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:55.717516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c0bd0-2791-4e53-bc65-42cf837a5f60 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:55.718006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c0bd0-2791-4e53-bc65-42cf837a5f60 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:55.718385 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c0bd0-2791-4e53-bc65-42cf837a5f60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:55.729601 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c0bd0-2791-4e53-bc65-42cf837a5f60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:55.731266 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c0bd0-2791-4e53-bc65-42cf837a5f60 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:55.744148 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1174/2329] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:55 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:34:57.177923 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da18d0c-a595-4cc1-8d79-e58a35027257 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:57.179610 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-6da18d0c-a595-4cc1-8d79-e58a35027257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:57.201156 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da18d0c-a595-4cc1-8d79-e58a35027257 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:57.206081 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26fd03-f273-4cde-b675-1fd2eb9c16b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:57.207516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26fd03-f273-4cde-b675-1fd2eb9c16b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:57.207804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26fd03-f273-4cde-b675-1fd2eb9c16b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:57.208133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26fd03-f273-4cde-b675-1fd2eb9c16b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:57.210143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-db26fd03-f273-4cde-b675-1fd2eb9c16b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:57.374983 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26fd03-f273-4cde-b675-1fd2eb9c16b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:57.376579 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26fd03-f273-4cde-b675-1fd2eb9c16b3 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:57.398902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1156/2330] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:57 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:57.457016 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c0bd0-2791-4e53-bc65-42cf837a5f60 service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:57.566919 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c0bd0-2791-4e53-bc65-42cf837a5f60 service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:57.581002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34eb2a-61c9-4e11-bc10-315e6fd5230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:57.582734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34eb2a-61c9-4e11-bc10-315e6fd5230f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:57.583441 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34eb2a-61c9-4e11-bc10-315e6fd5230f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:57.583979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34eb2a-61c9-4e11-bc10-315e6fd5230f admin admin] PATH_INFO: `/v3/users/131b2100c3784d53867816d6ff37d1df` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:57.585591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34eb2a-61c9-4e11-bc10-315e6fd5230f admin admin] RBAC: Authorizing `identity:delete_user(user_id=131b2100c3784d53867816d6ff37d1df)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:57.593622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34eb2a-61c9-4e11-bc10-315e6fd5230f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:57.693353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6b34eb2a-61c9-4e11-bc10-315e6fd5230f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131b2100c3784d53867816d6ff37d1df'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:57.720751 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6b34eb2a-61c9-4e11-bc10-315e6fd5230f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131b2100c3784d53867816d6ff37d1df'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:57.733377 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6b34eb2a-61c9-4e11-bc10-315e6fd5230f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131b2100c3784d53867816d6ff37d1df'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:57.745431 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6b34eb2a-61c9-4e11-bc10-315e6fd5230f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131b2100c3784d53867816d6ff37d1df'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:57.747370 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6b34eb2a-61c9-4e11-bc10-315e6fd5230f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131b2100c3784d53867816d6ff37d1df'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:57.761410 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1175/2331] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:34:57 2021] DELETE /identity/v3/users/131b2100c3784d53867816d6ff37d1df => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:57.766936 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124112a-3bbb-4ab2-87a7-e172ca81c6e5 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:57.767245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124112a-3bbb-4ab2-87a7-e172ca81c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:57.767523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124112a-3bbb-4ab2-87a7-e172ca81c6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:57.789553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-2124112a-3bbb-4ab2-87a7-e172ca81c6e5 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:57.791181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-2124112a-3bbb-4ab2-87a7-e172ca81c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:57.882435 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1157/2332] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:57.895488 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34eb2a-61c9-4e11-bc10-315e6fd5230f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:57.897658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-6b34eb2a-61c9-4e11-bc10-315e6fd5230f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:57.967842 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34eb2a-61c9-4e11-bc10-315e6fd5230f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:57.971896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c75e82-6354-42a8-82ee-7fb24df7bac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:57.972619 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75e82-6354-42a8-82ee-7fb24df7bac2 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:57.972906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75e82-6354-42a8-82ee-7fb24df7bac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:57.973215 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75e82-6354-42a8-82ee-7fb24df7bac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:57.983454 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c75e82-6354-42a8-82ee-7fb24df7bac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:57.984898 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c75e82-6354-42a8-82ee-7fb24df7bac2 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:57.996258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1176/2333] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:58.343543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124112a-3bbb-4ab2-87a7-e172ca81c6e5 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:58.345715 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-2124112a-3bbb-4ab2-87a7-e172ca81c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:58.378807 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124112a-3bbb-4ab2-87a7-e172ca81c6e5 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:58.386091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:58.387657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:58.388029 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:58.388594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] PATH_INFO: `/v3/projects/aaf5f995207a4f04b52ec25e9908a501` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:58.389980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf5f995207a4f04b52ec25e9908a501)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:58.392050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:58.473012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf5f995207a4f04b52ec25e9908a501', 'request_id': 'req-76f9d95d-e328-408b-8313-a6bb583720c6'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:58.486657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf5f995207a4f04b52ec25e9908a501', 'request_id': 'req-76f9d95d-e328-408b-8313-a6bb583720c6'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:58.493098 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf5f995207a4f04b52ec25e9908a501', 'request_id': 'req-76f9d95d-e328-408b-8313-a6bb583720c6'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:58.511850 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] The token cache is being invalidate because project aaf5f995207a4f04b52ec25e9908a501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:34:58.512424 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:58.513614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:58.515689 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1158/2334] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:34:58 2021] DELETE /identity/v3/projects/aaf5f995207a4f04b52ec25e9908a501 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:58.519686 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c75e82-6354-42a8-82ee-7fb24df7bac2 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:58.534054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c75e82-6354-42a8-82ee-7fb24df7bac2 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:58.613839 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec7aef-001f-4928-8eac-6ec651216f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:58.614719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec7aef-001f-4928-8eac-6ec651216f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:58.615155 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec7aef-001f-4928-8eac-6ec651216f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:58.615316 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec7aef-001f-4928-8eac-6ec651216f15 admin admin] PATH_INFO: `/v3/users/ebaf8faab13f40c0abe4f25e1a2a3708` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:58.616600 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec7aef-001f-4928-8eac-6ec651216f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebaf8faab13f40c0abe4f25e1a2a3708)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:58.618528 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec7aef-001f-4928-8eac-6ec651216f15 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:58.690271 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-75ec7aef-001f-4928-8eac-6ec651216f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebaf8faab13f40c0abe4f25e1a2a3708'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:58.704493 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-75ec7aef-001f-4928-8eac-6ec651216f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebaf8faab13f40c0abe4f25e1a2a3708'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:58.714902 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-75ec7aef-001f-4928-8eac-6ec651216f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebaf8faab13f40c0abe4f25e1a2a3708'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:58.722749 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-75ec7aef-001f-4928-8eac-6ec651216f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebaf8faab13f40c0abe4f25e1a2a3708'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:58.724588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-75ec7aef-001f-4928-8eac-6ec651216f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebaf8faab13f40c0abe4f25e1a2a3708'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:58.733491 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1177/2335] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:34:58 2021] DELETE /identity/v3/users/ebaf8faab13f40c0abe4f25e1a2a3708 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:34:59.087860 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:59.090602 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:59.133512 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9d95d-e328-408b-8313-a6bb583720c6 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:59.197138 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:59.198560 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.199055 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.199515 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8 admin admin] PATH_INFO: `/v3/projects/d969549f6c3e44f9b5cd089bc78a9b18` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.200768 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d969549f6c3e44f9b5cd089bc78a9b18)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:59.202706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:59.263324 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd969549f6c3e44f9b5cd089bc78a9b18', 'request_id': 'req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:59.273081 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd969549f6c3e44f9b5cd089bc78a9b18', 'request_id': 'req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:59.285481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd969549f6c3e44f9b5cd089bc78a9b18', 'request_id': 'req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:59.304346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8 admin admin] The token cache is being invalidate because project d969549f6c3e44f9b5cd089bc78a9b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:34:59.304696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:59.305421 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f1b77c2a-cb97-4140-83b8-e5a9edc860f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:34:59.307391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1159/2336] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:34:59 2021] DELETE /identity/v3/projects/d969549f6c3e44f9b5cd089bc78a9b18 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:59.314226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c10400-9bff-4f20-a647-a73628993361 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.314632 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c10400-9bff-4f20-a647-a73628993361 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.315026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c10400-9bff-4f20-a647-a73628993361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.340258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-24c10400-9bff-4f20-a647-a73628993361 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:59.341479 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-24c10400-9bff-4f20-a647-a73628993361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:59.421047 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1178/2337] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:34:59.429816 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1144f-1b40-4ae8-8fab-8df216719084 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.430876 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1144f-1b40-4ae8-8fab-8df216719084 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.431235 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1144f-1b40-4ae8-8fab-8df216719084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.459882 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-8cb1144f-1b40-4ae8-8fab-8df216719084 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:59.461281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-8cb1144f-1b40-4ae8-8fab-8df216719084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:59.470661 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1160/2338] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:59.475200 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c10400-9bff-4f20-a647-a73628993361 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:59.487418 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c10400-9bff-4f20-a647-a73628993361 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:59.494092 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b5d1f-df0f-4552-8f39-f7bcc20cdd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:59.494899 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b5d1f-df0f-4552-8f39-f7bcc20cdd7f admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.495267 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b5d1f-df0f-4552-8f39-f7bcc20cdd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.495619 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b5d1f-df0f-4552-8f39-f7bcc20cdd7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.498406 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b5d1f-df0f-4552-8f39-f7bcc20cdd7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:34:59.498406 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b5d1f-df0f-4552-8f39-f7bcc20cdd7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:59.498867 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b5d1f-df0f-4552-8f39-f7bcc20cdd7f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:59.515236 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1179/2339] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:34:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:34:59.519365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1144f-1b40-4ae8-8fab-8df216719084 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:59.529877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1144f-1b40-4ae8-8fab-8df216719084 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:59.534933 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9922596-d769-4f5b-a672-42bf61d14542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:59.535705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9922596-d769-4f5b-a672-42bf61d14542 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.536057 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9922596-d769-4f5b-a672-42bf61d14542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.536406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9922596-d769-4f5b-a672-42bf61d14542 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.537212 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9922596-d769-4f5b-a672-42bf61d14542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:59.539323 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9922596-d769-4f5b-a672-42bf61d14542 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:59.572608 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1161/2340] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:34:59 2021] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:34:59.573676 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b5d1f-df0f-4552-8f39-f7bcc20cdd7f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:59.584495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b5d1f-df0f-4552-8f39-f7bcc20cdd7f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:59.676865 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290480e-c3ad-46ae-9528-2bad425d702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:59.677631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290480e-c3ad-46ae-9528-2bad425d702f admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.677920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290480e-c3ad-46ae-9528-2bad425d702f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.678327 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290480e-c3ad-46ae-9528-2bad425d702f admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.679131 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290480e-c3ad-46ae-9528-2bad425d702f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:59.681045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290480e-c3ad-46ae-9528-2bad425d702f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:59.710367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1180/2341] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:34:59 2021] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:34:59.714432 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9922596-d769-4f5b-a672-42bf61d14542 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:59.726181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9922596-d769-4f5b-a672-42bf61d14542 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:59.732287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0b8c9-ee9c-4d9c-a67b-23d24370dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:59.733262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0b8c9-ee9c-4d9c-a67b-23d24370dda7 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.733788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0b8c9-ee9c-4d9c-a67b-23d24370dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.734282 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0b8c9-ee9c-4d9c-a67b-23d24370dda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.735606 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0b8c9-ee9c-4d9c-a67b-23d24370dda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:59.738380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0b8c9-ee9c-4d9c-a67b-23d24370dda7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:59.751556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1162/2342] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:59 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:59.755220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290480e-c3ad-46ae-9528-2bad425d702f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:59.772847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290480e-c3ad-46ae-9528-2bad425d702f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:59.779444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcdbbf-b9c0-406e-8988-5bfd7868eadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:59.780127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcdbbf-b9c0-406e-8988-5bfd7868eadc admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.780411 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcdbbf-b9c0-406e-8988-5bfd7868eadc admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.780690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcdbbf-b9c0-406e-8988-5bfd7868eadc admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.781446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcdbbf-b9c0-406e-8988-5bfd7868eadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:59.783089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcdbbf-b9c0-406e-8988-5bfd7868eadc admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:59.793971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1181/2343] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:34:59 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:34:59.798360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0b8c9-ee9c-4d9c-a67b-23d24370dda7 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:59.811219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0b8c9-ee9c-4d9c-a67b-23d24370dda7 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:59.818374 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39e803-0735-4600-8162-348b4442ae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:59.820123 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39e803-0735-4600-8162-348b4442ae08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.820542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39e803-0735-4600-8162-348b4442ae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.821029 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39e803-0735-4600-8162-348b4442ae08 admin admin] PATH_INFO: `/v3/projects/7f94b273ab374ac7a1396332ff49865e/users/888b8fff5051481f92f811008c9f4a6a/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.848353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39e803-0735-4600-8162-348b4442ae08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f94b273ab374ac7a1396332ff49865e, user_id=888b8fff5051481f92f811008c9f4a6a, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:59.853399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39e803-0735-4600-8162-348b4442ae08 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:59.870236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1163/2344] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:34:59 2021] PUT /identity/v3/projects/7f94b273ab374ac7a1396332ff49865e/users/888b8fff5051481f92f811008c9f4a6a/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:59.880867 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8988e5-26b6-4dd4-9fce-d38d29e0d12f None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.881387 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8988e5-26b6-4dd4-9fce-d38d29e0d12f None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.881852 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8988e5-26b6-4dd4-9fce-d38d29e0d12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.914282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-5e8988e5-26b6-4dd4-9fce-d38d29e0d12f None None] MFA Rules not processed for user `888b8fff5051481f92f811008c9f4a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:59.915946 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5e8988e5-26b6-4dd4-9fce-d38d29e0d12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:59.999108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1182/2345] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:34:59 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:00.004046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39e803-0735-4600-8162-348b4442ae08 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:00.074169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39e803-0735-4600-8162-348b4442ae08 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:00.079503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdbdfd-eedc-49c4-b6c7-0794a599dce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:00.080254 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdbdfd-eedc-49c4-b6c7-0794a599dce8 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:00.080610 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdbdfd-eedc-49c4-b6c7-0794a599dce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:00.080974 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdbdfd-eedc-49c4-b6c7-0794a599dce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:00.081901 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdbdfd-eedc-49c4-b6c7-0794a599dce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:00.084094 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdbdfd-eedc-49c4-b6c7-0794a599dce8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:00.125864 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1164/2346] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:35:00 2021] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:35:00.130734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8988e5-26b6-4dd4-9fce-d38d29e0d12f None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:00.145346 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8988e5-26b6-4dd4-9fce-d38d29e0d12f None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:00.254561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e4a71-eee6-489f-be65-cdd4a69873ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:00.255569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e4a71-eee6-489f-be65-cdd4a69873ff admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:00.256034 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e4a71-eee6-489f-be65-cdd4a69873ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:00.256476 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e4a71-eee6-489f-be65-cdd4a69873ff admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:00.257389 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e4a71-eee6-489f-be65-cdd4a69873ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:00.259566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e4a71-eee6-489f-be65-cdd4a69873ff admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:00.306569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1183/2347] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:35:00 2021] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:35:00.311410 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdbdfd-eedc-49c4-b6c7-0794a599dce8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:00.322623 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdbdfd-eedc-49c4-b6c7-0794a599dce8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:00.327444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9acdd-c81b-4592-80cf-b12cae506cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:00.328121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9acdd-c81b-4592-80cf-b12cae506cfd admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:00.328401 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9acdd-c81b-4592-80cf-b12cae506cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:00.328678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9acdd-c81b-4592-80cf-b12cae506cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:00.329438 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9acdd-c81b-4592-80cf-b12cae506cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:00.331156 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9acdd-c81b-4592-80cf-b12cae506cfd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:00.346906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1165/2348] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:35:00.347698 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e4a71-eee6-489f-be65-cdd4a69873ff admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:00.358972 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e4a71-eee6-489f-be65-cdd4a69873ff admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:00.363742 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53a715-b3d2-487b-932e-d84fa7592534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:00.364643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a715-b3d2-487b-932e-d84fa7592534 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:00.364926 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a715-b3d2-487b-932e-d84fa7592534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:00.365228 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a715-b3d2-487b-932e-d84fa7592534 admin admin] PATH_INFO: `/v3/projects/46069caea390461bbdc479963bd9a8b9/users/2781b4cef2094f4bacf2d710d8aed996/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:00.381905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53a715-b3d2-487b-932e-d84fa7592534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46069caea390461bbdc479963bd9a8b9, user_id=2781b4cef2094f4bacf2d710d8aed996, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:00.384153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53a715-b3d2-487b-932e-d84fa7592534 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:00.401911 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1184/2349] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:35:00 2021] PUT /identity/v3/projects/46069caea390461bbdc479963bd9a8b9/users/2781b4cef2094f4bacf2d710d8aed996/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:00.406202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9acdd-c81b-4592-80cf-b12cae506cfd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:00.417312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9acdd-c81b-4592-80cf-b12cae506cfd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:00.495983 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35158633-fade-439d-9238-742192c4d5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:00.496694 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35158633-fade-439d-9238-742192c4d5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:00.496930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35158633-fade-439d-9238-742192c4d5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:00.497204 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35158633-fade-439d-9238-742192c4d5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:00.497977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35158633-fade-439d-9238-742192c4d5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:00.499705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35158633-fade-439d-9238-742192c4d5d5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:00.509768 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1166/2350] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:00 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:35:00.513820 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53a715-b3d2-487b-932e-d84fa7592534 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:00.524406 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53a715-b3d2-487b-932e-d84fa7592534 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:00.530218 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0419246-efda-4b86-b7c1-5268f710b3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:00.531706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0419246-efda-4b86-b7c1-5268f710b3a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:00.531706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0419246-efda-4b86-b7c1-5268f710b3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:00.531884 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0419246-efda-4b86-b7c1-5268f710b3a2 admin admin] PATH_INFO: `/v3/projects/46069caea390461bbdc479963bd9a8b9/users/2781b4cef2094f4bacf2d710d8aed996/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:00.533834 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0419246-efda-4b86-b7c1-5268f710b3a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46069caea390461bbdc479963bd9a8b9, user_id=2781b4cef2094f4bacf2d710d8aed996, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:00.536630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0419246-efda-4b86-b7c1-5268f710b3a2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:00.549026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1185/2351] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:35:00 2021] PUT /identity/v3/projects/46069caea390461bbdc479963bd9a8b9/users/2781b4cef2094f4bacf2d710d8aed996/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:00.560094 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723007d-2a25-435e-97fd-c68ecba6af9e None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:00.560379 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723007d-2a25-435e-97fd-c68ecba6af9e None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:00.560653 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723007d-2a25-435e-97fd-c68ecba6af9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:00.599421 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-4723007d-2a25-435e-97fd-c68ecba6af9e None None] MFA Rules not processed for user `2781b4cef2094f4bacf2d710d8aed996`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:00.600814 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4723007d-2a25-435e-97fd-c68ecba6af9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:00.699409 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1167/2352] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:00 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:00.716547 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0419246-efda-4b86-b7c1-5268f710b3a2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:00.716547 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d0419246-efda-4b86-b7c1-5268f710b3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:00.784906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0419246-efda-4b86-b7c1-5268f710b3a2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:00.789368 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb1c46-d8ae-4925-bc87-6565d1fd9fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:00.790205 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb1c46-d8ae-4925-bc87-6565d1fd9fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:00.790664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb1c46-d8ae-4925-bc87-6565d1fd9fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:00.791603 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb1c46-d8ae-4925-bc87-6565d1fd9fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:00.802445 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb1c46-d8ae-4925-bc87-6565d1fd9fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:00.804070 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb1c46-d8ae-4925-bc87-6565d1fd9fa2 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:00.815405 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1186/2353] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:00 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:01.224614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723007d-2a25-435e-97fd-c68ecba6af9e None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:01.238361 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723007d-2a25-435e-97fd-c68ecba6af9e None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:01.243214 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89644f7-3900-4d1d-a23f-dfba4ec71b0f tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2781b4cef2094f4bacf2d710d8aed996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46069caea390461bbdc479963bd9a8b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:01.243941 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89644f7-3900-4d1d-a23f-dfba4ec71b0f tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:01.244825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89644f7-3900-4d1d-a23f-dfba4ec71b0f tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:01.245181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89644f7-3900-4d1d-a23f-dfba4ec71b0f tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:01.246000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89644f7-3900-4d1d-a23f-dfba4ec71b0f tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:35:01.246317 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89644f7-3900-4d1d-a23f-dfba4ec71b0f tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:01.248042 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89644f7-3900-4d1d-a23f-dfba4ec71b0f tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:01.275088 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1168/2354] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:35:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:35:01.276749 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb1c46-d8ae-4925-bc87-6565d1fd9fa2 service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:01.286552 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb1c46-d8ae-4925-bc87-6565d1fd9fa2 service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:01.292867 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f58c5-04d9-4fb3-a676-8a2362fb70ac tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2781b4cef2094f4bacf2d710d8aed996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46069caea390461bbdc479963bd9a8b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:01.293616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f58c5-04d9-4fb3-a676-8a2362fb70ac tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:01.294005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f58c5-04d9-4fb3-a676-8a2362fb70ac tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:01.294352 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f58c5-04d9-4fb3-a676-8a2362fb70ac tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:01.295215 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f58c5-04d9-4fb3-a676-8a2362fb70ac tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:01.297842 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f58c5-04d9-4fb3-a676-8a2362fb70ac tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:01.340596 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1187/2355] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:35:01 2021] POST /identity/v3/projects => generated 354 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:35:01.345878 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89644f7-3900-4d1d-a23f-dfba4ec71b0f tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:01.356918 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89644f7-3900-4d1d-a23f-dfba4ec71b0f tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:01.451790 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3097ad0-9cc7-4201-a8be-888eb5f245b3 tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2781b4cef2094f4bacf2d710d8aed996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46069caea390461bbdc479963bd9a8b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:01.453078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3097ad0-9cc7-4201-a8be-888eb5f245b3 tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:01.453514 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3097ad0-9cc7-4201-a8be-888eb5f245b3 tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:01.453880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3097ad0-9cc7-4201-a8be-888eb5f245b3 tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:01.454934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3097ad0-9cc7-4201-a8be-888eb5f245b3 tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:35:01.455487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3097ad0-9cc7-4201-a8be-888eb5f245b3 tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:01.458501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3097ad0-9cc7-4201-a8be-888eb5f245b3 tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:01.478534 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1169/2356] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:35:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:35:01.536824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f58c5-04d9-4fb3-a676-8a2362fb70ac tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:01.549359 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f58c5-04d9-4fb3-a676-8a2362fb70ac tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:01.555658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2781b4cef2094f4bacf2d710d8aed996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46069caea390461bbdc479963bd9a8b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:01.557193 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:01.558238 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:01.558682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] PATH_INFO: `/v3/projects/64498bdd19864f82a177a0f0f78e983b` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:01.560090 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] RBAC: Authorizing `identity:delete_project(project_id=64498bdd19864f82a177a0f0f78e983b)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:01.562050 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:01.629973 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64498bdd19864f82a177a0f0f78e983b', 'request_id': 'req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:01.637543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64498bdd19864f82a177a0f0f78e983b', 'request_id': 'req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:01.645399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64498bdd19864f82a177a0f0f78e983b', 'request_id': 'req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:01.656312 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] The token cache is being invalidate because project 64498bdd19864f82a177a0f0f78e983b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:35:01.656652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:01.657388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2bced34b-1f90-4563-8b2d-96f97ec2bf9c tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:01.662280 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1188/2357] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:35:01 2021] DELETE /identity/v3/projects/64498bdd19864f82a177a0f0f78e983b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:01.861209 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3097ad0-9cc7-4201-a8be-888eb5f245b3 tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:01.863247 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f3097ad0-9cc7-4201-a8be-888eb5f245b3 tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:01.935868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3097ad0-9cc7-4201-a8be-888eb5f245b3 tempest-VolumeQuotaClassesTest-384510210 tempest-VolumeQuotaClassesTest-384510210-project-admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:01.999775 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119386-6581-46ce-8356-d0228f0d55fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:02.000814 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119386-6581-46ce-8356-d0228f0d55fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:02.001199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119386-6581-46ce-8356-d0228f0d55fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:02.001598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119386-6581-46ce-8356-d0228f0d55fa admin admin] PATH_INFO: `/v3/users/888b8fff5051481f92f811008c9f4a6a` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:02.002949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a119386-6581-46ce-8356-d0228f0d55fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=888b8fff5051481f92f811008c9f4a6a)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:02.015622 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a119386-6581-46ce-8356-d0228f0d55fa admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:02.074617 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-9a119386-6581-46ce-8356-d0228f0d55fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888b8fff5051481f92f811008c9f4a6a'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:02.086805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-9a119386-6581-46ce-8356-d0228f0d55fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888b8fff5051481f92f811008c9f4a6a'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:02.097219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-9a119386-6581-46ce-8356-d0228f0d55fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888b8fff5051481f92f811008c9f4a6a'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:02.106773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-9a119386-6581-46ce-8356-d0228f0d55fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888b8fff5051481f92f811008c9f4a6a'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:02.107533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-9a119386-6581-46ce-8356-d0228f0d55fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888b8fff5051481f92f811008c9f4a6a'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:02.122054 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1170/2358] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:35:01 2021] DELETE /identity/v3/users/888b8fff5051481f92f811008c9f4a6a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:02.124787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bcc76-f502-4d14-8adf-7462bda6af58 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:02.125686 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bcc76-f502-4d14-8adf-7462bda6af58 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:02.126188 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bcc76-f502-4d14-8adf-7462bda6af58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:02.152690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-931bcc76-f502-4d14-8adf-7462bda6af58 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:02.154191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-931bcc76-f502-4d14-8adf-7462bda6af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:02.240460 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1189/2359] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:35:02.241636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119386-6581-46ce-8356-d0228f0d55fa admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:02.243130 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9a119386-6581-46ce-8356-d0228f0d55fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:02.306881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119386-6581-46ce-8356-d0228f0d55fa admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:02.311735 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab5a82-ddd4-420e-8a92-d66ea860a331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:02.312379 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab5a82-ddd4-420e-8a92-d66ea860a331 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:02.312663 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab5a82-ddd4-420e-8a92-d66ea860a331 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:02.313096 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab5a82-ddd4-420e-8a92-d66ea860a331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:02.327689 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab5a82-ddd4-420e-8a92-d66ea860a331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:02.329267 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab5a82-ddd4-420e-8a92-d66ea860a331 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:02.340111 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1171/2360] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:35:02.773920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bcc76-f502-4d14-8adf-7462bda6af58 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:02.775537 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-931bcc76-f502-4d14-8adf-7462bda6af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:02.793099 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bcc76-f502-4d14-8adf-7462bda6af58 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:02.814810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:02.816019 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:02.816485 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:02.816928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] PATH_INFO: `/v3/projects/7f94b273ab374ac7a1396332ff49865e` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:02.818985 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f94b273ab374ac7a1396332ff49865e)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:02.821274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:02.912601 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f94b273ab374ac7a1396332ff49865e', 'request_id': 'req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:02.923065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f94b273ab374ac7a1396332ff49865e', 'request_id': 'req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:02.929846 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f94b273ab374ac7a1396332ff49865e', 'request_id': 'req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:02.941351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] The token cache is being invalidate because project 7f94b273ab374ac7a1396332ff49865e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:35:02.941637 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:02.942303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:02.946932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1190/2361] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:35:02 2021] DELETE /identity/v3/projects/7f94b273ab374ac7a1396332ff49865e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:02.948216 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab5a82-ddd4-420e-8a92-d66ea860a331 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:02.958392 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab5a82-ddd4-420e-8a92-d66ea860a331 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:03.026073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52616509-3056-46d5-8238-26327a0f1aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:03.027318 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52616509-3056-46d5-8238-26327a0f1aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:03.027607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52616509-3056-46d5-8238-26327a0f1aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:03.027879 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52616509-3056-46d5-8238-26327a0f1aa6 admin admin] PATH_INFO: `/v3/users/2781b4cef2094f4bacf2d710d8aed996` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:03.029115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52616509-3056-46d5-8238-26327a0f1aa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2781b4cef2094f4bacf2d710d8aed996)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:03.031084 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52616509-3056-46d5-8238-26327a0f1aa6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:03.088705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-52616509-3056-46d5-8238-26327a0f1aa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2781b4cef2094f4bacf2d710d8aed996'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:03.106782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-52616509-3056-46d5-8238-26327a0f1aa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2781b4cef2094f4bacf2d710d8aed996'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:03.121504 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-52616509-3056-46d5-8238-26327a0f1aa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2781b4cef2094f4bacf2d710d8aed996'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:03.129060 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-52616509-3056-46d5-8238-26327a0f1aa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2781b4cef2094f4bacf2d710d8aed996'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:03.129759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-52616509-3056-46d5-8238-26327a0f1aa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2781b4cef2094f4bacf2d710d8aed996'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:03.136578 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1172/2362] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:35:02 2021] DELETE /identity/v3/users/2781b4cef2094f4bacf2d710d8aed996 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:03.472221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:03.473663 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:03.490278 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5684000-f4f0-4ab5-bbc8-f19c4bac2a86 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:03.558688 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a69a38-1e79-421a-a633-d671971f170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:03.559764 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a69a38-1e79-421a-a633-d671971f170c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:03.560053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a69a38-1e79-421a-a633-d671971f170c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:03.560335 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a69a38-1e79-421a-a633-d671971f170c admin admin] PATH_INFO: `/v3/projects/46069caea390461bbdc479963bd9a8b9` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:03.561833 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a69a38-1e79-421a-a633-d671971f170c admin admin] RBAC: Authorizing `identity:delete_project(project_id=46069caea390461bbdc479963bd9a8b9)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:03.563830 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a69a38-1e79-421a-a633-d671971f170c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:03.645168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-14a69a38-1e79-421a-a633-d671971f170c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46069caea390461bbdc479963bd9a8b9', 'request_id': 'req-14a69a38-1e79-421a-a633-d671971f170c'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:03.665619 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-14a69a38-1e79-421a-a633-d671971f170c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46069caea390461bbdc479963bd9a8b9', 'request_id': 'req-14a69a38-1e79-421a-a633-d671971f170c'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:03.674262 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-14a69a38-1e79-421a-a633-d671971f170c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46069caea390461bbdc479963bd9a8b9', 'request_id': 'req-14a69a38-1e79-421a-a633-d671971f170c'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:03.686487 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-14a69a38-1e79-421a-a633-d671971f170c admin admin] The token cache is being invalidate because project 46069caea390461bbdc479963bd9a8b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:35:03.686783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-14a69a38-1e79-421a-a633-d671971f170c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:03.689196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-14a69a38-1e79-421a-a633-d671971f170c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:03.695438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1191/2363] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:35:03 2021] DELETE /identity/v3/projects/46069caea390461bbdc479963bd9a8b9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:03.697930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f205f0-343c-457e-8b3b-21da17e4c434 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:03.698258 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f205f0-343c-457e-8b3b-21da17e4c434 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:03.698545 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f205f0-343c-457e-8b3b-21da17e4c434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:03.731705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-26f205f0-343c-457e-8b3b-21da17e4c434 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:03.733066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-26f205f0-343c-457e-8b3b-21da17e4c434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:03.809020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1173/2364] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:03.816724 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361a2f4-5ae5-483f-a551-5ec3ff40498b None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:03.817013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361a2f4-5ae5-483f-a551-5ec3ff40498b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:03.817288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361a2f4-5ae5-483f-a551-5ec3ff40498b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:03.836467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-5361a2f4-5ae5-483f-a551-5ec3ff40498b None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:03.837665 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5361a2f4-5ae5-483f-a551-5ec3ff40498b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:03.848744 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1192/2365] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:03.850020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f205f0-343c-457e-8b3b-21da17e4c434 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:03.863133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f205f0-343c-457e-8b3b-21da17e4c434 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:03.867737 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648b401-1004-4187-9ca7-add2e4966da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:03.868600 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648b401-1004-4187-9ca7-add2e4966da2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:03.868889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648b401-1004-4187-9ca7-add2e4966da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:03.869979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648b401-1004-4187-9ca7-add2e4966da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:03.870727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648b401-1004-4187-9ca7-add2e4966da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:35:03.871091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648b401-1004-4187-9ca7-add2e4966da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:03.872763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648b401-1004-4187-9ca7-add2e4966da2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:03.890898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1174/2366] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:35:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:35:03.893462 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361a2f4-5ae5-483f-a551-5ec3ff40498b None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:03.903320 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361a2f4-5ae5-483f-a551-5ec3ff40498b None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:03.908516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f652092-f8c4-411b-95e6-da3d2d64bf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:03.909588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f652092-f8c4-411b-95e6-da3d2d64bf42 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:03.909874 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f652092-f8c4-411b-95e6-da3d2d64bf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:03.910153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f652092-f8c4-411b-95e6-da3d2d64bf42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:03.910906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f652092-f8c4-411b-95e6-da3d2d64bf42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:03.912817 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f652092-f8c4-411b-95e6-da3d2d64bf42 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:03.943794 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1193/2367] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:35:03 2021] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:35:03.948821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648b401-1004-4187-9ca7-add2e4966da2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:03.964420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648b401-1004-4187-9ca7-add2e4966da2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:04.042421 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6340a-f2ef-4f38-aad3-3960fe2c7e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:04.043150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6340a-f2ef-4f38-aad3-3960fe2c7e28 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:04.043438 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6340a-f2ef-4f38-aad3-3960fe2c7e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:04.043715 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6340a-f2ef-4f38-aad3-3960fe2c7e28 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:04.044445 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6340a-f2ef-4f38-aad3-3960fe2c7e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:04.046385 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6340a-f2ef-4f38-aad3-3960fe2c7e28 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:04.082630 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1175/2368] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:35:03 2021] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:35:04.086583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f652092-f8c4-411b-95e6-da3d2d64bf42 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:04.101543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f652092-f8c4-411b-95e6-da3d2d64bf42 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:04.107527 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c5207-74e5-4faa-a030-7d3ec7cf222d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:04.108403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c5207-74e5-4faa-a030-7d3ec7cf222d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:04.108810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c5207-74e5-4faa-a030-7d3ec7cf222d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:04.109190 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c5207-74e5-4faa-a030-7d3ec7cf222d admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:04.110060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c5207-74e5-4faa-a030-7d3ec7cf222d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:04.111829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c5207-74e5-4faa-a030-7d3ec7cf222d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:04.126371 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1194/2369] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:04 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:35:04.127790 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6340a-f2ef-4f38-aad3-3960fe2c7e28 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:04.141358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6340a-f2ef-4f38-aad3-3960fe2c7e28 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:04.148237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c2f9c-75be-48a2-bfa2-d888483ff971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:04.149254 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c2f9c-75be-48a2-bfa2-d888483ff971 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:04.149645 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c2f9c-75be-48a2-bfa2-d888483ff971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:04.150032 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c2f9c-75be-48a2-bfa2-d888483ff971 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:04.151571 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c2f9c-75be-48a2-bfa2-d888483ff971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:04.153404 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c2f9c-75be-48a2-bfa2-d888483ff971 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:04.164733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1176/2370] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:04 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:35:04.169300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c5207-74e5-4faa-a030-7d3ec7cf222d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:04.182437 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c5207-74e5-4faa-a030-7d3ec7cf222d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:04.187371 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a185c-4b15-46cf-9141-bd94a348ce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:04.188384 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a185c-4b15-46cf-9141-bd94a348ce38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:04.188757 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a185c-4b15-46cf-9141-bd94a348ce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:04.189105 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a185c-4b15-46cf-9141-bd94a348ce38 admin admin] PATH_INFO: `/v3/projects/9dd551cf87a2417489d01d555723f025/users/113e1ac33bb748b78b4ae803fa0cc925/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:04.209747 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a185c-4b15-46cf-9141-bd94a348ce38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd551cf87a2417489d01d555723f025, user_id=113e1ac33bb748b78b4ae803fa0cc925, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:04.212579 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a185c-4b15-46cf-9141-bd94a348ce38 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:04.227794 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1195/2371] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:35:04 2021] PUT /identity/v3/projects/9dd551cf87a2417489d01d555723f025/users/113e1ac33bb748b78b4ae803fa0cc925/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:04.239457 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1f7a-9f2f-4512-ba21-526bf6571398 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:04.239888 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1f7a-9f2f-4512-ba21-526bf6571398 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:04.240266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1f7a-9f2f-4512-ba21-526bf6571398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:04.270325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-6e2d1f7a-9f2f-4512-ba21-526bf6571398 None None] MFA Rules not processed for user `113e1ac33bb748b78b4ae803fa0cc925`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:04.271744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-6e2d1f7a-9f2f-4512-ba21-526bf6571398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:04.351355 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1177/2372] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:04 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:04.360742 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a185c-4b15-46cf-9141-bd94a348ce38 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:04.362715 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-4d0a185c-4b15-46cf-9141-bd94a348ce38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:04.500185 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a185c-4b15-46cf-9141-bd94a348ce38 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:04.504540 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f66d8-f014-4830-ae99-e4986bed3ad2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9aff45fefe408fa1667e5298f8ff6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:04.505493 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f66d8-f014-4830-ae99-e4986bed3ad2 service glance] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:04.505766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f66d8-f014-4830-ae99-e4986bed3ad2 service glance] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:04.506052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f66d8-f014-4830-ae99-e4986bed3ad2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:04.517678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f66d8-f014-4830-ae99-e4986bed3ad2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:04.519798 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f66d8-f014-4830-ae99-e4986bed3ad2 service glance] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:04.533526 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1196/2373] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:04 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:13.723185 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d7425-4fb0-4ba5-ac87-af011a76c750 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:13.723779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d7425-4fb0-4ba5-ac87-af011a76c750 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:13.723897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d7425-4fb0-4ba5-ac87-af011a76c750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:13.742146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-674d7425-4fb0-4ba5-ac87-af011a76c750 None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:13.743542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-674d7425-4fb0-4ba5-ac87-af011a76c750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:13.815837 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1178/2374] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:35:13 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:13.831862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f66d8-f014-4830-ae99-e4986bed3ad2 service glance] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:13.833395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-114f66d8-f014-4830-ae99-e4986bed3ad2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:13.909128 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f66d8-f014-4830-ae99-e4986bed3ad2 service glance] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:13.914009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e4976-6e3e-4f6d-a62d-19010b02a171 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:13.914651 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e4976-6e3e-4f6d-a62d-19010b02a171 service swift] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:13.914962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e4976-6e3e-4f6d-a62d-19010b02a171 service swift] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:13.915238 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e4976-6e3e-4f6d-a62d-19010b02a171 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:13.923491 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e4976-6e3e-4f6d-a62d-19010b02a171 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:13.925057 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e4976-6e3e-4f6d-a62d-19010b02a171 service swift] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:13.933352 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1197/2375] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:35:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:35:24.334108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7b473-0b0b-4aba-b086-1b67319b89d9 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:24.334671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7b473-0b0b-4aba-b086-1b67319b89d9 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:24.334671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7b473-0b0b-4aba-b086-1b67319b89d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:24.352021 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-30a7b473-0b0b-4aba-b086-1b67319b89d9 None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:24.353210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-30a7b473-0b0b-4aba-b086-1b67319b89d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:24.360255 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1179/2376] 10.222.0.60 () {58 vars in 967 bytes} [Wed Dec 15 13:35:24 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:35:24.374116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e4976-6e3e-4f6d-a62d-19010b02a171 service swift] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:24.385024 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e4976-6e3e-4f6d-a62d-19010b02a171 service swift] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:24.390182 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c6972-5dc2-4541-a1d2-39aca4095ddc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:24.390816 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c6972-5dc2-4541-a1d2-39aca4095ddc service swift] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:24.391130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c6972-5dc2-4541-a1d2-39aca4095ddc service swift] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:24.391407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c6972-5dc2-4541-a1d2-39aca4095ddc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:24.399483 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c6972-5dc2-4541-a1d2-39aca4095ddc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:24.401099 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c6972-5dc2-4541-a1d2-39aca4095ddc service swift] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:24.408860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1198/2377] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:35:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:35:26.358681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7b473-0b0b-4aba-b086-1b67319b89d9 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:26.360765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-30a7b473-0b0b-4aba-b086-1b67319b89d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:26.434126 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7b473-0b0b-4aba-b086-1b67319b89d9 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:26.438700 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295b196-6b3c-435d-af5d-4cf1635b6600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:26.439607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b196-6b3c-435d-af5d-4cf1635b6600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:26.439894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b196-6b3c-435d-af5d-4cf1635b6600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:26.440175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b196-6b3c-435d-af5d-4cf1635b6600 admin admin] PATH_INFO: `/v3/users/a52a2c8071134b07bdc222088246a671` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:26.441450 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295b196-6b3c-435d-af5d-4cf1635b6600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a52a2c8071134b07bdc222088246a671)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:26.443503 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295b196-6b3c-435d-af5d-4cf1635b6600 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:26.492123 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8295b196-6b3c-435d-af5d-4cf1635b6600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a52a2c8071134b07bdc222088246a671'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:26.504534 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8295b196-6b3c-435d-af5d-4cf1635b6600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a52a2c8071134b07bdc222088246a671'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:26.512550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8295b196-6b3c-435d-af5d-4cf1635b6600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a52a2c8071134b07bdc222088246a671'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:26.519556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8295b196-6b3c-435d-af5d-4cf1635b6600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a52a2c8071134b07bdc222088246a671'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:26.520211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8295b196-6b3c-435d-af5d-4cf1635b6600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a52a2c8071134b07bdc222088246a671'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:26.526675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1180/2378] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:35:26 2021] DELETE /identity/v3/users/a52a2c8071134b07bdc222088246a671 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:26.692883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c6972-5dc2-4541-a1d2-39aca4095ddc service swift] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:26.705992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c6972-5dc2-4541-a1d2-39aca4095ddc service swift] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:26.762903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:26.763769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:26.764052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:26.764329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6 admin admin] PATH_INFO: `/v3/projects/050149bd93864d2abd0b342b8062d3d5` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:26.765562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=050149bd93864d2abd0b342b8062d3d5)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:26.767607 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:26.812505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050149bd93864d2abd0b342b8062d3d5', 'request_id': 'req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:26.819070 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050149bd93864d2abd0b342b8062d3d5', 'request_id': 'req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:26.825999 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050149bd93864d2abd0b342b8062d3d5', 'request_id': 'req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:26.835765 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6 admin admin] The token cache is being invalidate because project 050149bd93864d2abd0b342b8062d3d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:35:26.836052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:26.836700 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-be0a36f8-7ce9-4f9c-a1e8-f4724a89f5e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:26.838285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1199/2379] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:35:26 2021] DELETE /identity/v3/projects/050149bd93864d2abd0b342b8062d3d5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:26.843985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552c469-857a-4bd6-a093-1b4b152239d8 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:26.844271 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552c469-857a-4bd6-a093-1b4b152239d8 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:26.844557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552c469-857a-4bd6-a093-1b4b152239d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:26.861897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-5552c469-857a-4bd6-a093-1b4b152239d8 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:26.863139 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5552c469-857a-4bd6-a093-1b4b152239d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:26.920143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1181/2380] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:26.927689 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2ee40-f517-4fd7-bc54-e891151e707e None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:26.927983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2ee40-f517-4fd7-bc54-e891151e707e None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:26.928270 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2ee40-f517-4fd7-bc54-e891151e707e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:26.946992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-7ed2ee40-f517-4fd7-bc54-e891151e707e None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:26.948196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-7ed2ee40-f517-4fd7-bc54-e891151e707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:26.956015 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1200/2381] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:26.959974 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552c469-857a-4bd6-a093-1b4b152239d8 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:26.969313 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552c469-857a-4bd6-a093-1b4b152239d8 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:26.973886 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c718a-1f49-4c66-a0d6-d7baa0c8f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:26.974528 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c718a-1f49-4c66-a0d6-d7baa0c8f5da admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:26.974815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c718a-1f49-4c66-a0d6-d7baa0c8f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:26.975147 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c718a-1f49-4c66-a0d6-d7baa0c8f5da admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:26.975865 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c718a-1f49-4c66-a0d6-d7baa0c8f5da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:35:26.976178 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c718a-1f49-4c66-a0d6-d7baa0c8f5da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:26.977816 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c718a-1f49-4c66-a0d6-d7baa0c8f5da admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:26.989946 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1182/2382] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:35:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:35:26.994651 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2ee40-f517-4fd7-bc54-e891151e707e None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:27.003651 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2ee40-f517-4fd7-bc54-e891151e707e None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:27.008364 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d4248-5e25-452a-8a7a-a2be87094a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:27.009007 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d4248-5e25-452a-8a7a-a2be87094a6e admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:27.009291 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d4248-5e25-452a-8a7a-a2be87094a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:27.009600 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d4248-5e25-452a-8a7a-a2be87094a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:27.010306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d4248-5e25-452a-8a7a-a2be87094a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:27.012281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d4248-5e25-452a-8a7a-a2be87094a6e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:27.036534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1201/2383] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:35:26 2021] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:35:27.040622 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c718a-1f49-4c66-a0d6-d7baa0c8f5da admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:27.051055 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c718a-1f49-4c66-a0d6-d7baa0c8f5da admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:27.104542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b1e38-1722-4763-a731-23493ad6943f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:27.105202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b1e38-1722-4763-a731-23493ad6943f admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:27.105489 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b1e38-1722-4763-a731-23493ad6943f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:27.105772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b1e38-1722-4763-a731-23493ad6943f admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:27.106479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b1e38-1722-4763-a731-23493ad6943f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:27.108432 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b1e38-1722-4763-a731-23493ad6943f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:27.128171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1183/2384] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:35:27 2021] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:35:27.132261 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d4248-5e25-452a-8a7a-a2be87094a6e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:27.142329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d4248-5e25-452a-8a7a-a2be87094a6e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:27.147116 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c900528-df69-4c61-93e4-e5df83c82453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:27.147762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c900528-df69-4c61-93e4-e5df83c82453 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:27.148048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c900528-df69-4c61-93e4-e5df83c82453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:27.148443 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c900528-df69-4c61-93e4-e5df83c82453 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:27.149267 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c900528-df69-4c61-93e4-e5df83c82453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:27.150910 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c900528-df69-4c61-93e4-e5df83c82453 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:27.161112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1202/2385] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:27 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:35:27.164850 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b1e38-1722-4763-a731-23493ad6943f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:27.174994 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b1e38-1722-4763-a731-23493ad6943f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:27.179635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40e281-8a69-4727-9b7a-8f1d835359bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:27.180276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40e281-8a69-4727-9b7a-8f1d835359bd admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:27.180558 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40e281-8a69-4727-9b7a-8f1d835359bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:27.180839 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40e281-8a69-4727-9b7a-8f1d835359bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:27.182221 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40e281-8a69-4727-9b7a-8f1d835359bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:27.183855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40e281-8a69-4727-9b7a-8f1d835359bd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:27.193656 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1184/2386] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:27 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:35:27.197476 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c900528-df69-4c61-93e4-e5df83c82453 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:27.206967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c900528-df69-4c61-93e4-e5df83c82453 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:27.211512 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8fe22-5dd8-4ddb-a125-e89f56af09cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:27.212357 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8fe22-5dd8-4ddb-a125-e89f56af09cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:27.212680 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8fe22-5dd8-4ddb-a125-e89f56af09cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:27.212957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8fe22-5dd8-4ddb-a125-e89f56af09cd admin admin] PATH_INFO: `/v3/projects/3e48482797da42b0a9baccb4fdd73e84/users/36294768833043cebd4d4c8050eeef29/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:27.226826 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8fe22-5dd8-4ddb-a125-e89f56af09cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e48482797da42b0a9baccb4fdd73e84, user_id=36294768833043cebd4d4c8050eeef29, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:27.230051 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8fe22-5dd8-4ddb-a125-e89f56af09cd admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:27.242345 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1203/2387] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:35:27 2021] PUT /identity/v3/projects/3e48482797da42b0a9baccb4fdd73e84/users/36294768833043cebd4d4c8050eeef29/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:27.255467 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc17ab-dd24-4557-9307-b31678bcab72 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:27.255762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc17ab-dd24-4557-9307-b31678bcab72 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:27.256188 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc17ab-dd24-4557-9307-b31678bcab72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:27.282143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-3bdc17ab-dd24-4557-9307-b31678bcab72 None None] MFA Rules not processed for user `36294768833043cebd4d4c8050eeef29`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:27.283375 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-3bdc17ab-dd24-4557-9307-b31678bcab72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:27.347434 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1185/2388] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:27 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:27.360285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8fe22-5dd8-4ddb-a125-e89f56af09cd admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:27.361978 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a0f8fe22-5dd8-4ddb-a125-e89f56af09cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:27.420943 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8fe22-5dd8-4ddb-a125-e89f56af09cd admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:27.424618 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbb674-8505-49b7-b122-58d382dec022 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9aff45fefe408fa1667e5298f8ff6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:27.425256 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbb674-8505-49b7-b122-58d382dec022 service glance] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:27.425542 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbb674-8505-49b7-b122-58d382dec022 service glance] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:27.425823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbb674-8505-49b7-b122-58d382dec022 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:27.433978 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbb674-8505-49b7-b122-58d382dec022 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:27.435470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbb674-8505-49b7-b122-58d382dec022 service glance] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:27.444040 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1204/2389] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:27 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:35.312481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcc935-5012-4d42-9a40-bb2d2ea194bb None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:35.313053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcc935-5012-4d42-9a40-bb2d2ea194bb None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:35.313053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcc935-5012-4d42-9a40-bb2d2ea194bb None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:35.315180 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1186/2390] 10.222.0.60 () {54 vars in 921 bytes} [Wed Dec 15 13:35:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:35:35.322018 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf9421-1446-445a-9297-4003d2a15f37 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:35.322487 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf9421-1446-445a-9297-4003d2a15f37 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:35.322588 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf9421-1446-445a-9297-4003d2a15f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:35.377016 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-cdbf9421-1446-445a-9297-4003d2a15f37 None None] MFA Rules not processed for user `d61a8e4d64664e68a5710fdf766e4685`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:35.378248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-cdbf9421-1446-445a-9297-4003d2a15f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:35.467130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1205/2391] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Dec 15 13:35:35 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:35.480589 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcc935-5012-4d42-9a40-bb2d2ea194bb None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:35.482375 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-6ebcc935-5012-4d42-9a40-bb2d2ea194bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:35.498563 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcc935-5012-4d42-9a40-bb2d2ea194bb None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:35.502155 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0bcc3-0a89-44c3-924b-c3152e3c6b99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9aff45fefe408fa1667e5298f8ff6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:35.502799 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0bcc3-0a89-44c3-924b-c3152e3c6b99 service glance] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:35.503115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0bcc3-0a89-44c3-924b-c3152e3c6b99 service glance] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:35.503394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0bcc3-0a89-44c3-924b-c3152e3c6b99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:35.513183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0bcc3-0a89-44c3-924b-c3152e3c6b99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:35.514617 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0bcc3-0a89-44c3-924b-c3152e3c6b99 service glance] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:35.525410 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1187/2392] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:35 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:35.593227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3693229-d587-4da0-81de-a61d92ea509f None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:35.593653 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3693229-d587-4da0-81de-a61d92ea509f None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:35.593937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3693229-d587-4da0-81de-a61d92ea509f None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:35.595791 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1206/2393] 10.222.0.60 () {54 vars in 921 bytes} [Wed Dec 15 13:35:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:35:35.601169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c15eb5-d2ca-4291-83cc-cae00adda0b5 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:35.601452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c15eb5-d2ca-4291-83cc-cae00adda0b5 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:35.601729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c15eb5-d2ca-4291-83cc-cae00adda0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:35.637516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-44c15eb5-d2ca-4291-83cc-cae00adda0b5 None None] MFA Rules not processed for user `c9a44a13e31941b5af9579d8bec345ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:35.638657 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-44c15eb5-d2ca-4291-83cc-cae00adda0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:35.691742 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1188/2394] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Dec 15 13:35:35 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:35:35.704844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3693229-d587-4da0-81de-a61d92ea509f None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:35.707078 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b3693229-d587-4da0-81de-a61d92ea509f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:35.720616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3693229-d587-4da0-81de-a61d92ea509f None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:35.724134 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32e44b-369a-4538-bedc-71b72d9f43de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:35.724770 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32e44b-369a-4538-bedc-71b72d9f43de service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:35.725051 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32e44b-369a-4538-bedc-71b72d9f43de service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:35.725424 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32e44b-369a-4538-bedc-71b72d9f43de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:35.732928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32e44b-369a-4538-bedc-71b72d9f43de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:35.734352 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32e44b-369a-4538-bedc-71b72d9f43de service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:35.742062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1207/2395] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:35 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:37.155259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c15eb5-d2ca-4291-83cc-cae00adda0b5 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:37.156915 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-44c15eb5-d2ca-4291-83cc-cae00adda0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:37.218523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c15eb5-d2ca-4291-83cc-cae00adda0b5 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:37.222952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e7fd3-98f6-4e01-8816-44fa88fc25be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:37.223792 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e7fd3-98f6-4e01-8816-44fa88fc25be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:37.224071 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e7fd3-98f6-4e01-8816-44fa88fc25be admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:37.224343 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e7fd3-98f6-4e01-8816-44fa88fc25be admin admin] PATH_INFO: `/v3/users/9959ed1dd75a44b1bc73a74616858838` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:37.225534 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e7fd3-98f6-4e01-8816-44fa88fc25be admin admin] RBAC: Authorizing `identity:delete_user(user_id=9959ed1dd75a44b1bc73a74616858838)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:37.227477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e7fd3-98f6-4e01-8816-44fa88fc25be admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:37.279511 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-196e7fd3-98f6-4e01-8816-44fa88fc25be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9959ed1dd75a44b1bc73a74616858838'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:37.292889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-196e7fd3-98f6-4e01-8816-44fa88fc25be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9959ed1dd75a44b1bc73a74616858838'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:37.301787 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-196e7fd3-98f6-4e01-8816-44fa88fc25be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9959ed1dd75a44b1bc73a74616858838'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:37.309363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-196e7fd3-98f6-4e01-8816-44fa88fc25be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9959ed1dd75a44b1bc73a74616858838'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:37.309996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-196e7fd3-98f6-4e01-8816-44fa88fc25be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9959ed1dd75a44b1bc73a74616858838'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:37.315806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1189/2396] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:35:37 2021] DELETE /identity/v3/users/9959ed1dd75a44b1bc73a74616858838 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:37.320656 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053d62-0a19-441c-98d5-a84933fcf42a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:37.321126 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053d62-0a19-441c-98d5-a84933fcf42a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:37.321312 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053d62-0a19-441c-98d5-a84933fcf42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:37.339712 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-29053d62-0a19-441c-98d5-a84933fcf42a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:37.340913 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-29053d62-0a19-441c-98d5-a84933fcf42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:37.408761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1208/2397] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:35:37.421119 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e7fd3-98f6-4e01-8816-44fa88fc25be admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:37.423619 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-196e7fd3-98f6-4e01-8816-44fa88fc25be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:37.481733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e7fd3-98f6-4e01-8816-44fa88fc25be admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:37.485458 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f67e1-3512-4af6-a06c-87135c984fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:37.486105 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f67e1-3512-4af6-a06c-87135c984fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:37.486389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f67e1-3512-4af6-a06c-87135c984fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:37.486667 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f67e1-3512-4af6-a06c-87135c984fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:37.496121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f67e1-3512-4af6-a06c-87135c984fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:37.497604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f67e1-3512-4af6-a06c-87135c984fe3 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:37.507420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1190/2398] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:35:37.883535 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29053d62-0a19-441c-98d5-a84933fcf42a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:37.885151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-29053d62-0a19-441c-98d5-a84933fcf42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:37.902283 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29053d62-0a19-441c-98d5-a84933fcf42a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:37.909223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db88e9-9f80-4893-8eeb-205ba8026938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:37.910441 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db88e9-9f80-4893-8eeb-205ba8026938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:37.911074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db88e9-9f80-4893-8eeb-205ba8026938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:37.911538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db88e9-9f80-4893-8eeb-205ba8026938 admin admin] PATH_INFO: `/v3/projects/cc22190957f74695909a1e9eac363c3c` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:37.912928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db88e9-9f80-4893-8eeb-205ba8026938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc22190957f74695909a1e9eac363c3c)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:37.915040 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db88e9-9f80-4893-8eeb-205ba8026938 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:37.981258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-33db88e9-9f80-4893-8eeb-205ba8026938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc22190957f74695909a1e9eac363c3c', 'request_id': 'req-33db88e9-9f80-4893-8eeb-205ba8026938'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:37.988717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-33db88e9-9f80-4893-8eeb-205ba8026938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc22190957f74695909a1e9eac363c3c', 'request_id': 'req-33db88e9-9f80-4893-8eeb-205ba8026938'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:37.995714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-33db88e9-9f80-4893-8eeb-205ba8026938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc22190957f74695909a1e9eac363c3c', 'request_id': 'req-33db88e9-9f80-4893-8eeb-205ba8026938'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:38.006076 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-33db88e9-9f80-4893-8eeb-205ba8026938 admin admin] The token cache is being invalidate because project cc22190957f74695909a1e9eac363c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:35:38.006486 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-33db88e9-9f80-4893-8eeb-205ba8026938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:38.007159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-33db88e9-9f80-4893-8eeb-205ba8026938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:38.008668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1209/2399] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:35:37 2021] DELETE /identity/v3/projects/cc22190957f74695909a1e9eac363c3c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:38.012479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f67e1-3512-4af6-a06c-87135c984fe3 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:38.022026 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f67e1-3512-4af6-a06c-87135c984fe3 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:38.079635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae896507-9eea-48bb-b746-ac379e4777fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:38.080722 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae896507-9eea-48bb-b746-ac379e4777fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:38.081081 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae896507-9eea-48bb-b746-ac379e4777fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:38.081384 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae896507-9eea-48bb-b746-ac379e4777fc admin admin] PATH_INFO: `/v3/users/9726d7d14dee4bc1b11545dd7aeb8fef` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:38.083416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae896507-9eea-48bb-b746-ac379e4777fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9726d7d14dee4bc1b11545dd7aeb8fef)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:38.085375 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae896507-9eea-48bb-b746-ac379e4777fc admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:38.130744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ae896507-9eea-48bb-b746-ac379e4777fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9726d7d14dee4bc1b11545dd7aeb8fef'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:38.143033 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ae896507-9eea-48bb-b746-ac379e4777fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9726d7d14dee4bc1b11545dd7aeb8fef'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:38.150219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ae896507-9eea-48bb-b746-ac379e4777fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9726d7d14dee4bc1b11545dd7aeb8fef'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:38.157819 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ae896507-9eea-48bb-b746-ac379e4777fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9726d7d14dee4bc1b11545dd7aeb8fef'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:38.158490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ae896507-9eea-48bb-b746-ac379e4777fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9726d7d14dee4bc1b11545dd7aeb8fef'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:38.164563 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1191/2400] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:35:38 2021] DELETE /identity/v3/users/9726d7d14dee4bc1b11545dd7aeb8fef => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:38.192419 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caa791-79b6-41ba-b748-294111066282 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:38.192708 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caa791-79b6-41ba-b748-294111066282 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:38.192989 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caa791-79b6-41ba-b748-294111066282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:38.213778 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-c1caa791-79b6-41ba-b748-294111066282 None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:38.216062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c1caa791-79b6-41ba-b748-294111066282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:38.280123 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1210/2401] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:35:38 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:38.293453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae896507-9eea-48bb-b746-ac379e4777fc admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:38.294990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ae896507-9eea-48bb-b746-ac379e4777fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:38.380167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae896507-9eea-48bb-b746-ac379e4777fc admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:38.385443 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3007f-be24-46ad-bd70-fc0f43b5a6a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:38.386696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3007f-be24-46ad-bd70-fc0f43b5a6a6 service swift] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:38.387077 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3007f-be24-46ad-bd70-fc0f43b5a6a6 service swift] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:38.387355 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3007f-be24-46ad-bd70-fc0f43b5a6a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:38.396012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3007f-be24-46ad-bd70-fc0f43b5a6a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:38.397768 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3007f-be24-46ad-bd70-fc0f43b5a6a6 service swift] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:38.408842 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1192/2402] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:35:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:35:38.443839 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caa791-79b6-41ba-b748-294111066282 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:38.445601 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c1caa791-79b6-41ba-b748-294111066282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:38.638589 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caa791-79b6-41ba-b748-294111066282 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:38.643540 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f4300-acf6-46b0-bf7b-e702383e05e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:38.644519 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f4300-acf6-46b0-bf7b-e702383e05e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:38.644900 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f4300-acf6-46b0-bf7b-e702383e05e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:38.645505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f4300-acf6-46b0-bf7b-e702383e05e9 admin admin] PATH_INFO: `/v3/projects/f6b1b8943cf84235a8b83e95edc80e18` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:38.647219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f4300-acf6-46b0-bf7b-e702383e05e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b1b8943cf84235a8b83e95edc80e18)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:38.649482 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f4300-acf6-46b0-bf7b-e702383e05e9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:38.702223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6e6f4300-acf6-46b0-bf7b-e702383e05e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b1b8943cf84235a8b83e95edc80e18', 'request_id': 'req-6e6f4300-acf6-46b0-bf7b-e702383e05e9'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:38.709643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6e6f4300-acf6-46b0-bf7b-e702383e05e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b1b8943cf84235a8b83e95edc80e18', 'request_id': 'req-6e6f4300-acf6-46b0-bf7b-e702383e05e9'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:38.715940 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6e6f4300-acf6-46b0-bf7b-e702383e05e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b1b8943cf84235a8b83e95edc80e18', 'request_id': 'req-6e6f4300-acf6-46b0-bf7b-e702383e05e9'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:38.727300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6e6f4300-acf6-46b0-bf7b-e702383e05e9 admin admin] The token cache is being invalidate because project f6b1b8943cf84235a8b83e95edc80e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:35:38.727597 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6e6f4300-acf6-46b0-bf7b-e702383e05e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:38.728342 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6e6f4300-acf6-46b0-bf7b-e702383e05e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:38.729914 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1211/2403] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:35:38 2021] DELETE /identity/v3/projects/f6b1b8943cf84235a8b83e95edc80e18 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:38.738257 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1329d8b-6697-4293-bc50-3e7b787f79c1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:38.738922 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1329d8b-6697-4293-bc50-3e7b787f79c1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:38.739424 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1329d8b-6697-4293-bc50-3e7b787f79c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:38.760367 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-c1329d8b-6697-4293-bc50-3e7b787f79c1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:38.765186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c1329d8b-6697-4293-bc50-3e7b787f79c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:38.836916 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1193/2404] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:38.845976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000720a9-1cef-49a0-9095-31be630a76d7 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:38.846988 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000720a9-1cef-49a0-9095-31be630a76d7 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:38.847452 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000720a9-1cef-49a0-9095-31be630a76d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:38.871300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-000720a9-1cef-49a0-9095-31be630a76d7 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:38.872777 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-000720a9-1cef-49a0-9095-31be630a76d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:38.885485 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1212/2405] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:38.887588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1329d8b-6697-4293-bc50-3e7b787f79c1 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:38.898802 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1329d8b-6697-4293-bc50-3e7b787f79c1 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:38.903727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d3f08-4dd8-477a-8feb-b06c69bf98fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:38.904386 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d3f08-4dd8-477a-8feb-b06c69bf98fa admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:38.904671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d3f08-4dd8-477a-8feb-b06c69bf98fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:38.904950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d3f08-4dd8-477a-8feb-b06c69bf98fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:38.905692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d3f08-4dd8-477a-8feb-b06c69bf98fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:35:38.906003 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d3f08-4dd8-477a-8feb-b06c69bf98fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:38.907693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d3f08-4dd8-477a-8feb-b06c69bf98fa admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:38.923425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1194/2406] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:35:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:35:38.926630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000720a9-1cef-49a0-9095-31be630a76d7 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:38.945338 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000720a9-1cef-49a0-9095-31be630a76d7 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:38.970473 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f4a20-5239-467e-b840-3a9192328d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:38.971189 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4a20-5239-467e-b840-3a9192328d3d admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:38.971474 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4a20-5239-467e-b840-3a9192328d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:38.971835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4a20-5239-467e-b840-3a9192328d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:38.972480 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f4a20-5239-467e-b840-3a9192328d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:38.974378 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f4a20-5239-467e-b840-3a9192328d3d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:39.007630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1213/2407] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:35:38 2021] POST /identity/v3/projects => generated 359 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:35:39.011679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d3f08-4dd8-477a-8feb-b06c69bf98fa admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:39.023422 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d3f08-4dd8-477a-8feb-b06c69bf98fa admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:39.097581 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc4b0c-307e-4708-84e2-7124deeb07d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:39.098596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc4b0c-307e-4708-84e2-7124deeb07d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:39.098962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc4b0c-307e-4708-84e2-7124deeb07d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:39.099322 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc4b0c-307e-4708-84e2-7124deeb07d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:39.107045 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc4b0c-307e-4708-84e2-7124deeb07d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:39.109350 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc4b0c-307e-4708-84e2-7124deeb07d3 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:39.133625 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1195/2408] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:35:39 2021] POST /identity/v3/users => generated 280 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:35:39.141355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f4a20-5239-467e-b840-3a9192328d3d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:39.152619 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f4a20-5239-467e-b840-3a9192328d3d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:39.157844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b460a-ebdc-4da1-a247-de1e8746ac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:39.158534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b460a-ebdc-4da1-a247-de1e8746ac43 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:39.158868 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b460a-ebdc-4da1-a247-de1e8746ac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:39.159136 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b460a-ebdc-4da1-a247-de1e8746ac43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:39.159902 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b460a-ebdc-4da1-a247-de1e8746ac43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:39.161720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b460a-ebdc-4da1-a247-de1e8746ac43 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:39.174280 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1214/2409] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:39 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:35:39.178238 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc4b0c-307e-4708-84e2-7124deeb07d3 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:39.189221 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc4b0c-307e-4708-84e2-7124deeb07d3 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:39.194067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94df81-598d-4c32-83c4-6de327001896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:39.195074 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94df81-598d-4c32-83c4-6de327001896 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:39.195306 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94df81-598d-4c32-83c4-6de327001896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:39.195672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94df81-598d-4c32-83c4-6de327001896 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:39.196363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94df81-598d-4c32-83c4-6de327001896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:39.197965 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94df81-598d-4c32-83c4-6de327001896 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:39.208472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1196/2410] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:39 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:35:39.212717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b460a-ebdc-4da1-a247-de1e8746ac43 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:39.222761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b460a-ebdc-4da1-a247-de1e8746ac43 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:39.227416 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56972f9c-49ec-4bee-90e2-860affc2c5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:39.228281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56972f9c-49ec-4bee-90e2-860affc2c5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:39.228568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56972f9c-49ec-4bee-90e2-860affc2c5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:39.228847 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56972f9c-49ec-4bee-90e2-860affc2c5a7 admin admin] PATH_INFO: `/v3/projects/eee57ce10a314fab90a35d78b1e10958/users/46c9743fa0e64ff0a968210066a15437/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:39.243594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56972f9c-49ec-4bee-90e2-860affc2c5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee57ce10a314fab90a35d78b1e10958, user_id=46c9743fa0e64ff0a968210066a15437, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:39.246901 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56972f9c-49ec-4bee-90e2-860affc2c5a7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:39.260572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1215/2411] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:35:39 2021] PUT /identity/v3/projects/eee57ce10a314fab90a35d78b1e10958/users/46c9743fa0e64ff0a968210066a15437/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:39.271055 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbc654-9a24-4097-bf6c-ef2eeddf948a None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:39.271344 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbc654-9a24-4097-bf6c-ef2eeddf948a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:39.271637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbc654-9a24-4097-bf6c-ef2eeddf948a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:39.300163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-cafbc654-9a24-4097-bf6c-ef2eeddf948a None None] MFA Rules not processed for user `46c9743fa0e64ff0a968210066a15437`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:39.301515 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-cafbc654-9a24-4097-bf6c-ef2eeddf948a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:39.370683 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1197/2412] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:39 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:39.411239 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56972f9c-49ec-4bee-90e2-860affc2c5a7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:39.412988 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-56972f9c-49ec-4bee-90e2-860affc2c5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:39.469582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56972f9c-49ec-4bee-90e2-860affc2c5a7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:39.473271 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b06573-3b24-4c92-90a9-37d97d2706a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:39.473912 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b06573-3b24-4c92-90a9-37d97d2706a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:39.474200 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b06573-3b24-4c92-90a9-37d97d2706a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:39.474482 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b06573-3b24-4c92-90a9-37d97d2706a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:39.483289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b06573-3b24-4c92-90a9-37d97d2706a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:39.484713 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b06573-3b24-4c92-90a9-37d97d2706a2 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:39.494651 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1216/2413] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:39 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:39.510143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbc654-9a24-4097-bf6c-ef2eeddf948a None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:39.575136 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbc654-9a24-4097-bf6c-ef2eeddf948a None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:39.579788 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5c920-cd31-44bc-9025-f3ddd5427e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:39.580691 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5c920-cd31-44bc-9025-f3ddd5427e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:39.580977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5c920-cd31-44bc-9025-f3ddd5427e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:39.581260 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5c920-cd31-44bc-9025-f3ddd5427e3a admin admin] PATH_INFO: `/v3/users/46c9743fa0e64ff0a968210066a15437` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:39.582507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5c920-cd31-44bc-9025-f3ddd5427e3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=46c9743fa0e64ff0a968210066a15437)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:39.584498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5c920-cd31-44bc-9025-f3ddd5427e3a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:39.631778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4cd5c920-cd31-44bc-9025-f3ddd5427e3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46c9743fa0e64ff0a968210066a15437'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:39.645106 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4cd5c920-cd31-44bc-9025-f3ddd5427e3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46c9743fa0e64ff0a968210066a15437'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:39.654789 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4cd5c920-cd31-44bc-9025-f3ddd5427e3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46c9743fa0e64ff0a968210066a15437'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:39.664409 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4cd5c920-cd31-44bc-9025-f3ddd5427e3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46c9743fa0e64ff0a968210066a15437'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:39.665093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4cd5c920-cd31-44bc-9025-f3ddd5427e3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46c9743fa0e64ff0a968210066a15437'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:39.671288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1198/2414] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:35:39 2021] DELETE /identity/v3/users/46c9743fa0e64ff0a968210066a15437 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:39.675889 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc0f65-1ecd-4d8d-86dd-061a297d5084 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:39.676185 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc0f65-1ecd-4d8d-86dd-061a297d5084 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:39.676495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc0f65-1ecd-4d8d-86dd-061a297d5084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:39.696180 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-94dc0f65-1ecd-4d8d-86dd-061a297d5084 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:39.697423 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-94dc0f65-1ecd-4d8d-86dd-061a297d5084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:39.757366 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1217/2415] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:35:39.767643 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5c920-cd31-44bc-9025-f3ddd5427e3a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:39.769050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4cd5c920-cd31-44bc-9025-f3ddd5427e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:39.827889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5c920-cd31-44bc-9025-f3ddd5427e3a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:39.831653 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e412f-5fe0-499b-a693-ba4560f93a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:39.832371 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e412f-5fe0-499b-a693-ba4560f93a50 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:39.832660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e412f-5fe0-499b-a693-ba4560f93a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:39.833054 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e412f-5fe0-499b-a693-ba4560f93a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:39.844647 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e412f-5fe0-499b-a693-ba4560f93a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:39.846105 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e412f-5fe0-499b-a693-ba4560f93a50 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:39.856551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1199/2416] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:40.162649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc0f65-1ecd-4d8d-86dd-061a297d5084 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:40.164196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-94dc0f65-1ecd-4d8d-86dd-061a297d5084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:40.178230 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc0f65-1ecd-4d8d-86dd-061a297d5084 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:40.183476 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:40.184330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:40.184609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:40.184882 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2 admin admin] PATH_INFO: `/v3/projects/eee57ce10a314fab90a35d78b1e10958` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:40.186670 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee57ce10a314fab90a35d78b1e10958)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:40.188815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:40.247149 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee57ce10a314fab90a35d78b1e10958', 'request_id': 'req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:40.254172 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee57ce10a314fab90a35d78b1e10958', 'request_id': 'req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:40.260431 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee57ce10a314fab90a35d78b1e10958', 'request_id': 'req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:40.271969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2 admin admin] The token cache is being invalidate because project eee57ce10a314fab90a35d78b1e10958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:35:40.272194 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:40.272840 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-f8e7ed1c-55aa-4303-99ce-cb7552b3b7c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:40.274386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1218/2417] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:35:40 2021] DELETE /identity/v3/projects/eee57ce10a314fab90a35d78b1e10958 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:40.280209 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029742b3-5cf1-4c05-86a7-b10501f840a1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:40.280720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029742b3-5cf1-4c05-86a7-b10501f840a1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:40.280821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029742b3-5cf1-4c05-86a7-b10501f840a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:40.299596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-029742b3-5cf1-4c05-86a7-b10501f840a1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:40.301112 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-029742b3-5cf1-4c05-86a7-b10501f840a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:40.362990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1200/2418] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:40.372129 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d8193-ffe1-4882-a83f-23edbe358f6d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:40.372445 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d8193-ffe1-4882-a83f-23edbe358f6d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:40.372750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d8193-ffe1-4882-a83f-23edbe358f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:40.392196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-743d8193-ffe1-4882-a83f-23edbe358f6d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:40.393384 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-743d8193-ffe1-4882-a83f-23edbe358f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:40.401414 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1219/2419] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:35:40.405898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029742b3-5cf1-4c05-86a7-b10501f840a1 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:40.418085 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029742b3-5cf1-4c05-86a7-b10501f840a1 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:40.424509 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c02cd-77e1-4d86-872b-f726fb7bef9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:40.425274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c02cd-77e1-4d86-872b-f726fb7bef9e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:40.425662 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c02cd-77e1-4d86-872b-f726fb7bef9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:40.425950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c02cd-77e1-4d86-872b-f726fb7bef9e admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:40.426789 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c02cd-77e1-4d86-872b-f726fb7bef9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:35:40.427229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c02cd-77e1-4d86-872b-f726fb7bef9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:40.429039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c02cd-77e1-4d86-872b-f726fb7bef9e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:40.446205 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1201/2420] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:35:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:35:40.449930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d8193-ffe1-4882-a83f-23edbe358f6d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:40.459927 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d8193-ffe1-4882-a83f-23edbe358f6d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:40.464797 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ac0d2-a51b-464c-a590-3a299007635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:40.465459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ac0d2-a51b-464c-a590-3a299007635a admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:40.465740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ac0d2-a51b-464c-a590-3a299007635a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:40.466016 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ac0d2-a51b-464c-a590-3a299007635a admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:40.466731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ac0d2-a51b-464c-a590-3a299007635a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:40.468657 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ac0d2-a51b-464c-a590-3a299007635a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:40.494737 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1220/2421] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:35:40 2021] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:35:40.499745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c02cd-77e1-4d86-872b-f726fb7bef9e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:40.510617 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c02cd-77e1-4d86-872b-f726fb7bef9e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:40.570430 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de2743-5a8c-467d-8262-4d7c092f2da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:40.571054 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de2743-5a8c-467d-8262-4d7c092f2da2 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:40.571335 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de2743-5a8c-467d-8262-4d7c092f2da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:40.571607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de2743-5a8c-467d-8262-4d7c092f2da2 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:40.572328 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de2743-5a8c-467d-8262-4d7c092f2da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:40.574324 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de2743-5a8c-467d-8262-4d7c092f2da2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:40.593692 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1202/2422] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:35:40 2021] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:35:40.598224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ac0d2-a51b-464c-a590-3a299007635a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:40.608877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ac0d2-a51b-464c-a590-3a299007635a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:40.618441 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1ce30-61bd-4dc4-b59e-d4ed8f78dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:40.622505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ce30-61bd-4dc4-b59e-d4ed8f78dbeb admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:40.622786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ce30-61bd-4dc4-b59e-d4ed8f78dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:40.623104 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ce30-61bd-4dc4-b59e-d4ed8f78dbeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:40.623941 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1ce30-61bd-4dc4-b59e-d4ed8f78dbeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:40.625808 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1ce30-61bd-4dc4-b59e-d4ed8f78dbeb admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:40.642275 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1221/2423] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:40 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:35:40.643817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de2743-5a8c-467d-8262-4d7c092f2da2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:40.657323 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de2743-5a8c-467d-8262-4d7c092f2da2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:40.662070 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ca1d4-5f88-48fb-a01d-2377df4de0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:40.662735 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ca1d4-5f88-48fb-a01d-2377df4de0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:40.663118 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ca1d4-5f88-48fb-a01d-2377df4de0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:40.663399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ca1d4-5f88-48fb-a01d-2377df4de0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:40.664197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ca1d4-5f88-48fb-a01d-2377df4de0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:40.665829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ca1d4-5f88-48fb-a01d-2377df4de0d0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:40.676691 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1203/2424] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:40 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:35:40.680858 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1ce30-61bd-4dc4-b59e-d4ed8f78dbeb admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:40.691401 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1ce30-61bd-4dc4-b59e-d4ed8f78dbeb admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:40.696356 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ac43e-5f24-4434-88ec-6e3199560052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:40.697239 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ac43e-5f24-4434-88ec-6e3199560052 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:40.697523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ac43e-5f24-4434-88ec-6e3199560052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:40.697809 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ac43e-5f24-4434-88ec-6e3199560052 admin admin] PATH_INFO: `/v3/projects/c127c89e1bd24ebfbdba22d49bad8405/users/940503c3fd114bdfbc8feb21303b7742/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:40.712218 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ac43e-5f24-4434-88ec-6e3199560052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c127c89e1bd24ebfbdba22d49bad8405, user_id=940503c3fd114bdfbc8feb21303b7742, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:40.714931 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ac43e-5f24-4434-88ec-6e3199560052 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:40.731332 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1222/2425] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:35:40 2021] PUT /identity/v3/projects/c127c89e1bd24ebfbdba22d49bad8405/users/940503c3fd114bdfbc8feb21303b7742/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:40.742261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7584f-a199-4656-99c7-a93960743bcd None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:40.742261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7584f-a199-4656-99c7-a93960743bcd None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:40.742261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7584f-a199-4656-99c7-a93960743bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:40.769029 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-c4c7584f-a199-4656-99c7-a93960743bcd None None] MFA Rules not processed for user `940503c3fd114bdfbc8feb21303b7742`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:40.770209 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c4c7584f-a199-4656-99c7-a93960743bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:40.836225 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1204/2426] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:40 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:40.840398 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ac43e-5f24-4434-88ec-6e3199560052 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:40.900241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ac43e-5f24-4434-88ec-6e3199560052 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:40.905179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cec1e-6aac-4d6a-acf4-a299258ef396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:40.905869 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cec1e-6aac-4d6a-acf4-a299258ef396 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:40.906195 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cec1e-6aac-4d6a-acf4-a299258ef396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:40.906420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cec1e-6aac-4d6a-acf4-a299258ef396 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:40.907173 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42cec1e-6aac-4d6a-acf4-a299258ef396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:40.909102 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42cec1e-6aac-4d6a-acf4-a299258ef396 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:40.935569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1223/2427] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:35:40 2021] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:35:40.939798 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7584f-a199-4656-99c7-a93960743bcd None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:40.951338 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7584f-a199-4656-99c7-a93960743bcd None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:41.009506 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4f9ab-98cf-4778-802c-0bbe34181e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:41.010184 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4f9ab-98cf-4778-802c-0bbe34181e13 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:41.010580 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4f9ab-98cf-4778-802c-0bbe34181e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:41.011505 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4f9ab-98cf-4778-802c-0bbe34181e13 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:41.012279 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4f9ab-98cf-4778-802c-0bbe34181e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:41.014199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4f9ab-98cf-4778-802c-0bbe34181e13 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:41.039441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1205/2428] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:35:40 2021] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:35:41.041045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cec1e-6aac-4d6a-acf4-a299258ef396 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:41.055491 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cec1e-6aac-4d6a-acf4-a299258ef396 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:41.060963 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67785201-5820-455f-8563-16eec5962f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:41.061728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67785201-5820-455f-8563-16eec5962f9b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:41.062079 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67785201-5820-455f-8563-16eec5962f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:41.062425 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67785201-5820-455f-8563-16eec5962f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:41.063278 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67785201-5820-455f-8563-16eec5962f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:41.065518 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67785201-5820-455f-8563-16eec5962f9b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:41.082665 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1224/2429] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:41 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:35:41.083972 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4f9ab-98cf-4778-802c-0bbe34181e13 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:41.095396 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4f9ab-98cf-4778-802c-0bbe34181e13 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:41.103306 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cf374-c1b2-4f40-8966-fb840e274fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:41.103999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cf374-c1b2-4f40-8966-fb840e274fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:41.104285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cf374-c1b2-4f40-8966-fb840e274fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:41.104594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cf374-c1b2-4f40-8966-fb840e274fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:41.105357 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cf374-c1b2-4f40-8966-fb840e274fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:41.107155 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cf374-c1b2-4f40-8966-fb840e274fe2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:41.118732 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1206/2430] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:41 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:35:41.123887 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67785201-5820-455f-8563-16eec5962f9b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:41.134556 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67785201-5820-455f-8563-16eec5962f9b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:41.140354 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070befcf-e91e-47d1-b786-1fe9d88d2d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:41.141286 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070befcf-e91e-47d1-b786-1fe9d88d2d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:41.141572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070befcf-e91e-47d1-b786-1fe9d88d2d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:41.141850 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070befcf-e91e-47d1-b786-1fe9d88d2d92 admin admin] PATH_INFO: `/v3/projects/c7d0885d582940a6b8a2f4da7e1e2a15/users/352b60402c8945abaf2e905d8fb07e95/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:41.157346 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070befcf-e91e-47d1-b786-1fe9d88d2d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d0885d582940a6b8a2f4da7e1e2a15, user_id=352b60402c8945abaf2e905d8fb07e95, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:41.160028 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070befcf-e91e-47d1-b786-1fe9d88d2d92 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:41.173280 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1225/2431] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:35:41 2021] PUT /identity/v3/projects/c7d0885d582940a6b8a2f4da7e1e2a15/users/352b60402c8945abaf2e905d8fb07e95/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:35:41.185037 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a77c3-92e8-4209-a2d7-498ca3d19144 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:41.185334 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a77c3-92e8-4209-a2d7-498ca3d19144 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:41.185614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a77c3-92e8-4209-a2d7-498ca3d19144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:41.211674 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-0e8a77c3-92e8-4209-a2d7-498ca3d19144 None None] MFA Rules not processed for user `352b60402c8945abaf2e905d8fb07e95`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:41.213065 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0e8a77c3-92e8-4209-a2d7-498ca3d19144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:41.284473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1207/2432] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:41 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:35:41.288857 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070befcf-e91e-47d1-b786-1fe9d88d2d92 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:41.360288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070befcf-e91e-47d1-b786-1fe9d88d2d92 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:41.365244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747fb7a-a5a1-45a2-8c9e-a6340b243be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:41.366494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747fb7a-a5a1-45a2-8c9e-a6340b243be4 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:41.366494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747fb7a-a5a1-45a2-8c9e-a6340b243be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:41.367014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747fb7a-a5a1-45a2-8c9e-a6340b243be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:41.367308 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747fb7a-a5a1-45a2-8c9e-a6340b243be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:41.369357 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747fb7a-a5a1-45a2-8c9e-a6340b243be4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:41.418610 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1226/2433] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:35:41 2021] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:35:41.422734 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a77c3-92e8-4209-a2d7-498ca3d19144 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:41.434191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a77c3-92e8-4209-a2d7-498ca3d19144 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:41.507411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22162564-6a84-47f6-a871-5c99065f719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:41.508093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22162564-6a84-47f6-a871-5c99065f719f admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:41.508381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22162564-6a84-47f6-a871-5c99065f719f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:41.508662 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22162564-6a84-47f6-a871-5c99065f719f admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:41.509384 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22162564-6a84-47f6-a871-5c99065f719f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:41.511405 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22162564-6a84-47f6-a871-5c99065f719f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:41.538976 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1208/2434] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:35:41 2021] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:35:41.544202 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747fb7a-a5a1-45a2-8c9e-a6340b243be4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:41.554659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747fb7a-a5a1-45a2-8c9e-a6340b243be4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:41.559721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fe30d-b368-4cd9-bc0f-cc46c11a6415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:41.560386 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fe30d-b368-4cd9-bc0f-cc46c11a6415 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:41.560676 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fe30d-b368-4cd9-bc0f-cc46c11a6415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:41.560959 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fe30d-b368-4cd9-bc0f-cc46c11a6415 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:41.561702 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fe30d-b368-4cd9-bc0f-cc46c11a6415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:41.563370 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fe30d-b368-4cd9-bc0f-cc46c11a6415 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:41.577752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1227/2435] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:41 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:35:41.582238 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22162564-6a84-47f6-a871-5c99065f719f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:41.594626 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22162564-6a84-47f6-a871-5c99065f719f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:41.599848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f958da-193f-4bbb-bbed-17577f86dd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:41.600666 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f958da-193f-4bbb-bbed-17577f86dd20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:41.600947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f958da-193f-4bbb-bbed-17577f86dd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:41.601220 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f958da-193f-4bbb-bbed-17577f86dd20 admin admin] PATH_INFO: `/v3/projects/4725cdef2d124cf0b255f6f96afb83bf/users/df3b9e154ba14714a96f99497780802c/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:41.619383 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f958da-193f-4bbb-bbed-17577f86dd20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4725cdef2d124cf0b255f6f96afb83bf, user_id=df3b9e154ba14714a96f99497780802c, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:41.622972 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f958da-193f-4bbb-bbed-17577f86dd20 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:41.638473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1209/2436] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:35:41 2021] PUT /identity/v3/projects/4725cdef2d124cf0b255f6f96afb83bf/users/df3b9e154ba14714a96f99497780802c/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:35:41.642580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fe30d-b368-4cd9-bc0f-cc46c11a6415 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:41.656097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fe30d-b368-4cd9-bc0f-cc46c11a6415 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:41.724712 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b4a15-3b3e-496a-a02f-2ffdadcda3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:41.725389 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b4a15-3b3e-496a-a02f-2ffdadcda3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:41.725672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b4a15-3b3e-496a-a02f-2ffdadcda3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:41.725948 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b4a15-3b3e-496a-a02f-2ffdadcda3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:41.726686 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b4a15-3b3e-496a-a02f-2ffdadcda3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:41.728310 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b4a15-3b3e-496a-a02f-2ffdadcda3f1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:41.740095 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1228/2437] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:41 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:35:41.744734 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f958da-193f-4bbb-bbed-17577f86dd20 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:41.755672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f958da-193f-4bbb-bbed-17577f86dd20 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:41.760648 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead60e72-928a-4d84-8c5e-e08cd9eb40d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:41.761612 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead60e72-928a-4d84-8c5e-e08cd9eb40d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:41.762048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead60e72-928a-4d84-8c5e-e08cd9eb40d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:41.762330 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead60e72-928a-4d84-8c5e-e08cd9eb40d8 admin admin] PATH_INFO: `/v3/projects/4725cdef2d124cf0b255f6f96afb83bf/users/df3b9e154ba14714a96f99497780802c/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:41.764540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead60e72-928a-4d84-8c5e-e08cd9eb40d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4725cdef2d124cf0b255f6f96afb83bf, user_id=df3b9e154ba14714a96f99497780802c, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:41.767540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead60e72-928a-4d84-8c5e-e08cd9eb40d8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:41.780088 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1210/2438] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:35:41 2021] PUT /identity/v3/projects/4725cdef2d124cf0b255f6f96afb83bf/users/df3b9e154ba14714a96f99497780802c/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:41.790457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26593095-e35a-4b19-ab30-ac2a0ac89f10 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:41.790749 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26593095-e35a-4b19-ab30-ac2a0ac89f10 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:41.791049 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26593095-e35a-4b19-ab30-ac2a0ac89f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:41.819228 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-26593095-e35a-4b19-ab30-ac2a0ac89f10 None None] MFA Rules not processed for user `df3b9e154ba14714a96f99497780802c`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:41.820755 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-26593095-e35a-4b19-ab30-ac2a0ac89f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:41.893788 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1229/2439] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:41 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:41.905356 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead60e72-928a-4d84-8c5e-e08cd9eb40d8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:41.907120 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ead60e72-928a-4d84-8c5e-e08cd9eb40d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:41.973116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead60e72-928a-4d84-8c5e-e08cd9eb40d8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:41.977195 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f60ea-a407-4023-b8d8-6146e6cc8a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:41.977845 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f60ea-a407-4023-b8d8-6146e6cc8a8b service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:41.978131 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f60ea-a407-4023-b8d8-6146e6cc8a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:41.978411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f60ea-a407-4023-b8d8-6146e6cc8a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:42.036399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f60ea-a407-4023-b8d8-6146e6cc8a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:42.038208 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f60ea-a407-4023-b8d8-6146e6cc8a8b service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:42.055416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1211/2440] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:41 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:44.595769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26593095-e35a-4b19-ab30-ac2a0ac89f10 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:44.605063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26593095-e35a-4b19-ab30-ac2a0ac89f10 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:44.608580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301177c-78ba-46b4-bacb-81d8f3990a6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:44.609206 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301177c-78ba-46b4-bacb-81d8f3990a6c service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:44.609514 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301177c-78ba-46b4-bacb-81d8f3990a6c service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:44.609794 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301177c-78ba-46b4-bacb-81d8f3990a6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:44.675717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301177c-78ba-46b4-bacb-81d8f3990a6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:44.677380 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301177c-78ba-46b4-bacb-81d8f3990a6c service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:44.688080 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1230/2441] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:44 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:45.252932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f60ea-a407-4023-b8d8-6146e6cc8a8b service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:45.254534 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-1f4f60ea-a407-4023-b8d8-6146e6cc8a8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:45.269999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f60ea-a407-4023-b8d8-6146e6cc8a8b service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:45.274871 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de046fb-0eb6-48ac-bee7-28db00707bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:45.275559 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de046fb-0eb6-48ac-bee7-28db00707bdb service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:45.275843 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de046fb-0eb6-48ac-bee7-28db00707bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:45.276121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de046fb-0eb6-48ac-bee7-28db00707bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:45.287073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de046fb-0eb6-48ac-bee7-28db00707bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:45.288659 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de046fb-0eb6-48ac-bee7-28db00707bdb service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:45.299273 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1212/2442] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:45 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:47.674204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301177c-78ba-46b4-bacb-81d8f3990a6c service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:47.675616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-4301177c-78ba-46b4-bacb-81d8f3990a6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:47.751910 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301177c-78ba-46b4-bacb-81d8f3990a6c service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:47.756561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac988ca-c76f-4020-a99f-9be1eca41fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:47.757458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac988ca-c76f-4020-a99f-9be1eca41fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:47.757737 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac988ca-c76f-4020-a99f-9be1eca41fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:47.758010 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac988ca-c76f-4020-a99f-9be1eca41fe1 admin admin] PATH_INFO: `/v3/users/113e1ac33bb748b78b4ae803fa0cc925` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:47.759248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac988ca-c76f-4020-a99f-9be1eca41fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=113e1ac33bb748b78b4ae803fa0cc925)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:47.761151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac988ca-c76f-4020-a99f-9be1eca41fe1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:47.842196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3ac988ca-c76f-4020-a99f-9be1eca41fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113e1ac33bb748b78b4ae803fa0cc925'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:47.856255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3ac988ca-c76f-4020-a99f-9be1eca41fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113e1ac33bb748b78b4ae803fa0cc925'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:47.872974 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3ac988ca-c76f-4020-a99f-9be1eca41fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113e1ac33bb748b78b4ae803fa0cc925'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:47.880951 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3ac988ca-c76f-4020-a99f-9be1eca41fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113e1ac33bb748b78b4ae803fa0cc925'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:47.881649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3ac988ca-c76f-4020-a99f-9be1eca41fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113e1ac33bb748b78b4ae803fa0cc925'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:47.888244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1231/2443] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:35:47 2021] DELETE /identity/v3/users/113e1ac33bb748b78b4ae803fa0cc925 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:47.892868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d316a8-48d2-42b4-a2c9-18e6b2ea0daa None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:47.893374 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d316a8-48d2-42b4-a2c9-18e6b2ea0daa None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:47.893488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d316a8-48d2-42b4-a2c9-18e6b2ea0daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:47.935244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-42d316a8-48d2-42b4-a2c9-18e6b2ea0daa None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:47.936496 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-42d316a8-48d2-42b4-a2c9-18e6b2ea0daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:48.006073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1213/2444] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:35:48.017054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac988ca-c76f-4020-a99f-9be1eca41fe1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:48.027255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3ac988ca-c76f-4020-a99f-9be1eca41fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:48.129498 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac988ca-c76f-4020-a99f-9be1eca41fe1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:48.136341 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874bc1a-71e6-4d24-ba47-3f2bc7f7506f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:48.137137 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874bc1a-71e6-4d24-ba47-3f2bc7f7506f service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:48.138048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874bc1a-71e6-4d24-ba47-3f2bc7f7506f service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:48.138454 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874bc1a-71e6-4d24-ba47-3f2bc7f7506f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:48.148744 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874bc1a-71e6-4d24-ba47-3f2bc7f7506f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:48.150488 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874bc1a-71e6-4d24-ba47-3f2bc7f7506f service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:48.165882 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1232/2445] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:48.439495 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d316a8-48d2-42b4-a2c9-18e6b2ea0daa None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:48.442959 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-42d316a8-48d2-42b4-a2c9-18e6b2ea0daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:48.459000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d316a8-48d2-42b4-a2c9-18e6b2ea0daa None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:48.468326 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d1c32-470c-42e2-a195-76b521fd125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:48.469347 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d1c32-470c-42e2-a195-76b521fd125b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:48.469759 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d1c32-470c-42e2-a195-76b521fd125b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:48.470193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d1c32-470c-42e2-a195-76b521fd125b admin admin] PATH_INFO: `/v3/projects/9dd551cf87a2417489d01d555723f025` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:48.471604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d1c32-470c-42e2-a195-76b521fd125b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd551cf87a2417489d01d555723f025)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:48.473857 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d1c32-470c-42e2-a195-76b521fd125b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:48.545003 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d41d1c32-470c-42e2-a195-76b521fd125b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd551cf87a2417489d01d555723f025', 'request_id': 'req-d41d1c32-470c-42e2-a195-76b521fd125b'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:48.552196 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d41d1c32-470c-42e2-a195-76b521fd125b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd551cf87a2417489d01d555723f025', 'request_id': 'req-d41d1c32-470c-42e2-a195-76b521fd125b'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:48.557681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d41d1c32-470c-42e2-a195-76b521fd125b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd551cf87a2417489d01d555723f025', 'request_id': 'req-d41d1c32-470c-42e2-a195-76b521fd125b'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:48.576162 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d41d1c32-470c-42e2-a195-76b521fd125b admin admin] The token cache is being invalidate because project 9dd551cf87a2417489d01d555723f025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:35:48.576856 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d41d1c32-470c-42e2-a195-76b521fd125b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:48.577863 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d41d1c32-470c-42e2-a195-76b521fd125b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:48.579739 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1214/2446] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:35:48 2021] DELETE /identity/v3/projects/9dd551cf87a2417489d01d555723f025 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:48.589229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da7d97-fc5f-4090-aca8-62348af5272c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:48.589844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da7d97-fc5f-4090-aca8-62348af5272c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:48.590289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da7d97-fc5f-4090-aca8-62348af5272c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:48.613668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-d5da7d97-fc5f-4090-aca8-62348af5272c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:48.616630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d5da7d97-fc5f-4090-aca8-62348af5272c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:48.685963 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1233/2447] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:35:48.693916 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6a8c0-c686-43e4-b490-a069fb996102 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:48.694304 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6a8c0-c686-43e4-b490-a069fb996102 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:48.694829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6a8c0-c686-43e4-b490-a069fb996102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:48.741472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-fae6a8c0-c686-43e4-b490-a069fb996102 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:48.742693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-fae6a8c0-c686-43e4-b490-a069fb996102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:48.761705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1215/2448] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:48.765659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da7d97-fc5f-4090-aca8-62348af5272c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:48.776560 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da7d97-fc5f-4090-aca8-62348af5272c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:48.782089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3271e5d-9b95-4fbb-a3dc-ead442862028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:48.782824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271e5d-9b95-4fbb-a3dc-ead442862028 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:48.783250 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271e5d-9b95-4fbb-a3dc-ead442862028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:48.783862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271e5d-9b95-4fbb-a3dc-ead442862028 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:48.784738 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3271e5d-9b95-4fbb-a3dc-ead442862028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:35:48.785085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3271e5d-9b95-4fbb-a3dc-ead442862028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:48.786889 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3271e5d-9b95-4fbb-a3dc-ead442862028 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:48.800396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1234/2449] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:35:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:35:48.804561 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6a8c0-c686-43e4-b490-a069fb996102 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:48.814799 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6a8c0-c686-43e4-b490-a069fb996102 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:48.821123 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f3bf2-eaca-4a20-8c64-4d5cba2a2bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:48.824191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f3bf2-eaca-4a20-8c64-4d5cba2a2bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:48.824191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f3bf2-eaca-4a20-8c64-4d5cba2a2bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:48.824191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f3bf2-eaca-4a20-8c64-4d5cba2a2bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:48.824191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f3bf2-eaca-4a20-8c64-4d5cba2a2bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:48.837808 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f3bf2-eaca-4a20-8c64-4d5cba2a2bd5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:48.877382 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1216/2450] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:35:48 2021] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:35:48.881154 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3271e5d-9b95-4fbb-a3dc-ead442862028 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:48.891600 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3271e5d-9b95-4fbb-a3dc-ead442862028 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:48.990330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c07a91-d606-464d-9985-57db7ba2cba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:48.991255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c07a91-d606-464d-9985-57db7ba2cba7 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:48.992141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c07a91-d606-464d-9985-57db7ba2cba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:48.992525 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c07a91-d606-464d-9985-57db7ba2cba7 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:48.994033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c07a91-d606-464d-9985-57db7ba2cba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:48.996295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c07a91-d606-464d-9985-57db7ba2cba7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:49.019796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1235/2451] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:35:48 2021] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:35:49.024140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f3bf2-eaca-4a20-8c64-4d5cba2a2bd5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:49.038049 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f3bf2-eaca-4a20-8c64-4d5cba2a2bd5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:49.044360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfc6f4-6152-4b9c-8a1a-bffd47913f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:49.045413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfc6f4-6152-4b9c-8a1a-bffd47913f3c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:49.045780 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfc6f4-6152-4b9c-8a1a-bffd47913f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:49.046226 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfc6f4-6152-4b9c-8a1a-bffd47913f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:49.047175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfc6f4-6152-4b9c-8a1a-bffd47913f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:49.049162 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfc6f4-6152-4b9c-8a1a-bffd47913f3c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:49.060961 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1217/2452] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:49 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:35:49.065254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c07a91-d606-464d-9985-57db7ba2cba7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:49.075631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c07a91-d606-464d-9985-57db7ba2cba7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:49.080937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f38ec-fe9c-4e32-9361-6a87de0fbd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:49.081720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f38ec-fe9c-4e32-9361-6a87de0fbd37 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:49.082009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f38ec-fe9c-4e32-9361-6a87de0fbd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:49.082284 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f38ec-fe9c-4e32-9361-6a87de0fbd37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:49.083192 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f38ec-fe9c-4e32-9361-6a87de0fbd37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:49.084780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f38ec-fe9c-4e32-9361-6a87de0fbd37 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:49.095786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1236/2453] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:49 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:35:49.100230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfc6f4-6152-4b9c-8a1a-bffd47913f3c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:49.111846 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfc6f4-6152-4b9c-8a1a-bffd47913f3c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:49.116871 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf8450-b779-460f-9754-bdb53b5646b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:49.117776 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf8450-b779-460f-9754-bdb53b5646b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:49.118053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf8450-b779-460f-9754-bdb53b5646b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:49.118488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf8450-b779-460f-9754-bdb53b5646b5 admin admin] PATH_INFO: `/v3/projects/4b281078faad41b9a0f84ea9206f9d6d/users/7791c1376d244085ae676b2bb2b43738/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:49.135365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf8450-b779-460f-9754-bdb53b5646b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b281078faad41b9a0f84ea9206f9d6d, user_id=7791c1376d244085ae676b2bb2b43738, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:49.138227 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf8450-b779-460f-9754-bdb53b5646b5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:49.152369 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1218/2454] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:35:49 2021] PUT /identity/v3/projects/4b281078faad41b9a0f84ea9206f9d6d/users/7791c1376d244085ae676b2bb2b43738/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:35:49.163209 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f67e55-1a76-409e-84f9-cc83cb6310d0 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:49.163502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f67e55-1a76-409e-84f9-cc83cb6310d0 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:49.163782 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f67e55-1a76-409e-84f9-cc83cb6310d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:49.191956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b8f67e55-1a76-409e-84f9-cc83cb6310d0 None None] MFA Rules not processed for user `7791c1376d244085ae676b2bb2b43738`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:49.193313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b8f67e55-1a76-409e-84f9-cc83cb6310d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:49.268962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1237/2455] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:49 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:35:49.277346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf8450-b779-460f-9754-bdb53b5646b5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:49.279304 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f67e55-1a76-409e-84f9-cc83cb6310d0 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:49.279571 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-3dbf8450-b779-460f-9754-bdb53b5646b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:49.280684 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b8f67e55-1a76-409e-84f9-cc83cb6310d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:49.336846 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f67e55-1a76-409e-84f9-cc83cb6310d0 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:49.340470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f7824-7d3e-4402-8635-7a5dad805603 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9aff45fefe408fa1667e5298f8ff6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:49.341121 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f7824-7d3e-4402-8635-7a5dad805603 service glance] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:49.341403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f7824-7d3e-4402-8635-7a5dad805603 service glance] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:49.341681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f7824-7d3e-4402-8635-7a5dad805603 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:49.342724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf8450-b779-460f-9754-bdb53b5646b5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:49.347433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42824d84-f52e-481d-be0f-c09c316f85de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:49.348293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824d84-f52e-481d-be0f-c09c316f85de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:49.348576 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824d84-f52e-481d-be0f-c09c316f85de admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:49.348852 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824d84-f52e-481d-be0f-c09c316f85de admin admin] PATH_INFO: `/v3/users/940503c3fd114bdfbc8feb21303b7742` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:49.349886 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f7824-7d3e-4402-8635-7a5dad805603 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:49.350054 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42824d84-f52e-481d-be0f-c09c316f85de admin admin] RBAC: Authorizing `identity:delete_user(user_id=940503c3fd114bdfbc8feb21303b7742)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:49.351352 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f7824-7d3e-4402-8635-7a5dad805603 service glance] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:49.352012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42824d84-f52e-481d-be0f-c09c316f85de admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:49.361635 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1238/2456] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:49 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:49.402015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-42824d84-f52e-481d-be0f-c09c316f85de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940503c3fd114bdfbc8feb21303b7742'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:49.418149 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-42824d84-f52e-481d-be0f-c09c316f85de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940503c3fd114bdfbc8feb21303b7742'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:49.435620 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-42824d84-f52e-481d-be0f-c09c316f85de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940503c3fd114bdfbc8feb21303b7742'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:49.450021 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-42824d84-f52e-481d-be0f-c09c316f85de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940503c3fd114bdfbc8feb21303b7742'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:49.450977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-42824d84-f52e-481d-be0f-c09c316f85de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940503c3fd114bdfbc8feb21303b7742'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:49.457666 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1219/2457] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:35:49 2021] DELETE /identity/v3/users/940503c3fd114bdfbc8feb21303b7742 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:49.462503 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06309edb-9282-4672-a9ac-bd2276b8d64f None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:49.462797 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06309edb-9282-4672-a9ac-bd2276b8d64f None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:49.463252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06309edb-9282-4672-a9ac-bd2276b8d64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:49.481829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-06309edb-9282-4672-a9ac-bd2276b8d64f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:49.483057 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-06309edb-9282-4672-a9ac-bd2276b8d64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:49.563185 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1239/2458] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:49.573444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42824d84-f52e-481d-be0f-c09c316f85de admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:49.574939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-42824d84-f52e-481d-be0f-c09c316f85de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:49.645972 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42824d84-f52e-481d-be0f-c09c316f85de admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:49.650124 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4abdf3-d014-4e0a-8d23-cc50e98e4cff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:49.650858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4abdf3-d014-4e0a-8d23-cc50e98e4cff service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:49.651219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4abdf3-d014-4e0a-8d23-cc50e98e4cff service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:49.651501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4abdf3-d014-4e0a-8d23-cc50e98e4cff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:49.661704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4abdf3-d014-4e0a-8d23-cc50e98e4cff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:49.663309 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4abdf3-d014-4e0a-8d23-cc50e98e4cff service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:49.674433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1220/2459] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:50.086358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06309edb-9282-4672-a9ac-bd2276b8d64f None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:50.087895 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-06309edb-9282-4672-a9ac-bd2276b8d64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:50.103595 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06309edb-9282-4672-a9ac-bd2276b8d64f None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:50.109623 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:50.110731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:50.111226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:50.111511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] PATH_INFO: `/v3/projects/c127c89e1bd24ebfbdba22d49bad8405` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:50.112794 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c127c89e1bd24ebfbdba22d49bad8405)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:50.116013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:50.167769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c127c89e1bd24ebfbdba22d49bad8405', 'request_id': 'req-08d24084-cdeb-4943-aa12-fde90745d291'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.175369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c127c89e1bd24ebfbdba22d49bad8405', 'request_id': 'req-08d24084-cdeb-4943-aa12-fde90745d291'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.182473 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c127c89e1bd24ebfbdba22d49bad8405', 'request_id': 'req-08d24084-cdeb-4943-aa12-fde90745d291'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.195556 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] The token cache is being invalidate because project c127c89e1bd24ebfbdba22d49bad8405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:35:50.195923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.196717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.198431 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1240/2460] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:35:50 2021] DELETE /identity/v3/projects/c127c89e1bd24ebfbdba22d49bad8405 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:50.203109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4abdf3-d014-4e0a-8d23-cc50e98e4cff service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:50.216467 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4abdf3-d014-4e0a-8d23-cc50e98e4cff service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:50.271475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04736b9-77f7-4dd3-bcb3-c80d081470e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:50.272335 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04736b9-77f7-4dd3-bcb3-c80d081470e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:50.272620 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04736b9-77f7-4dd3-bcb3-c80d081470e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:50.272962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04736b9-77f7-4dd3-bcb3-c80d081470e2 admin admin] PATH_INFO: `/v3/users/352b60402c8945abaf2e905d8fb07e95` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:50.274173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04736b9-77f7-4dd3-bcb3-c80d081470e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=352b60402c8945abaf2e905d8fb07e95)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:50.276144 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04736b9-77f7-4dd3-bcb3-c80d081470e2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:50.344252 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b04736b9-77f7-4dd3-bcb3-c80d081470e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352b60402c8945abaf2e905d8fb07e95'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.356238 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b04736b9-77f7-4dd3-bcb3-c80d081470e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352b60402c8945abaf2e905d8fb07e95'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.363670 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b04736b9-77f7-4dd3-bcb3-c80d081470e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352b60402c8945abaf2e905d8fb07e95'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.370993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b04736b9-77f7-4dd3-bcb3-c80d081470e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352b60402c8945abaf2e905d8fb07e95'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.371834 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b04736b9-77f7-4dd3-bcb3-c80d081470e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352b60402c8945abaf2e905d8fb07e95'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.377624 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1221/2461] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:35:50 2021] DELETE /identity/v3/users/352b60402c8945abaf2e905d8fb07e95 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:50.681196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:50.683754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:50.703899 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d24084-cdeb-4943-aa12-fde90745d291 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:50.763581 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:50.764449 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:50.764729 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:50.765004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] PATH_INFO: `/v3/projects/c7d0885d582940a6b8a2f4da7e1e2a15` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:50.766253 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d0885d582940a6b8a2f4da7e1e2a15)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:50.768197 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:50.812644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d0885d582940a6b8a2f4da7e1e2a15', 'request_id': 'req-eba4582e-c727-41cd-89a1-49ef2aa09971'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.820563 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d0885d582940a6b8a2f4da7e1e2a15', 'request_id': 'req-eba4582e-c727-41cd-89a1-49ef2aa09971'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.827642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d0885d582940a6b8a2f4da7e1e2a15', 'request_id': 'req-eba4582e-c727-41cd-89a1-49ef2aa09971'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.843579 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] The token cache is being invalidate because project c7d0885d582940a6b8a2f4da7e1e2a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:35:50.843870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.844526 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:50.846339 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1241/2462] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:35:50 2021] DELETE /identity/v3/projects/c7d0885d582940a6b8a2f4da7e1e2a15 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:50.850619 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04736b9-77f7-4dd3-bcb3-c80d081470e2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:50.852059 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b04736b9-77f7-4dd3-bcb3-c80d081470e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:50.873877 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04736b9-77f7-4dd3-bcb3-c80d081470e2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:50.941284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0271db-4430-4973-8c88-9388692456e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:50.942258 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0271db-4430-4973-8c88-9388692456e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:50.942665 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0271db-4430-4973-8c88-9388692456e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:50.942995 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0271db-4430-4973-8c88-9388692456e0 admin admin] PATH_INFO: `/v3/users/df3b9e154ba14714a96f99497780802c` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:50.944312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0271db-4430-4973-8c88-9388692456e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3b9e154ba14714a96f99497780802c)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:50.946614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0271db-4430-4973-8c88-9388692456e0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:51.021103 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-bc0271db-4430-4973-8c88-9388692456e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3b9e154ba14714a96f99497780802c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:51.033037 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-bc0271db-4430-4973-8c88-9388692456e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3b9e154ba14714a96f99497780802c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:51.041617 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-bc0271db-4430-4973-8c88-9388692456e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3b9e154ba14714a96f99497780802c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:51.055248 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-bc0271db-4430-4973-8c88-9388692456e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3b9e154ba14714a96f99497780802c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:51.060306 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-bc0271db-4430-4973-8c88-9388692456e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3b9e154ba14714a96f99497780802c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:51.072128 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1222/2463] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:35:50 2021] DELETE /identity/v3/users/df3b9e154ba14714a96f99497780802c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:35:51.389838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:51.391561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:51.411027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4582e-c727-41cd-89a1-49ef2aa09971 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:51.479895 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90bfc9-9bb4-4848-860b-f68772a2d539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:51.480750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90bfc9-9bb4-4848-860b-f68772a2d539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:51.481025 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90bfc9-9bb4-4848-860b-f68772a2d539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:51.481893 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90bfc9-9bb4-4848-860b-f68772a2d539 admin admin] PATH_INFO: `/v3/projects/4725cdef2d124cf0b255f6f96afb83bf` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:51.483101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90bfc9-9bb4-4848-860b-f68772a2d539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4725cdef2d124cf0b255f6f96afb83bf)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:51.484986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90bfc9-9bb4-4848-860b-f68772a2d539 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:51.542755 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ad90bfc9-9bb4-4848-860b-f68772a2d539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4725cdef2d124cf0b255f6f96afb83bf', 'request_id': 'req-ad90bfc9-9bb4-4848-860b-f68772a2d539'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:51.552198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ad90bfc9-9bb4-4848-860b-f68772a2d539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4725cdef2d124cf0b255f6f96afb83bf', 'request_id': 'req-ad90bfc9-9bb4-4848-860b-f68772a2d539'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:51.558686 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ad90bfc9-9bb4-4848-860b-f68772a2d539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4725cdef2d124cf0b255f6f96afb83bf', 'request_id': 'req-ad90bfc9-9bb4-4848-860b-f68772a2d539'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:51.568551 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ad90bfc9-9bb4-4848-860b-f68772a2d539 admin admin] The token cache is being invalidate because project 4725cdef2d124cf0b255f6f96afb83bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:35:51.568838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ad90bfc9-9bb4-4848-860b-f68772a2d539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:51.569459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ad90bfc9-9bb4-4848-860b-f68772a2d539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:51.571272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1242/2464] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:35:51 2021] DELETE /identity/v3/projects/4725cdef2d124cf0b255f6f96afb83bf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:51.577360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8fefb-df8e-440a-be1d-203a8905e789 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:51.577944 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8fefb-df8e-440a-be1d-203a8905e789 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:51.577944 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8fefb-df8e-440a-be1d-203a8905e789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:51.595984 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-66a8fefb-df8e-440a-be1d-203a8905e789 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:51.599969 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-66a8fefb-df8e-440a-be1d-203a8905e789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:51.664623 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1223/2465] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:51.672643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af60dce-1835-4a10-b16f-afe77b6218a1 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:51.672945 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af60dce-1835-4a10-b16f-afe77b6218a1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:51.673229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af60dce-1835-4a10-b16f-afe77b6218a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:51.692285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-9af60dce-1835-4a10-b16f-afe77b6218a1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:51.694074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9af60dce-1835-4a10-b16f-afe77b6218a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:51.702920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1243/2466] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:51.707268 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8fefb-df8e-440a-be1d-203a8905e789 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:51.717645 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8fefb-df8e-440a-be1d-203a8905e789 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:51.722430 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29664e8-1fb7-40b1-b3ca-9373654f52e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:51.723119 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29664e8-1fb7-40b1-b3ca-9373654f52e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:51.723413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29664e8-1fb7-40b1-b3ca-9373654f52e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:51.723691 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29664e8-1fb7-40b1-b3ca-9373654f52e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:51.724444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29664e8-1fb7-40b1-b3ca-9373654f52e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:35:51.724758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29664e8-1fb7-40b1-b3ca-9373654f52e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:51.726389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29664e8-1fb7-40b1-b3ca-9373654f52e0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:51.738876 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1224/2467] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:35:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:35:51.743217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af60dce-1835-4a10-b16f-afe77b6218a1 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:51.752538 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af60dce-1835-4a10-b16f-afe77b6218a1 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:51.757219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5416e-7dc0-4216-b33d-94c20e5a644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:51.757886 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5416e-7dc0-4216-b33d-94c20e5a644b admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:51.758179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5416e-7dc0-4216-b33d-94c20e5a644b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:51.758460 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5416e-7dc0-4216-b33d-94c20e5a644b admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:51.759631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5416e-7dc0-4216-b33d-94c20e5a644b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:51.761541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5416e-7dc0-4216-b33d-94c20e5a644b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:51.789329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1244/2468] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:35:51 2021] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:35:51.793645 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29664e8-1fb7-40b1-b3ca-9373654f52e0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:51.805655 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29664e8-1fb7-40b1-b3ca-9373654f52e0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:51.864719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204caaa-9342-4dcd-8b88-813ae28ee732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:51.865186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204caaa-9342-4dcd-8b88-813ae28ee732 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:51.865467 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204caaa-9342-4dcd-8b88-813ae28ee732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:51.865744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204caaa-9342-4dcd-8b88-813ae28ee732 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:51.866450 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204caaa-9342-4dcd-8b88-813ae28ee732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:51.868403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204caaa-9342-4dcd-8b88-813ae28ee732 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:51.892734 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1225/2469] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:35:51 2021] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:35:51.893997 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5416e-7dc0-4216-b33d-94c20e5a644b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:51.905288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5416e-7dc0-4216-b33d-94c20e5a644b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:51.909972 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76244dad-b741-40dc-ac2e-d71d95d7321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:51.910643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76244dad-b741-40dc-ac2e-d71d95d7321e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:51.910958 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76244dad-b741-40dc-ac2e-d71d95d7321e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:51.911243 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76244dad-b741-40dc-ac2e-d71d95d7321e admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:51.911986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76244dad-b741-40dc-ac2e-d71d95d7321e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:51.913703 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76244dad-b741-40dc-ac2e-d71d95d7321e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:51.928571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1245/2470] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:35:51.929842 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204caaa-9342-4dcd-8b88-813ae28ee732 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:51.940046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204caaa-9342-4dcd-8b88-813ae28ee732 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:51.945282 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394e4d9-18bd-43d2-adf3-dfb3e192ae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:51.945966 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394e4d9-18bd-43d2-adf3-dfb3e192ae2a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:51.946252 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394e4d9-18bd-43d2-adf3-dfb3e192ae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:51.946533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394e4d9-18bd-43d2-adf3-dfb3e192ae2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:51.947390 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394e4d9-18bd-43d2-adf3-dfb3e192ae2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:51.948990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394e4d9-18bd-43d2-adf3-dfb3e192ae2a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:51.959408 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1226/2471] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:35:51.963434 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76244dad-b741-40dc-ac2e-d71d95d7321e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:51.973772 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76244dad-b741-40dc-ac2e-d71d95d7321e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:51.978492 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489c296-1efc-479f-b2ce-721c88deaa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:51.979506 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489c296-1efc-479f-b2ce-721c88deaa96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:51.979858 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489c296-1efc-479f-b2ce-721c88deaa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:51.980145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489c296-1efc-479f-b2ce-721c88deaa96 admin admin] PATH_INFO: `/v3/projects/a49eb8bcf5c148ec95095b64ef84f775/users/c21818011bee4318ac5dafc0ae4778ca/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:51.998150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489c296-1efc-479f-b2ce-721c88deaa96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49eb8bcf5c148ec95095b64ef84f775, user_id=c21818011bee4318ac5dafc0ae4778ca, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:52.001646 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489c296-1efc-479f-b2ce-721c88deaa96 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:52.017013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1246/2472] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:35:51 2021] PUT /identity/v3/projects/a49eb8bcf5c148ec95095b64ef84f775/users/c21818011bee4318ac5dafc0ae4778ca/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:52.028126 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9aa3f-bc6d-4672-be20-061e5c5c99c8 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:52.028427 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9aa3f-bc6d-4672-be20-061e5c5c99c8 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:52.028713 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9aa3f-bc6d-4672-be20-061e5c5c99c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:52.054681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-3ca9aa3f-bc6d-4672-be20-061e5c5c99c8 None None] MFA Rules not processed for user `c21818011bee4318ac5dafc0ae4778ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:52.055923 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-3ca9aa3f-bc6d-4672-be20-061e5c5c99c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:52.123429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1227/2473] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:52 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:52.133590 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489c296-1efc-479f-b2ce-721c88deaa96 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:52.135315 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-f489c296-1efc-479f-b2ce-721c88deaa96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:52.190829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489c296-1efc-479f-b2ce-721c88deaa96 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:52.194453 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e6d51-4fd3-48e2-b01e-ef687708f247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:52.195367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e6d51-4fd3-48e2-b01e-ef687708f247 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:52.195648 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e6d51-4fd3-48e2-b01e-ef687708f247 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:52.195923 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e6d51-4fd3-48e2-b01e-ef687708f247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:52.204527 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e6d51-4fd3-48e2-b01e-ef687708f247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:52.205944 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e6d51-4fd3-48e2-b01e-ef687708f247 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:52.214986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1247/2474] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:52 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:55.791477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9aa3f-bc6d-4672-be20-061e5c5c99c8 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:55.855185 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9aa3f-bc6d-4672-be20-061e5c5c99c8 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:55.861382 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb84173-1b50-4576-94fd-468dc824c3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:55.862420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84173-1b50-4576-94fd-468dc824c3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:55.862817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84173-1b50-4576-94fd-468dc824c3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:55.863219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84173-1b50-4576-94fd-468dc824c3cd admin admin] PATH_INFO: `/v3/users/c21818011bee4318ac5dafc0ae4778ca` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:55.864629 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb84173-1b50-4576-94fd-468dc824c3cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21818011bee4318ac5dafc0ae4778ca)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:55.866569 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb84173-1b50-4576-94fd-468dc824c3cd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:55.915126 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0fb84173-1b50-4576-94fd-468dc824c3cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21818011bee4318ac5dafc0ae4778ca'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:55.927766 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0fb84173-1b50-4576-94fd-468dc824c3cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21818011bee4318ac5dafc0ae4778ca'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:55.938394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0fb84173-1b50-4576-94fd-468dc824c3cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21818011bee4318ac5dafc0ae4778ca'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:55.946115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0fb84173-1b50-4576-94fd-468dc824c3cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21818011bee4318ac5dafc0ae4778ca'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:55.946726 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0fb84173-1b50-4576-94fd-468dc824c3cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21818011bee4318ac5dafc0ae4778ca'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:55.952804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1228/2475] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:35:55 2021] DELETE /identity/v3/users/c21818011bee4318ac5dafc0ae4778ca => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:55.957374 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8f606-5226-4ff4-99d2-31798413cd33 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:55.957835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8f606-5226-4ff4-99d2-31798413cd33 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:55.957931 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8f606-5226-4ff4-99d2-31798413cd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:55.975646 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-e9e8f606-5226-4ff4-99d2-31798413cd33 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:55.976879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e9e8f606-5226-4ff4-99d2-31798413cd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:56.040249 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1248/2476] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:56.050445 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb84173-1b50-4576-94fd-468dc824c3cd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:56.051856 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0fb84173-1b50-4576-94fd-468dc824c3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:56.110085 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb84173-1b50-4576-94fd-468dc824c3cd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:56.113695 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6a652-24f4-47ee-8c8a-f18966fa51d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:56.114335 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a652-24f4-47ee-8c8a-f18966fa51d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:56.114618 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a652-24f4-47ee-8c8a-f18966fa51d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:56.114923 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a652-24f4-47ee-8c8a-f18966fa51d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:56.125635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6a652-24f4-47ee-8c8a-f18966fa51d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:56.127166 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6a652-24f4-47ee-8c8a-f18966fa51d7 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:56.137028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1229/2477] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:56.416778 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8f606-5226-4ff4-99d2-31798413cd33 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:56.418373 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-e9e8f606-5226-4ff4-99d2-31798413cd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:56.430494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8f606-5226-4ff4-99d2-31798413cd33 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:56.435508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d9b0e-33e3-4cf1-8254-4c326143d686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:56.436371 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9b0e-33e3-4cf1-8254-4c326143d686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:56.436657 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9b0e-33e3-4cf1-8254-4c326143d686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:56.436940 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9b0e-33e3-4cf1-8254-4c326143d686 admin admin] PATH_INFO: `/v3/projects/a49eb8bcf5c148ec95095b64ef84f775` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:56.438248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d9b0e-33e3-4cf1-8254-4c326143d686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a49eb8bcf5c148ec95095b64ef84f775)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:56.440260 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d9b0e-33e3-4cf1-8254-4c326143d686 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:56.485675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2b7d9b0e-33e3-4cf1-8254-4c326143d686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49eb8bcf5c148ec95095b64ef84f775', 'request_id': 'req-2b7d9b0e-33e3-4cf1-8254-4c326143d686'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:56.492027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2b7d9b0e-33e3-4cf1-8254-4c326143d686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49eb8bcf5c148ec95095b64ef84f775', 'request_id': 'req-2b7d9b0e-33e3-4cf1-8254-4c326143d686'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:56.502312 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2b7d9b0e-33e3-4cf1-8254-4c326143d686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49eb8bcf5c148ec95095b64ef84f775', 'request_id': 'req-2b7d9b0e-33e3-4cf1-8254-4c326143d686'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:56.513782 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2b7d9b0e-33e3-4cf1-8254-4c326143d686 admin admin] The token cache is being invalidate because project a49eb8bcf5c148ec95095b64ef84f775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:35:56.514074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2b7d9b0e-33e3-4cf1-8254-4c326143d686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:56.514734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2b7d9b0e-33e3-4cf1-8254-4c326143d686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:35:56.516401 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1249/2478] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:35:56 2021] DELETE /identity/v3/projects/a49eb8bcf5c148ec95095b64ef84f775 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:56.522123 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9ce7a-5e51-4b46-9dae-67abf24aa26d None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:56.522411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9ce7a-5e51-4b46-9dae-67abf24aa26d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:56.522693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9ce7a-5e51-4b46-9dae-67abf24aa26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:56.539848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-76e9ce7a-5e51-4b46-9dae-67abf24aa26d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:56.541020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-76e9ce7a-5e51-4b46-9dae-67abf24aa26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:56.598951 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1230/2479] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:56.606863 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8840f4-1b5b-47c7-89e6-f6e4a52ccd21 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:56.607159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8840f4-1b5b-47c7-89e6-f6e4a52ccd21 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:56.607439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8840f4-1b5b-47c7-89e6-f6e4a52ccd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:56.628045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-5d8840f4-1b5b-47c7-89e6-f6e4a52ccd21 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:56.629260 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5d8840f4-1b5b-47c7-89e6-f6e4a52ccd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:56.638101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1250/2480] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:56.642534 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9ce7a-5e51-4b46-9dae-67abf24aa26d None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:56.652021 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9ce7a-5e51-4b46-9dae-67abf24aa26d None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:56.656819 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff34c93-c8db-4866-9883-8c3f8db49dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:56.657480 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff34c93-c8db-4866-9883-8c3f8db49dfe admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:56.657762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff34c93-c8db-4866-9883-8c3f8db49dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:56.658039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff34c93-c8db-4866-9883-8c3f8db49dfe admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:56.658781 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff34c93-c8db-4866-9883-8c3f8db49dfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:35:56.659146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff34c93-c8db-4866-9883-8c3f8db49dfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:56.660753 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff34c93-c8db-4866-9883-8c3f8db49dfe admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:56.672322 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1231/2481] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:35:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:35:56.676599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8840f4-1b5b-47c7-89e6-f6e4a52ccd21 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:56.686048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8840f4-1b5b-47c7-89e6-f6e4a52ccd21 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:56.690935 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd6601-7897-4e05-8aa9-f2c4ba9ec504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:56.691672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd6601-7897-4e05-8aa9-f2c4ba9ec504 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:56.691962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd6601-7897-4e05-8aa9-f2c4ba9ec504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:56.692255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd6601-7897-4e05-8aa9-f2c4ba9ec504 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:56.693232 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd6601-7897-4e05-8aa9-f2c4ba9ec504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:56.695596 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd6601-7897-4e05-8aa9-f2c4ba9ec504 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:56.722139 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1251/2482] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:35:56 2021] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:35:56.726226 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff34c93-c8db-4866-9883-8c3f8db49dfe admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:56.736734 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff34c93-c8db-4866-9883-8c3f8db49dfe admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:56.794027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632d3d3-db5a-48a2-8bd5-1f8750c6a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:56.794712 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632d3d3-db5a-48a2-8bd5-1f8750c6a6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:56.795098 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632d3d3-db5a-48a2-8bd5-1f8750c6a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:56.795447 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632d3d3-db5a-48a2-8bd5-1f8750c6a6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:56.796393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632d3d3-db5a-48a2-8bd5-1f8750c6a6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:56.799107 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632d3d3-db5a-48a2-8bd5-1f8750c6a6b6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:56.820442 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1232/2483] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:35:56 2021] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:35:56.824517 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd6601-7897-4e05-8aa9-f2c4ba9ec504 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:56.834991 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd6601-7897-4e05-8aa9-f2c4ba9ec504 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:56.839570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f75966-598d-4fa8-8e14-7d23e906f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:56.840216 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f75966-598d-4fa8-8e14-7d23e906f4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:56.840528 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f75966-598d-4fa8-8e14-7d23e906f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:56.840802 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f75966-598d-4fa8-8e14-7d23e906f4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:56.841539 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f75966-598d-4fa8-8e14-7d23e906f4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:56.843144 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f75966-598d-4fa8-8e14-7d23e906f4a4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:56.855777 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1252/2484] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:56 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:35:56.860717 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632d3d3-db5a-48a2-8bd5-1f8750c6a6b6 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:56.871267 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632d3d3-db5a-48a2-8bd5-1f8750c6a6b6 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:56.877425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91e0a2-a246-40b5-8719-a608c6541a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:56.878135 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91e0a2-a246-40b5-8719-a608c6541a81 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:56.878421 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91e0a2-a246-40b5-8719-a608c6541a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:56.878700 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91e0a2-a246-40b5-8719-a608c6541a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:56.879487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91e0a2-a246-40b5-8719-a608c6541a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:56.881122 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91e0a2-a246-40b5-8719-a608c6541a81 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:56.892997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1233/2485] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:35:56 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:35:56.897741 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f75966-598d-4fa8-8e14-7d23e906f4a4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:56.908707 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f75966-598d-4fa8-8e14-7d23e906f4a4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:56.913568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245a6e3-55b9-4af6-8c9c-e9980aa81aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:56.914459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245a6e3-55b9-4af6-8c9c-e9980aa81aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:56.914761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245a6e3-55b9-4af6-8c9c-e9980aa81aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:56.915069 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245a6e3-55b9-4af6-8c9c-e9980aa81aa1 admin admin] PATH_INFO: `/v3/projects/bb0ac6d4548e486492887beb2e915bdb/users/7774ea10bce345cabd96a0c94eda98b3/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:56.931073 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245a6e3-55b9-4af6-8c9c-e9980aa81aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0ac6d4548e486492887beb2e915bdb, user_id=7774ea10bce345cabd96a0c94eda98b3, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:56.933794 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245a6e3-55b9-4af6-8c9c-e9980aa81aa1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:56.965755 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1253/2486] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:35:56 2021] PUT /identity/v3/projects/bb0ac6d4548e486492887beb2e915bdb/users/7774ea10bce345cabd96a0c94eda98b3/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:35:56.971456 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b251a15-61da-417b-80ce-13691a6815d6 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:56.971895 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b251a15-61da-417b-80ce-13691a6815d6 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:56.972186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b251a15-61da-417b-80ce-13691a6815d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:57.012526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-4b251a15-61da-417b-80ce-13691a6815d6 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:35:57.013889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4b251a15-61da-417b-80ce-13691a6815d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:57.075836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1234/2487] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:35:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:35:57.085685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245a6e3-55b9-4af6-8c9c-e9980aa81aa1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:57.087404 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-1245a6e3-55b9-4af6-8c9c-e9980aa81aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:57.143725 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245a6e3-55b9-4af6-8c9c-e9980aa81aa1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:57.147451 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43b406-4bd1-4abd-b1ad-30c604d2b010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:57.148096 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43b406-4bd1-4abd-b1ad-30c604d2b010 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:57.148382 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43b406-4bd1-4abd-b1ad-30c604d2b010 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:57.148659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43b406-4bd1-4abd-b1ad-30c604d2b010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:57.162394 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43b406-4bd1-4abd-b1ad-30c604d2b010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:57.163660 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43b406-4bd1-4abd-b1ad-30c604d2b010 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:57.173892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1254/2488] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:58.244611 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b251a15-61da-417b-80ce-13691a6815d6 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:58.247149 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4b251a15-61da-417b-80ce-13691a6815d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:58.259230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b251a15-61da-417b-80ce-13691a6815d6 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:58.270553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc86648-b589-44fb-8ac4-0f5c056185e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:58.271599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc86648-b589-44fb-8ac4-0f5c056185e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:58.272050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc86648-b589-44fb-8ac4-0f5c056185e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:58.272428 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc86648-b589-44fb-8ac4-0f5c056185e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:58.274400 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0cc86648-b589-44fb-8ac4-0f5c056185e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:58.360189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc86648-b589-44fb-8ac4-0f5c056185e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:58.362312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc86648-b589-44fb-8ac4-0f5c056185e6 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:58.377245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1235/2489] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:35:58.571876 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43b406-4bd1-4abd-b1ad-30c604d2b010 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:35:58.581877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43b406-4bd1-4abd-b1ad-30c604d2b010 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:35:58.587556 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659236b-cd54-4b2b-b786-dbf89f2c7995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:35:58.588647 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659236b-cd54-4b2b-b786-dbf89f2c7995 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:35:58.588941 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659236b-cd54-4b2b-b786-dbf89f2c7995 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:35:58.589216 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659236b-cd54-4b2b-b786-dbf89f2c7995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:35:58.591157 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-7659236b-cd54-4b2b-b786-dbf89f2c7995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:35:58.617412 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659236b-cd54-4b2b-b786-dbf89f2c7995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:35:58.618915 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659236b-cd54-4b2b-b786-dbf89f2c7995 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:35:58.631903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1255/2490] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:35:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:01.645536 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e23c6-8421-4c7a-a856-9261e23d7c98 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:01.646040 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e23c6-8421-4c7a-a856-9261e23d7c98 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:01.646160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e23c6-8421-4c7a-a856-9261e23d7c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:01.674552 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-1a3e23c6-8421-4c7a-a856-9261e23d7c98 None None] MFA Rules not processed for user `7774ea10bce345cabd96a0c94eda98b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:01.676185 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-1a3e23c6-8421-4c7a-a856-9261e23d7c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:01.752082 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1236/2491] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:36:01 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:01.755822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659236b-cd54-4b2b-b786-dbf89f2c7995 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:01.770943 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659236b-cd54-4b2b-b786-dbf89f2c7995 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:01.783754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4266111-cdec-4b27-a584-38acb9538ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:01.784520 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4266111-cdec-4b27-a584-38acb9538ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:01.784880 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4266111-cdec-4b27-a584-38acb9538ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:01.785231 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4266111-cdec-4b27-a584-38acb9538ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:01.786028 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4266111-cdec-4b27-a584-38acb9538ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:01.788101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4266111-cdec-4b27-a584-38acb9538ab1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:01.825433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1256/2492] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:01 2021] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:36:01.829434 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e23c6-8421-4c7a-a856-9261e23d7c98 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:01.841875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e23c6-8421-4c7a-a856-9261e23d7c98 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:01.907250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a35d27-e8ec-4c22-a79e-85a5ecbaf3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:01.907857 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a35d27-e8ec-4c22-a79e-85a5ecbaf3bd admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:01.908141 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a35d27-e8ec-4c22-a79e-85a5ecbaf3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:01.908426 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a35d27-e8ec-4c22-a79e-85a5ecbaf3bd admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:01.909158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a35d27-e8ec-4c22-a79e-85a5ecbaf3bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:01.911262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a35d27-e8ec-4c22-a79e-85a5ecbaf3bd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:01.935219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1237/2493] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:01 2021] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:01.936413 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4266111-cdec-4b27-a584-38acb9538ab1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:01.947157 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4266111-cdec-4b27-a584-38acb9538ab1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:01.951922 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f9086-08cc-4e74-b76e-f30fea3a3b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:01.952598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f9086-08cc-4e74-b76e-f30fea3a3b1e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:01.952884 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f9086-08cc-4e74-b76e-f30fea3a3b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:01.953328 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f9086-08cc-4e74-b76e-f30fea3a3b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:01.954081 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f9086-08cc-4e74-b76e-f30fea3a3b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:01.955725 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f9086-08cc-4e74-b76e-f30fea3a3b1e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:01.968989 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1257/2494] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:01 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:01.973475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a35d27-e8ec-4c22-a79e-85a5ecbaf3bd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:01.984291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a35d27-e8ec-4c22-a79e-85a5ecbaf3bd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:01.988986 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636d5d8-7279-4073-ac04-d22457d7f92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:01.989876 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636d5d8-7279-4073-ac04-d22457d7f92f admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:01.990160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636d5d8-7279-4073-ac04-d22457d7f92f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:01.990439 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636d5d8-7279-4073-ac04-d22457d7f92f admin admin] PATH_INFO: `/v3/projects/c7eab11f9bb1411c9559a3ec8184b9c5/users/61003898c1ed47b181ef387133342017/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:02.006465 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636d5d8-7279-4073-ac04-d22457d7f92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7eab11f9bb1411c9559a3ec8184b9c5, user_id=61003898c1ed47b181ef387133342017, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:02.009099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636d5d8-7279-4073-ac04-d22457d7f92f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:02.023964 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1238/2495] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:01 2021] PUT /identity/v3/projects/c7eab11f9bb1411c9559a3ec8184b9c5/users/61003898c1ed47b181ef387133342017/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:02.028584 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f9086-08cc-4e74-b76e-f30fea3a3b1e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:02.040274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f9086-08cc-4e74-b76e-f30fea3a3b1e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:02.098492 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89451e1f-ad8e-46ee-8157-22f655f0eac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:02.099208 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89451e1f-ad8e-46ee-8157-22f655f0eac2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:02.099498 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89451e1f-ad8e-46ee-8157-22f655f0eac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:02.099779 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89451e1f-ad8e-46ee-8157-22f655f0eac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:02.100531 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89451e1f-ad8e-46ee-8157-22f655f0eac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:02.102149 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89451e1f-ad8e-46ee-8157-22f655f0eac2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:02.115913 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1258/2496] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:02 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:36:02.119724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636d5d8-7279-4073-ac04-d22457d7f92f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:02.130193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636d5d8-7279-4073-ac04-d22457d7f92f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:02.134985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91726f-ddea-4c82-b710-3e4d90dde736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:02.135873 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91726f-ddea-4c82-b710-3e4d90dde736 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:02.136164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91726f-ddea-4c82-b710-3e4d90dde736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:02.136449 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91726f-ddea-4c82-b710-3e4d90dde736 admin admin] PATH_INFO: `/v3/projects/c7eab11f9bb1411c9559a3ec8184b9c5/users/61003898c1ed47b181ef387133342017/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:02.139115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91726f-ddea-4c82-b710-3e4d90dde736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7eab11f9bb1411c9559a3ec8184b9c5, user_id=61003898c1ed47b181ef387133342017, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:02.141816 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91726f-ddea-4c82-b710-3e4d90dde736 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:02.153878 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1239/2497] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:02 2021] PUT /identity/v3/projects/c7eab11f9bb1411c9559a3ec8184b9c5/users/61003898c1ed47b181ef387133342017/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:06.308496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89451e1f-ad8e-46ee-8157-22f655f0eac2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:06.311385 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-89451e1f-ad8e-46ee-8157-22f655f0eac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:06.430804 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89451e1f-ad8e-46ee-8157-22f655f0eac2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:06.526446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ddc30-733b-47f5-9a95-429480276c76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:06.528517 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ddc30-733b-47f5-9a95-429480276c76 service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:06.528973 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ddc30-733b-47f5-9a95-429480276c76 service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:06.529458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ddc30-733b-47f5-9a95-429480276c76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:06.532777 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2c8ddc30-733b-47f5-9a95-429480276c76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:06.606138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ddc30-733b-47f5-9a95-429480276c76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:06.606913 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ddc30-733b-47f5-9a95-429480276c76 service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:06.617443 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1259/2498] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:06 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:07.429163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d31a6-6205-43a2-8d6b-a19ca5e06965 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:07.429738 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d31a6-6205-43a2-8d6b-a19ca5e06965 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:07.430164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d31a6-6205-43a2-8d6b-a19ca5e06965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:07.458803 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-9f2d31a6-6205-43a2-8d6b-a19ca5e06965 None None] MFA Rules not processed for user `61003898c1ed47b181ef387133342017`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:07.460319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9f2d31a6-6205-43a2-8d6b-a19ca5e06965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:07.543403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1240/2499] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:36:07 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:07.555058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ddc30-733b-47f5-9a95-429480276c76 service nova] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:07.576168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ddc30-733b-47f5-9a95-429480276c76 service nova] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:07.576168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f71f24-125c-4050-91c5-82db96a597ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:07.576168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f71f24-125c-4050-91c5-82db96a597ca service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:07.576168 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f71f24-125c-4050-91c5-82db96a597ca service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:07.576652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f71f24-125c-4050-91c5-82db96a597ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:07.659557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f71f24-125c-4050-91c5-82db96a597ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:07.662131 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f71f24-125c-4050-91c5-82db96a597ca service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:07.672817 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1260/2500] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:07 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:09.006921 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca749f-b978-44bd-bd54-54b7946617b3 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:09.007792 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca749f-b978-44bd-bd54-54b7946617b3 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:09.008473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca749f-b978-44bd-bd54-54b7946617b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:09.028302 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a6ca749f-b978-44bd-bd54-54b7946617b3 None None] MFA Rules not processed for user `7774ea10bce345cabd96a0c94eda98b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:09.029532 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a6ca749f-b978-44bd-bd54-54b7946617b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:09.037346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1241/2501] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:36:09 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:18.044049 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f71f24-125c-4050-91c5-82db96a597ca service nova] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:18.095848 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f71f24-125c-4050-91c5-82db96a597ca service nova] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:18.099543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b66833-f34b-4c99-9493-94748586166a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:18.100176 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b66833-f34b-4c99-9493-94748586166a service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:18.100455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b66833-f34b-4c99-9493-94748586166a service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:18.100728 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b66833-f34b-4c99-9493-94748586166a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:18.102433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-66b66833-f34b-4c99-9493-94748586166a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:18.112353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b66833-f34b-4c99-9493-94748586166a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:18.113749 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b66833-f34b-4c99-9493-94748586166a service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:18.121979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1261/2502] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:18 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:23.770183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca749f-b978-44bd-bd54-54b7946617b3 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:23.779253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a6ca749f-b978-44bd-bd54-54b7946617b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:23.839652 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca749f-b978-44bd-bd54-54b7946617b3 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:23.845194 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf9fe1-367f-455d-9eca-9a554ceee0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:23.846061 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf9fe1-367f-455d-9eca-9a554ceee0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:23.846363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf9fe1-367f-455d-9eca-9a554ceee0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:23.846624 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf9fe1-367f-455d-9eca-9a554ceee0e7 admin admin] PATH_INFO: `/v3/users/36294768833043cebd4d4c8050eeef29` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:23.847896 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf9fe1-367f-455d-9eca-9a554ceee0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36294768833043cebd4d4c8050eeef29)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:23.849935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf9fe1-367f-455d-9eca-9a554ceee0e7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:23.899476 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-dacf9fe1-367f-455d-9eca-9a554ceee0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36294768833043cebd4d4c8050eeef29'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:23.911236 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-dacf9fe1-367f-455d-9eca-9a554ceee0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36294768833043cebd4d4c8050eeef29'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:23.918115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-dacf9fe1-367f-455d-9eca-9a554ceee0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36294768833043cebd4d4c8050eeef29'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:23.925273 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-dacf9fe1-367f-455d-9eca-9a554ceee0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36294768833043cebd4d4c8050eeef29'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:23.925938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-dacf9fe1-367f-455d-9eca-9a554ceee0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36294768833043cebd4d4c8050eeef29'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:23.931851 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1242/2503] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:23 2021] DELETE /identity/v3/users/36294768833043cebd4d4c8050eeef29 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:23.936513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2cf35-1c36-45bb-addb-e7276da54624 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:23.937016 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2cf35-1c36-45bb-addb-e7276da54624 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:23.937204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2cf35-1c36-45bb-addb-e7276da54624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:23.957394 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-acb2cf35-1c36-45bb-addb-e7276da54624 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:23.958516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-acb2cf35-1c36-45bb-addb-e7276da54624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:24.019625 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1262/2504] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:36:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:24.030342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf9fe1-367f-455d-9eca-9a554ceee0e7 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.031782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-dacf9fe1-367f-455d-9eca-9a554ceee0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:24.092346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf9fe1-367f-455d-9eca-9a554ceee0e7 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.096043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465ba25-21f5-427a-95d2-aeb4a378cf02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.096688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465ba25-21f5-427a-95d2-aeb4a378cf02 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.096975 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465ba25-21f5-427a-95d2-aeb4a378cf02 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.097257 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465ba25-21f5-427a-95d2-aeb4a378cf02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.106681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465ba25-21f5-427a-95d2-aeb4a378cf02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.108158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465ba25-21f5-427a-95d2-aeb4a378cf02 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.117403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1243/2505] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:24.384419 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2cf35-1c36-45bb-addb-e7276da54624 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.386079 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-acb2cf35-1c36-45bb-addb-e7276da54624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:24.401448 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2cf35-1c36-45bb-addb-e7276da54624 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.406890 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.407844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.408011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.408355 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8 admin admin] PATH_INFO: `/v3/projects/3e48482797da42b0a9baccb4fdd73e84` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.409603 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e48482797da42b0a9baccb4fdd73e84)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.411497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.458134 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e48482797da42b0a9baccb4fdd73e84', 'request_id': 'req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:24.465439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e48482797da42b0a9baccb4fdd73e84', 'request_id': 'req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:24.471698 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e48482797da42b0a9baccb4fdd73e84', 'request_id': 'req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:24.481913 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8 admin admin] The token cache is being invalidate because project 3e48482797da42b0a9baccb4fdd73e84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:24.482194 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:24.482835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-aa78dc19-ca55-49eb-86ef-ffd85001a9e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:24.484371 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1263/2506] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:24 2021] DELETE /identity/v3/projects/3e48482797da42b0a9baccb4fdd73e84 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:36:24.490340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec3c0-08ed-4fb1-8e91-99942ece852c None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.490675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec3c0-08ed-4fb1-8e91-99942ece852c None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.491122 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec3c0-08ed-4fb1-8e91-99942ece852c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.509209 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-623ec3c0-08ed-4fb1-8e91-99942ece852c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:24.510415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-623ec3c0-08ed-4fb1-8e91-99942ece852c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:24.569142 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1244/2507] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:36:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:24.577851 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7c7b1-31dd-476f-8e23-eda44df90066 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.578626 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7c7b1-31dd-476f-8e23-eda44df90066 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.578626 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7c7b1-31dd-476f-8e23-eda44df90066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.597329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-88e7c7b1-31dd-476f-8e23-eda44df90066 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:24.598529 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-88e7c7b1-31dd-476f-8e23-eda44df90066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:24.606574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1264/2508] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:36:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:24.610839 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ec3c0-08ed-4fb1-8e91-99942ece852c None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.620483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ec3c0-08ed-4fb1-8e91-99942ece852c None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.625140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461cdcb-3a85-4f75-9611-58b9adfa5788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.625790 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461cdcb-3a85-4f75-9611-58b9adfa5788 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.626090 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461cdcb-3a85-4f75-9611-58b9adfa5788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.626550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461cdcb-3a85-4f75-9611-58b9adfa5788 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.627334 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461cdcb-3a85-4f75-9611-58b9adfa5788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:24.627648 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461cdcb-3a85-4f75-9611-58b9adfa5788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.629269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461cdcb-3a85-4f75-9611-58b9adfa5788 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.641564 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1245/2509] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:24.645832 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7c7b1-31dd-476f-8e23-eda44df90066 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.655608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7c7b1-31dd-476f-8e23-eda44df90066 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.661953 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e82c1-b071-4ebd-9eff-b3c3243788b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.663536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e82c1-b071-4ebd-9eff-b3c3243788b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.663824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e82c1-b071-4ebd-9eff-b3c3243788b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.664105 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e82c1-b071-4ebd-9eff-b3c3243788b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.664843 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e82c1-b071-4ebd-9eff-b3c3243788b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.666766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e82c1-b071-4ebd-9eff-b3c3243788b5 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.694118 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1265/2510] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:24 2021] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:24.698640 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461cdcb-3a85-4f75-9611-58b9adfa5788 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.710534 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461cdcb-3a85-4f75-9611-58b9adfa5788 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.769274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffed5ca-c8e8-4b50-86de-5104184ffb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.769941 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed5ca-c8e8-4b50-86de-5104184ffb73 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.770256 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed5ca-c8e8-4b50-86de-5104184ffb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.770807 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed5ca-c8e8-4b50-86de-5104184ffb73 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.771268 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffed5ca-c8e8-4b50-86de-5104184ffb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.773177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffed5ca-c8e8-4b50-86de-5104184ffb73 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.792756 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1246/2511] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:24 2021] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:36:24.796986 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e82c1-b071-4ebd-9eff-b3c3243788b5 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.808390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e82c1-b071-4ebd-9eff-b3c3243788b5 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.813657 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e5cc-a168-40db-aa8b-e4ff1801ef0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.814710 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e5cc-a168-40db-aa8b-e4ff1801ef0b admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.814710 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e5cc-a168-40db-aa8b-e4ff1801ef0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.814943 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e5cc-a168-40db-aa8b-e4ff1801ef0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.815683 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e5cc-a168-40db-aa8b-e4ff1801ef0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.817290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e5cc-a168-40db-aa8b-e4ff1801ef0b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.828717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1266/2512] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:36:24.832905 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffed5ca-c8e8-4b50-86de-5104184ffb73 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.843678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffed5ca-c8e8-4b50-86de-5104184ffb73 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.849347 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeee44-9ae2-4083-b9f0-621b99ebba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.850006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeee44-9ae2-4083-b9f0-621b99ebba71 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.850284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeee44-9ae2-4083-b9f0-621b99ebba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.850557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeee44-9ae2-4083-b9f0-621b99ebba71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.851409 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeee44-9ae2-4083-b9f0-621b99ebba71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.853035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeee44-9ae2-4083-b9f0-621b99ebba71 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.864046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1247/2513] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:24.868075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e5cc-a168-40db-aa8b-e4ff1801ef0b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.879006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e5cc-a168-40db-aa8b-e4ff1801ef0b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.884240 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2691aa-2b15-47a2-b750-3fa11d94f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.885259 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2691aa-2b15-47a2-b750-3fa11d94f93c admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.885533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2691aa-2b15-47a2-b750-3fa11d94f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.885813 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2691aa-2b15-47a2-b750-3fa11d94f93c admin admin] PATH_INFO: `/v3/projects/d34439291532491a9465faeb3494359c/users/d09cf32e1d53403dbcbdde406e19c5ae/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.901798 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2691aa-2b15-47a2-b750-3fa11d94f93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d34439291532491a9465faeb3494359c, user_id=d09cf32e1d53403dbcbdde406e19c5ae, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.905158 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2691aa-2b15-47a2-b750-3fa11d94f93c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.929459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1267/2514] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:24 2021] PUT /identity/v3/projects/d34439291532491a9465faeb3494359c/users/d09cf32e1d53403dbcbdde406e19c5ae/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:24.932368 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c06943-2390-4ac1-9352-4486f8c8bb8d None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.932881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c06943-2390-4ac1-9352-4486f8c8bb8d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.933264 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c06943-2390-4ac1-9352-4486f8c8bb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.966576 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-35c06943-2390-4ac1-9352-4486f8c8bb8d None None] MFA Rules not processed for user `d09cf32e1d53403dbcbdde406e19c5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:24.967751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-35c06943-2390-4ac1-9352-4486f8c8bb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:25.032517 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1248/2515] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:36:24 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:25.045803 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2691aa-2b15-47a2-b750-3fa11d94f93c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:25.048029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-dc2691aa-2b15-47a2-b750-3fa11d94f93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:25.115968 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2691aa-2b15-47a2-b750-3fa11d94f93c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:25.120642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9487333-3d6a-4721-bc00-594a90af35cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:25.121978 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9487333-3d6a-4721-bc00-594a90af35cd service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:25.122269 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9487333-3d6a-4721-bc00-594a90af35cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:25.122585 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9487333-3d6a-4721-bc00-594a90af35cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:25.131602 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9487333-3d6a-4721-bc00-594a90af35cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:25.133244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9487333-3d6a-4721-bc00-594a90af35cd service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:25.143870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1268/2516] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:25 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:36.254620 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbe66e-d2a4-4bb6-b586-05d60c31e658 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:36.255108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbe66e-d2a4-4bb6-b586-05d60c31e658 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:36.255357 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbe66e-d2a4-4bb6-b586-05d60c31e658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:36.274380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-c4bbe66e-d2a4-4bb6-b586-05d60c31e658 None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:36.275611 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c4bbe66e-d2a4-4bb6-b586-05d60c31e658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:36.333755 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1249/2517] 10.222.0.60 () {58 vars in 967 bytes} [Wed Dec 15 13:36:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:36.357823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9487333-3d6a-4721-bc00-594a90af35cd service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:36.359354 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a9487333-3d6a-4721-bc00-594a90af35cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:36.427994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9487333-3d6a-4721-bc00-594a90af35cd service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:36.432889 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf6024-83b3-439a-bc9c-0b876b788714 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:36.433580 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf6024-83b3-439a-bc9c-0b876b788714 service swift] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:36.433886 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf6024-83b3-439a-bc9c-0b876b788714 service swift] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:36.434161 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf6024-83b3-439a-bc9c-0b876b788714 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:36.446028 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf6024-83b3-439a-bc9c-0b876b788714 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:36.447646 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf6024-83b3-439a-bc9c-0b876b788714 service swift] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:36.457666 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1269/2518] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:36:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:36:44.547793 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbe66e-d2a4-4bb6-b586-05d60c31e658 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:44.617029 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbe66e-d2a4-4bb6-b586-05d60c31e658 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:44.621773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231d19f-c6eb-4717-8689-144341f796f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:44.622768 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d19f-c6eb-4717-8689-144341f796f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:44.623245 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d19f-c6eb-4717-8689-144341f796f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:44.623702 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d19f-c6eb-4717-8689-144341f796f5 admin admin] PATH_INFO: `/v3/users/d09cf32e1d53403dbcbdde406e19c5ae` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:44.625022 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231d19f-c6eb-4717-8689-144341f796f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d09cf32e1d53403dbcbdde406e19c5ae)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:44.626833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231d19f-c6eb-4717-8689-144341f796f5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:44.674701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-5231d19f-c6eb-4717-8689-144341f796f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd09cf32e1d53403dbcbdde406e19c5ae'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:44.685960 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-5231d19f-c6eb-4717-8689-144341f796f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd09cf32e1d53403dbcbdde406e19c5ae'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:44.693358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-5231d19f-c6eb-4717-8689-144341f796f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd09cf32e1d53403dbcbdde406e19c5ae'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:44.700521 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-5231d19f-c6eb-4717-8689-144341f796f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd09cf32e1d53403dbcbdde406e19c5ae'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:44.701155 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-5231d19f-c6eb-4717-8689-144341f796f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd09cf32e1d53403dbcbdde406e19c5ae'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:44.706917 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1250/2519] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:44 2021] DELETE /identity/v3/users/d09cf32e1d53403dbcbdde406e19c5ae => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:44.711378 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c076ac-1fb2-41c6-ab51-25e1b2ec489d None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:44.711814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c076ac-1fb2-41c6-ab51-25e1b2ec489d None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:44.711948 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c076ac-1fb2-41c6-ab51-25e1b2ec489d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:44.730246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-93c076ac-1fb2-41c6-ab51-25e1b2ec489d None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:44.732066 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-93c076ac-1fb2-41c6-ab51-25e1b2ec489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:44.789078 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1270/2520] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:36:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:44.799441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231d19f-c6eb-4717-8689-144341f796f5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:44.800848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5231d19f-c6eb-4717-8689-144341f796f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:44.860790 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231d19f-c6eb-4717-8689-144341f796f5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:44.864388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e08f77-3059-4743-8579-12317a8ffb4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:44.865017 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e08f77-3059-4743-8579-12317a8ffb4c service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:44.865296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e08f77-3059-4743-8579-12317a8ffb4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:44.865571 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e08f77-3059-4743-8579-12317a8ffb4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:44.874805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e08f77-3059-4743-8579-12317a8ffb4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:44.876271 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e08f77-3059-4743-8579-12317a8ffb4c service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:44.885578 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1251/2521] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:45.144726 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c076ac-1fb2-41c6-ab51-25e1b2ec489d None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:45.146596 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-93c076ac-1fb2-41c6-ab51-25e1b2ec489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:45.162394 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c076ac-1fb2-41c6-ab51-25e1b2ec489d None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:45.167262 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:45.168291 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:45.168657 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:45.168996 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] PATH_INFO: `/v3/projects/d34439291532491a9465faeb3494359c` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:45.170797 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d34439291532491a9465faeb3494359c)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:45.172737 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:45.219197 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd34439291532491a9465faeb3494359c', 'request_id': 'req-6b17de71-257e-48fd-b760-e6d45b6f40d6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:45.226036 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd34439291532491a9465faeb3494359c', 'request_id': 'req-6b17de71-257e-48fd-b760-e6d45b6f40d6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:45.232151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd34439291532491a9465faeb3494359c', 'request_id': 'req-6b17de71-257e-48fd-b760-e6d45b6f40d6'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:45.242062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] The token cache is being invalidate because project d34439291532491a9465faeb3494359c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:45.242351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:45.243014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:45.244703 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1271/2522] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:45 2021] DELETE /identity/v3/projects/d34439291532491a9465faeb3494359c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:55.940405 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e08f77-3059-4743-8579-12317a8ffb4c service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:55.949100 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e08f77-3059-4743-8579-12317a8ffb4c service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:56.005928 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c32b-da7a-4fc9-8ab7-f8dc2a48984b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:56.006566 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c32b-da7a-4fc9-8ab7-f8dc2a48984b service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.006862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c32b-da7a-4fc9-8ab7-f8dc2a48984b service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.007156 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c32b-da7a-4fc9-8ab7-f8dc2a48984b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.008928 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a7c0c32b-da7a-4fc9-8ab7-f8dc2a48984b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:56.017846 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0c32b-da7a-4fc9-8ab7-f8dc2a48984b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:56.019317 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0c32b-da7a-4fc9-8ab7-f8dc2a48984b service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:56.027646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1252/2523] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:55 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:56.457202 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:56.458622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:56.461633 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c32b-da7a-4fc9-8ab7-f8dc2a48984b service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:56.463039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a7c0c32b-da7a-4fc9-8ab7-f8dc2a48984b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:56.528556 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17de71-257e-48fd-b760-e6d45b6f40d6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:56.533082 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b050d80-0ba3-4cf7-a60f-3a49a3b52c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:56.533942 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b050d80-0ba3-4cf7-a60f-3a49a3b52c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.534226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b050d80-0ba3-4cf7-a60f-3a49a3b52c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.534507 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b050d80-0ba3-4cf7-a60f-3a49a3b52c83 admin admin] PATH_INFO: `/v3/users/7791c1376d244085ae676b2bb2b43738` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.535774 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b050d80-0ba3-4cf7-a60f-3a49a3b52c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7791c1376d244085ae676b2bb2b43738)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:56.536443 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c32b-da7a-4fc9-8ab7-f8dc2a48984b service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:56.537678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b050d80-0ba3-4cf7-a60f-3a49a3b52c83 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:56.541543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d2669-eceb-44dd-9869-f9d02c83c421 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e05695f0d91463bae1f2a67a58cb54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:56.542183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d2669-eceb-44dd-9869-f9d02c83c421 service placement] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.542476 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d2669-eceb-44dd-9869-f9d02c83c421 service placement] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.542782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d2669-eceb-44dd-9869-f9d02c83c421 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.544598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-bf0d2669-eceb-44dd-9869-f9d02c83c421 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:56.556105 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d2669-eceb-44dd-9869-f9d02c83c421 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:56.557683 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d2669-eceb-44dd-9869-f9d02c83c421 service placement] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:56.568419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1253/2524] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:56 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:36:56.584914 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3b050d80-0ba3-4cf7-a60f-3a49a3b52c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7791c1376d244085ae676b2bb2b43738'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.596363 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3b050d80-0ba3-4cf7-a60f-3a49a3b52c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7791c1376d244085ae676b2bb2b43738'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.603279 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3b050d80-0ba3-4cf7-a60f-3a49a3b52c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7791c1376d244085ae676b2bb2b43738'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.610515 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3b050d80-0ba3-4cf7-a60f-3a49a3b52c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7791c1376d244085ae676b2bb2b43738'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.611173 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3b050d80-0ba3-4cf7-a60f-3a49a3b52c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7791c1376d244085ae676b2bb2b43738'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.616933 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1272/2525] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:56 2021] DELETE /identity/v3/users/7791c1376d244085ae676b2bb2b43738 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:56.622173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b6fc0-3027-47b6-8a83-d70e91ba7443 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.622650 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b6fc0-3027-47b6-8a83-d70e91ba7443 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.623099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b6fc0-3027-47b6-8a83-d70e91ba7443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.644608 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-349b6fc0-3027-47b6-8a83-d70e91ba7443 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:56.645980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-349b6fc0-3027-47b6-8a83-d70e91ba7443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:56.711244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1254/2526] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:36:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:56.721875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b050d80-0ba3-4cf7-a60f-3a49a3b52c83 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:56.723338 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3b050d80-0ba3-4cf7-a60f-3a49a3b52c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:56.781712 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b050d80-0ba3-4cf7-a60f-3a49a3b52c83 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:56.786035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f68fe2-5003-448f-b11d-63291fe5e5b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:56.786685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f68fe2-5003-448f-b11d-63291fe5e5b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.787006 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f68fe2-5003-448f-b11d-63291fe5e5b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.787287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f68fe2-5003-448f-b11d-63291fe5e5b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.797337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f68fe2-5003-448f-b11d-63291fe5e5b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:56.798870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f68fe2-5003-448f-b11d-63291fe5e5b8 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:56.809191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1273/2527] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:57.076860 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b6fc0-3027-47b6-8a83-d70e91ba7443 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.078541 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-349b6fc0-3027-47b6-8a83-d70e91ba7443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:57.091207 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b6fc0-3027-47b6-8a83-d70e91ba7443 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.098348 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f25646-3415-4d39-b784-bc88f316e2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.099541 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f25646-3415-4d39-b784-bc88f316e2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.099952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f25646-3415-4d39-b784-bc88f316e2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.100422 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f25646-3415-4d39-b784-bc88f316e2af admin admin] PATH_INFO: `/v3/projects/4b281078faad41b9a0f84ea9206f9d6d` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.101963 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f25646-3415-4d39-b784-bc88f316e2af admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b281078faad41b9a0f84ea9206f9d6d)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.103945 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f25646-3415-4d39-b784-bc88f316e2af admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.153124 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d7f25646-3415-4d39-b784-bc88f316e2af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b281078faad41b9a0f84ea9206f9d6d', 'request_id': 'req-d7f25646-3415-4d39-b784-bc88f316e2af'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.160117 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d7f25646-3415-4d39-b784-bc88f316e2af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b281078faad41b9a0f84ea9206f9d6d', 'request_id': 'req-d7f25646-3415-4d39-b784-bc88f316e2af'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.165670 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d7f25646-3415-4d39-b784-bc88f316e2af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b281078faad41b9a0f84ea9206f9d6d', 'request_id': 'req-d7f25646-3415-4d39-b784-bc88f316e2af'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.177502 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d7f25646-3415-4d39-b784-bc88f316e2af admin admin] The token cache is being invalidate because project 4b281078faad41b9a0f84ea9206f9d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:57.177785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d7f25646-3415-4d39-b784-bc88f316e2af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.178406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d7f25646-3415-4d39-b784-bc88f316e2af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.179957 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1255/2528] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:57 2021] DELETE /identity/v3/projects/4b281078faad41b9a0f84ea9206f9d6d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:57.186149 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824b6c0-531a-4af6-91d4-678f37754752 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.186446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824b6c0-531a-4af6-91d4-678f37754752 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.186736 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824b6c0-531a-4af6-91d4-678f37754752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.205766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-0824b6c0-531a-4af6-91d4-678f37754752 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:57.207005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-0824b6c0-531a-4af6-91d4-678f37754752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:57.262718 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1274/2529] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:36:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:57.270498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f5cf7-d04f-47fc-8156-ebd5e13f03ec None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.270783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f5cf7-d04f-47fc-8156-ebd5e13f03ec None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.271091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f5cf7-d04f-47fc-8156-ebd5e13f03ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.289118 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-df2f5cf7-d04f-47fc-8156-ebd5e13f03ec None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:57.290290 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-df2f5cf7-d04f-47fc-8156-ebd5e13f03ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:57.298478 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1256/2530] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:36:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:57.302453 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824b6c0-531a-4af6-91d4-678f37754752 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.311776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824b6c0-531a-4af6-91d4-678f37754752 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.316287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0068f90-eb13-43a9-b401-0d78f71f23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.316929 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0068f90-eb13-43a9-b401-0d78f71f23c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.317213 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0068f90-eb13-43a9-b401-0d78f71f23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.317491 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0068f90-eb13-43a9-b401-0d78f71f23c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.318225 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0068f90-eb13-43a9-b401-0d78f71f23c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:57.318533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0068f90-eb13-43a9-b401-0d78f71f23c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.320163 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0068f90-eb13-43a9-b401-0d78f71f23c0 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.331639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1275/2531] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:57.335744 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f5cf7-d04f-47fc-8156-ebd5e13f03ec None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.345099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f5cf7-d04f-47fc-8156-ebd5e13f03ec None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.349693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c764d-8781-47d0-9dee-7c370fdeb657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.350346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c764d-8781-47d0-9dee-7c370fdeb657 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.350628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c764d-8781-47d0-9dee-7c370fdeb657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.350938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c764d-8781-47d0-9dee-7c370fdeb657 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.351638 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c764d-8781-47d0-9dee-7c370fdeb657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.353533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c764d-8781-47d0-9dee-7c370fdeb657 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.377731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1257/2532] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:57 2021] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:57.381732 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0068f90-eb13-43a9-b401-0d78f71f23c0 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.392497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0068f90-eb13-43a9-b401-0d78f71f23c0 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.449411 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbecae5-a942-4927-8729-59de3c83ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.449997 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbecae5-a942-4927-8729-59de3c83ccd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.450276 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbecae5-a942-4927-8729-59de3c83ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.450549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbecae5-a942-4927-8729-59de3c83ccd7 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.451299 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbecae5-a942-4927-8729-59de3c83ccd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.453205 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbecae5-a942-4927-8729-59de3c83ccd7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.475656 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1276/2533] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:57 2021] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:36:57.477888 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c764d-8781-47d0-9dee-7c370fdeb657 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.489178 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c764d-8781-47d0-9dee-7c370fdeb657 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.494594 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a98a3-0070-40a0-9c90-94c2990aaf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.495357 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a98a3-0070-40a0-9c90-94c2990aaf9c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.496054 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a98a3-0070-40a0-9c90-94c2990aaf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.496054 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a98a3-0070-40a0-9c90-94c2990aaf9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.497462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a98a3-0070-40a0-9c90-94c2990aaf9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.499117 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a98a3-0070-40a0-9c90-94c2990aaf9c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.512231 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1258/2534] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:57 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:57.517542 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbecae5-a942-4927-8729-59de3c83ccd7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.529577 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbecae5-a942-4927-8729-59de3c83ccd7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.535198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e5361-0cc9-4b80-83fa-c5975f816ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.536011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e5361-0cc9-4b80-83fa-c5975f816ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.536353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e5361-0cc9-4b80-83fa-c5975f816ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.536638 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e5361-0cc9-4b80-83fa-c5975f816ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.537439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e5361-0cc9-4b80-83fa-c5975f816ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.539295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e5361-0cc9-4b80-83fa-c5975f816ec2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.551130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1277/2535] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:57 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:36:57.555144 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a98a3-0070-40a0-9c90-94c2990aaf9c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.567109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a98a3-0070-40a0-9c90-94c2990aaf9c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.572881 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34708e2a-2abe-4393-896a-9737e51358ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.573797 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34708e2a-2abe-4393-896a-9737e51358ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.574630 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34708e2a-2abe-4393-896a-9737e51358ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.574942 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34708e2a-2abe-4393-896a-9737e51358ab admin admin] PATH_INFO: `/v3/projects/b8066a245289451b8a7cc12d4311b412/users/1fa1533801dc4fa0b79d8662414749d8/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.592208 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34708e2a-2abe-4393-896a-9737e51358ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8066a245289451b8a7cc12d4311b412, user_id=1fa1533801dc4fa0b79d8662414749d8, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.595073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34708e2a-2abe-4393-896a-9737e51358ab admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.616829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1259/2536] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:57 2021] PUT /identity/v3/projects/b8066a245289451b8a7cc12d4311b412/users/1fa1533801dc4fa0b79d8662414749d8/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:36:57.621859 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bf995-2c4a-4f3a-97a9-02154abfbdf5 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.622153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bf995-2c4a-4f3a-97a9-02154abfbdf5 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.622433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bf995-2c4a-4f3a-97a9-02154abfbdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.641542 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-078bf995-2c4a-4f3a-97a9-02154abfbdf5 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:57.643005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-078bf995-2c4a-4f3a-97a9-02154abfbdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:57.716639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1278/2537] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:36:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:57.749801 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34708e2a-2abe-4393-896a-9737e51358ab admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.751616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-34708e2a-2abe-4393-896a-9737e51358ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:57.806557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34708e2a-2abe-4393-896a-9737e51358ab admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.810233 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f9d8f-65e5-4e4f-8f4e-9e39374a4a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.810894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f9d8f-65e5-4e4f-8f4e-9e39374a4a6e service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.811183 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f9d8f-65e5-4e4f-8f4e-9e39374a4a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.811461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f9d8f-65e5-4e4f-8f4e-9e39374a4a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.826307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f9d8f-65e5-4e4f-8f4e-9e39374a4a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.827860 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f9d8f-65e5-4e4f-8f4e-9e39374a4a6e service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.837616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1260/2538] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:58.778715 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ed24-6a19-48dd-9fe3-da39acc0c909 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.779956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ed24-6a19-48dd-9fe3-da39acc0c909 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.780418 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ed24-6a19-48dd-9fe3-da39acc0c909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.818119 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-fa18ed24-6a19-48dd-9fe3-da39acc0c909 None None] MFA Rules not processed for user `1fa1533801dc4fa0b79d8662414749d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:58.820285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-fa18ed24-6a19-48dd-9fe3-da39acc0c909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:58.905247 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1279/2539] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:36:58 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:58.915862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f9d8f-65e5-4e4f-8f4e-9e39374a4a6e service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:58.917391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4b2f9d8f-65e5-4e4f-8f4e-9e39374a4a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:59.008471 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f9d8f-65e5-4e4f-8f4e-9e39374a4a6e service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:59.013372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a14385-0b6d-4546-8ee6-3a899e22b848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:59.014485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a14385-0b6d-4546-8ee6-3a899e22b848 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:59.014990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a14385-0b6d-4546-8ee6-3a899e22b848 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:59.015485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a14385-0b6d-4546-8ee6-3a899e22b848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:59.027417 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a14385-0b6d-4546-8ee6-3a899e22b848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:59.029165 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a14385-0b6d-4546-8ee6-3a899e22b848 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:59.040024 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1261/2540] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:58 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:59.129068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18ed24-6a19-48dd-9fe3-da39acc0c909 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:59.130574 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-fa18ed24-6a19-48dd-9fe3-da39acc0c909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:59.254678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18ed24-6a19-48dd-9fe3-da39acc0c909 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:59.262705 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66567cd-3666-4d3a-b937-f181d6380ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:59.263704 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66567cd-3666-4d3a-b937-f181d6380ea2 service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:59.264163 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66567cd-3666-4d3a-b937-f181d6380ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:59.264659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66567cd-3666-4d3a-b937-f181d6380ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:59.266684 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c66567cd-3666-4d3a-b937-f181d6380ea2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:59.283594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66567cd-3666-4d3a-b937-f181d6380ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:59.286361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66567cd-3666-4d3a-b937-f181d6380ea2 service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:59.313349 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1280/2541] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:59 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:00.450263 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49048ea-386e-481b-bd7c-880c0ac6d52d None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:00.450767 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49048ea-386e-481b-bd7c-880c0ac6d52d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:00.450897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49048ea-386e-481b-bd7c-880c0ac6d52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:00.467513 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e49048ea-386e-481b-bd7c-880c0ac6d52d None None] MFA Rules not processed for user `1fa1533801dc4fa0b79d8662414749d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:00.468734 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e49048ea-386e-481b-bd7c-880c0ac6d52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:00.475644 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1262/2542] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:37:00 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:07.886397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66567cd-3666-4d3a-b937-f181d6380ea2 service nova] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:07.898740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66567cd-3666-4d3a-b937-f181d6380ea2 service nova] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:07.905101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89e62e-a56a-4405-b57e-486217129d9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:07.905745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89e62e-a56a-4405-b57e-486217129d9a service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:07.906029 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89e62e-a56a-4405-b57e-486217129d9a service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:07.906307 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89e62e-a56a-4405-b57e-486217129d9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:07.908084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9a89e62e-a56a-4405-b57e-486217129d9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:07.921697 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89e62e-a56a-4405-b57e-486217129d9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:07.923305 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89e62e-a56a-4405-b57e-486217129d9a service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:07.934035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1281/2543] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:13.162111 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49048ea-386e-481b-bd7c-880c0ac6d52d None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:13.163520 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e49048ea-386e-481b-bd7c-880c0ac6d52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:13.175137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49048ea-386e-481b-bd7c-880c0ac6d52d None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:13.178681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1518529-9623-4e7d-aabe-ee9043eb3a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:13.179339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1518529-9623-4e7d-aabe-ee9043eb3a69 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:13.179625 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1518529-9623-4e7d-aabe-ee9043eb3a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:13.179905 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1518529-9623-4e7d-aabe-ee9043eb3a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:13.181598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c1518529-9623-4e7d-aabe-ee9043eb3a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:13.244488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1518529-9623-4e7d-aabe-ee9043eb3a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:13.245856 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1518529-9623-4e7d-aabe-ee9043eb3a69 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:13.255625 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1263/2544] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:13 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:14.876100 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89e62e-a56a-4405-b57e-486217129d9a service nova] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:14.877657 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-9a89e62e-a56a-4405-b57e-486217129d9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:14.894086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89e62e-a56a-4405-b57e-486217129d9a service nova] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:14.899569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afda3f-c386-4c56-bced-7adf8677c1bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:14.900207 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afda3f-c386-4c56-bced-7adf8677c1bd service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:14.900486 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afda3f-c386-4c56-bced-7adf8677c1bd service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:14.900760 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afda3f-c386-4c56-bced-7adf8677c1bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:14.903097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-67afda3f-c386-4c56-bced-7adf8677c1bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:14.915506 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afda3f-c386-4c56-bced-7adf8677c1bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:14.917255 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afda3f-c386-4c56-bced-7adf8677c1bd service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:14.928426 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1282/2545] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:14 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:18.951845 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1518529-9623-4e7d-aabe-ee9043eb3a69 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:18.964307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1518529-9623-4e7d-aabe-ee9043eb3a69 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:18.970437 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200c972-7cb6-41da-ade3-0213299bfdb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:18.971111 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200c972-7cb6-41da-ade3-0213299bfdb5 service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:18.971399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200c972-7cb6-41da-ade3-0213299bfdb5 service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:18.971678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200c972-7cb6-41da-ade3-0213299bfdb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:18.973885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9200c972-7cb6-41da-ade3-0213299bfdb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:19.032755 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200c972-7cb6-41da-ade3-0213299bfdb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:19.034346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200c972-7cb6-41da-ade3-0213299bfdb5 service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:19.043830 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1264/2546] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:18 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:43.124699 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afda3f-c386-4c56-bced-7adf8677c1bd service nova] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.135614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afda3f-c386-4c56-bced-7adf8677c1bd service nova] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.141733 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063736d3-0acb-4acd-a2ab-7fb245371c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:43.142363 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063736d3-0acb-4acd-a2ab-7fb245371c4c service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.142651 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063736d3-0acb-4acd-a2ab-7fb245371c4c service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.142968 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063736d3-0acb-4acd-a2ab-7fb245371c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.144698 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-063736d3-0acb-4acd-a2ab-7fb245371c4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:43.200544 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063736d3-0acb-4acd-a2ab-7fb245371c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:43.202104 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063736d3-0acb-4acd-a2ab-7fb245371c4c service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:43.210835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1283/2547] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:43 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:03.008829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf37ffe-fab2-4c6b-8c41-769b92f88403 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:03.009388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf37ffe-fab2-4c6b-8c41-769b92f88403 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:03.009388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf37ffe-fab2-4c6b-8c41-769b92f88403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:03.026555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-ecf37ffe-fab2-4c6b-8c41-769b92f88403 None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:03.027789 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ecf37ffe-fab2-4c6b-8c41-769b92f88403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:03.086961 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1265/2548] 10.222.0.60 () {58 vars in 967 bytes} [Wed Dec 15 13:38:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:03.141344 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063736d3-0acb-4acd-a2ab-7fb245371c4c service nova] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:03.142738 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-063736d3-0acb-4acd-a2ab-7fb245371c4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:03.209111 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063736d3-0acb-4acd-a2ab-7fb245371c4c service nova] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:03.214231 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1e447-eb52-41bc-9375-4dd569215361 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:03.214999 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1e447-eb52-41bc-9375-4dd569215361 service swift] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:03.215367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1e447-eb52-41bc-9375-4dd569215361 service swift] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:03.216365 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1e447-eb52-41bc-9375-4dd569215361 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:03.224651 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1e447-eb52-41bc-9375-4dd569215361 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:03.226351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1e447-eb52-41bc-9375-4dd569215361 service swift] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:03.235087 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1284/2549] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:38:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:38:03.579404 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf37ffe-fab2-4c6b-8c41-769b92f88403 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:03.588806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf37ffe-fab2-4c6b-8c41-769b92f88403 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:03.593164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c41bf-ba83-47fd-9906-f7863a0c11ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:03.593801 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c41bf-ba83-47fd-9906-f7863a0c11ce service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:03.594115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c41bf-ba83-47fd-9906-f7863a0c11ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:03.594396 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c41bf-ba83-47fd-9906-f7863a0c11ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:03.596182 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-d00c41bf-ba83-47fd-9906-f7863a0c11ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:03.608215 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c41bf-ba83-47fd-9906-f7863a0c11ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:03.609647 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c41bf-ba83-47fd-9906-f7863a0c11ce service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:03.619678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1266/2550] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:10.753682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1e447-eb52-41bc-9375-4dd569215361 service swift] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:10.755562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-ffb1e447-eb52-41bc-9375-4dd569215361 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:10.773889 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1e447-eb52-41bc-9375-4dd569215361 service swift] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:10.779079 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222ec7a-2e5f-4e7a-8a34-c7518bdc5a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:10.780018 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222ec7a-2e5f-4e7a-8a34-c7518bdc5a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:10.780306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222ec7a-2e5f-4e7a-8a34-c7518bdc5a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:10.780583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222ec7a-2e5f-4e7a-8a34-c7518bdc5a3e admin admin] PATH_INFO: `/v3/users/5ed1331bcb0e4fe4a53379d1d72f650a` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:10.781795 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222ec7a-2e5f-4e7a-8a34-c7518bdc5a3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed1331bcb0e4fe4a53379d1d72f650a)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:10.783747 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222ec7a-2e5f-4e7a-8a34-c7518bdc5a3e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:10.830137 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2222ec7a-2e5f-4e7a-8a34-c7518bdc5a3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed1331bcb0e4fe4a53379d1d72f650a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:10.843659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2222ec7a-2e5f-4e7a-8a34-c7518bdc5a3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed1331bcb0e4fe4a53379d1d72f650a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:10.851483 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2222ec7a-2e5f-4e7a-8a34-c7518bdc5a3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed1331bcb0e4fe4a53379d1d72f650a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:10.858853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2222ec7a-2e5f-4e7a-8a34-c7518bdc5a3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed1331bcb0e4fe4a53379d1d72f650a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:10.859513 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-2222ec7a-2e5f-4e7a-8a34-c7518bdc5a3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed1331bcb0e4fe4a53379d1d72f650a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:10.865270 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1285/2551] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:10 2021] DELETE /identity/v3/users/5ed1331bcb0e4fe4a53379d1d72f650a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:11.036678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c41bf-ba83-47fd-9906-f7863a0c11ce service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:11.047817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c41bf-ba83-47fd-9906-f7863a0c11ce service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:11.107985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:11.108837 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:11.109116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:11.109392 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] PATH_INFO: `/v3/projects/c38faa56e5864d3aba51e1e8351e3a93` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:11.110586 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38faa56e5864d3aba51e1e8351e3a93)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:11.112571 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:11.160410 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38faa56e5864d3aba51e1e8351e3a93', 'request_id': 'req-978caf5e-d248-4fb5-afa5-b1081d577857'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.167564 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38faa56e5864d3aba51e1e8351e3a93', 'request_id': 'req-978caf5e-d248-4fb5-afa5-b1081d577857'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.173002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38faa56e5864d3aba51e1e8351e3a93', 'request_id': 'req-978caf5e-d248-4fb5-afa5-b1081d577857'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.183637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] The token cache is being invalidate because project c38faa56e5864d3aba51e1e8351e3a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:11.183920 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.184540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.186073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1267/2552] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:11 2021] DELETE /identity/v3/projects/c38faa56e5864d3aba51e1e8351e3a93 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:11.190004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222ec7a-2e5f-4e7a-8a34-c7518bdc5a3e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:11.191435 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2222ec7a-2e5f-4e7a-8a34-c7518bdc5a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:11.205121 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222ec7a-2e5f-4e7a-8a34-c7518bdc5a3e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:11.258903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef2829-c990-4544-b619-55a47a1078cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:11.259761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef2829-c990-4544-b619-55a47a1078cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:11.260045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef2829-c990-4544-b619-55a47a1078cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:11.260322 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef2829-c990-4544-b619-55a47a1078cf admin admin] PATH_INFO: `/v3/users/ff8e646555cd4696be2d23a31f2476d9` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:11.261497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef2829-c990-4544-b619-55a47a1078cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff8e646555cd4696be2d23a31f2476d9)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:11.263958 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef2829-c990-4544-b619-55a47a1078cf admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:11.311712 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-87ef2829-c990-4544-b619-55a47a1078cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff8e646555cd4696be2d23a31f2476d9'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.323110 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-87ef2829-c990-4544-b619-55a47a1078cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff8e646555cd4696be2d23a31f2476d9'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.330903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-87ef2829-c990-4544-b619-55a47a1078cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff8e646555cd4696be2d23a31f2476d9'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.337416 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-87ef2829-c990-4544-b619-55a47a1078cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff8e646555cd4696be2d23a31f2476d9'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.338041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-87ef2829-c990-4544-b619-55a47a1078cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff8e646555cd4696be2d23a31f2476d9'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.344426 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1286/2553] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:11 2021] DELETE /identity/v3/users/ff8e646555cd4696be2d23a31f2476d9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:11.519779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:11.521337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:11.534396 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978caf5e-d248-4fb5-afa5-b1081d577857 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:11.593857 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:11.594763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:11.595073 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:11.595354 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] PATH_INFO: `/v3/projects/bad08717445b4feeb99a5015417b271c` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:11.596569 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bad08717445b4feeb99a5015417b271c)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:11.598465 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:11.642942 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bad08717445b4feeb99a5015417b271c', 'request_id': 'req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.650518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bad08717445b4feeb99a5015417b271c', 'request_id': 'req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.655993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bad08717445b4feeb99a5015417b271c', 'request_id': 'req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.667222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] The token cache is being invalidate because project bad08717445b4feeb99a5015417b271c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:11.667508 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.668143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.669654 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1268/2554] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:11 2021] DELETE /identity/v3/projects/bad08717445b4feeb99a5015417b271c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:21.886768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d58765-baa8-44f9-a2f4-ddb43d764535 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:21.887304 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d58765-baa8-44f9-a2f4-ddb43d764535 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:21.887405 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d58765-baa8-44f9-a2f4-ddb43d764535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:21.906502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b6d58765-baa8-44f9-a2f4-ddb43d764535 None None] MFA Rules not processed for user `1fa1533801dc4fa0b79d8662414749d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:21.907736 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b6d58765-baa8-44f9-a2f4-ddb43d764535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:21.963707 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1287/2555] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:38:21 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:22.259415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:22.260825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:22.317832 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbc4a6-6ae6-4aa6-9df9-86dc9e38500f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:22.321762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe6181-b44a-4ea6-a037-9e7bac1bb9c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:22.322399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe6181-b44a-4ea6-a037-9e7bac1bb9c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:22.322679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe6181-b44a-4ea6-a037-9e7bac1bb9c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:22.322990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe6181-b44a-4ea6-a037-9e7bac1bb9c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:22.324980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-3cfe6181-b44a-4ea6-a037-9e7bac1bb9c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:22.334287 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe6181-b44a-4ea6-a037-9e7bac1bb9c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:22.335736 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe6181-b44a-4ea6-a037-9e7bac1bb9c7 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:22.343540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1269/2556] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:22 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:27.023024 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd32122-faa7-4f2b-b77e-f24973281347 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:27.023578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd32122-faa7-4f2b-b77e-f24973281347 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:27.023578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd32122-faa7-4f2b-b77e-f24973281347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:27.040606 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-fdd32122-faa7-4f2b-b77e-f24973281347 None None] MFA Rules not processed for user `58ad05b9c93c48a4bf4d1f086b6d5ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:27.041794 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-fdd32122-faa7-4f2b-b77e-f24973281347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:27.094832 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1288/2557] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:38:27 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:12.671800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe6181-b44a-4ea6-a037-9e7bac1bb9c7 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:12.673382 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-3cfe6181-b44a-4ea6-a037-9e7bac1bb9c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:12.775648 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe6181-b44a-4ea6-a037-9e7bac1bb9c7 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:12.784521 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcffdc7-0079-4c4a-90b3-b7e06cc7afea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e05695f0d91463bae1f2a67a58cb54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:12.785805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcffdc7-0079-4c4a-90b3-b7e06cc7afea service placement] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:12.785805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcffdc7-0079-4c4a-90b3-b7e06cc7afea service placement] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:12.785805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcffdc7-0079-4c4a-90b3-b7e06cc7afea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:12.787922 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ffcffdc7-0079-4c4a-90b3-b7e06cc7afea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:12.801169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcffdc7-0079-4c4a-90b3-b7e06cc7afea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:12.802970 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcffdc7-0079-4c4a-90b3-b7e06cc7afea service placement] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:12.813818 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1270/2558] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:39:12 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:39:15.640554 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e0e1c-ba5f-471c-8fda-2090a8c395cd None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:15.641072 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e0e1c-ba5f-471c-8fda-2090a8c395cd None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:15.641175 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e0e1c-ba5f-471c-8fda-2090a8c395cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:15.659274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-133e0e1c-ba5f-471c-8fda-2090a8c395cd None None] MFA Rules not processed for user `e2f51c315df74089bc6873e889cf80d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:15.661064 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-133e0e1c-ba5f-471c-8fda-2090a8c395cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:15.714540 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1289/2559] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:39:15 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:39:29.633937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcffdc7-0079-4c4a-90b3-b7e06cc7afea service placement] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:29.635738 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ffcffdc7-0079-4c4a-90b3-b7e06cc7afea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:29.706354 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcffdc7-0079-4c4a-90b3-b7e06cc7afea service placement] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:29.711074 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4520d-5f38-4a6c-a50b-80cbfe1da709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:29.711948 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4520d-5f38-4a6c-a50b-80cbfe1da709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:29.712229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4520d-5f38-4a6c-a50b-80cbfe1da709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:29.712508 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4520d-5f38-4a6c-a50b-80cbfe1da709 admin admin] PATH_INFO: `/v3/users/1fa1533801dc4fa0b79d8662414749d8` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:29.713723 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4520d-5f38-4a6c-a50b-80cbfe1da709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa1533801dc4fa0b79d8662414749d8)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:29.715701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4520d-5f38-4a6c-a50b-80cbfe1da709 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:29.762815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1dc4520d-5f38-4a6c-a50b-80cbfe1da709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa1533801dc4fa0b79d8662414749d8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:29.774487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1dc4520d-5f38-4a6c-a50b-80cbfe1da709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa1533801dc4fa0b79d8662414749d8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:29.782449 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1dc4520d-5f38-4a6c-a50b-80cbfe1da709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa1533801dc4fa0b79d8662414749d8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:29.789770 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1dc4520d-5f38-4a6c-a50b-80cbfe1da709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa1533801dc4fa0b79d8662414749d8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:29.790483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1dc4520d-5f38-4a6c-a50b-80cbfe1da709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa1533801dc4fa0b79d8662414749d8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:29.796325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1271/2560] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:39:29 2021] DELETE /identity/v3/users/1fa1533801dc4fa0b79d8662414749d8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:39:29.963094 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e0e1c-ba5f-471c-8fda-2090a8c395cd None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:29.975756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e0e1c-ba5f-471c-8fda-2090a8c395cd None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:30.035827 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:30.037139 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:30.037445 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:30.037719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] PATH_INFO: `/v3/projects/b8066a245289451b8a7cc12d4311b412` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:30.038938 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8066a245289451b8a7cc12d4311b412)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:30.040827 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:30.086794 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8066a245289451b8a7cc12d4311b412', 'request_id': 'req-bf95ddc5-194f-443e-8eca-9429fbe487b4'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:30.094042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8066a245289451b8a7cc12d4311b412', 'request_id': 'req-bf95ddc5-194f-443e-8eca-9429fbe487b4'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:30.100848 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8066a245289451b8a7cc12d4311b412', 'request_id': 'req-bf95ddc5-194f-443e-8eca-9429fbe487b4'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:30.110691 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] The token cache is being invalidate because project b8066a245289451b8a7cc12d4311b412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:39:30.111013 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:30.111647 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:30.113162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1290/2561] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:39:29 2021] DELETE /identity/v3/projects/b8066a245289451b8a7cc12d4311b412 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:40:35.122979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db117c07-5881-4777-951f-7403b15af926 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:35.123486 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db117c07-5881-4777-951f-7403b15af926 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:35.123589 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db117c07-5881-4777-951f-7403b15af926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:35.140949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-db117c07-5881-4777-951f-7403b15af926 None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:35.142149 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-db117c07-5881-4777-951f-7403b15af926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:35.194429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1272/2562] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:40:35 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:35.243317 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:35.244718 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:35.318287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95ddc5-194f-443e-8eca-9429fbe487b4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:35.323831 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a609bbe-9445-4dc1-8f19-f5f3954a7319 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:35.324481 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a609bbe-9445-4dc1-8f19-f5f3954a7319 service swift] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:35.324765 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a609bbe-9445-4dc1-8f19-f5f3954a7319 service swift] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:35.325161 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a609bbe-9445-4dc1-8f19-f5f3954a7319 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:35.333465 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a609bbe-9445-4dc1-8f19-f5f3954a7319 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:35.335064 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a609bbe-9445-4dc1-8f19-f5f3954a7319 service swift] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:35.343522 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1291/2563] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:40:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:40:51.679752 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc236ff-5ee3-4544-8345-b7040848ecea None None] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:51.680325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc236ff-5ee3-4544-8345-b7040848ecea None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:51.680325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc236ff-5ee3-4544-8345-b7040848ecea None None] PATH_INFO: `/` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:51.682631 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1273/2564] 10.222.0.60 () {54 vars in 921 bytes} [Wed Dec 15 13:40:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:40:51.689388 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854b872-e1b8-4b4f-89dc-ec2c35e32671 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:51.689905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854b872-e1b8-4b4f-89dc-ec2c35e32671 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:51.690101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854b872-e1b8-4b4f-89dc-ec2c35e32671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:51.713623 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b854b872-e1b8-4b4f-89dc-ec2c35e32671 None None] MFA Rules not processed for user `d61a8e4d64664e68a5710fdf766e4685`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:51.714988 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b854b872-e1b8-4b4f-89dc-ec2c35e32671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:51.780440 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1292/2565] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Dec 15 13:40:51 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:51.794178 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc236ff-5ee3-4544-8345-b7040848ecea None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:51.795914 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-1dc236ff-5ee3-4544-8345-b7040848ecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:51.851990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc236ff-5ee3-4544-8345-b7040848ecea None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:51.856060 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e7403-696d-49f3-a4e0-60161e10099f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9aff45fefe408fa1667e5298f8ff6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:51.856693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e7403-696d-49f3-a4e0-60161e10099f service glance] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:51.856992 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e7403-696d-49f3-a4e0-60161e10099f service glance] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:51.857253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e7403-696d-49f3-a4e0-60161e10099f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:51.867053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e7403-696d-49f3-a4e0-60161e10099f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:51.869175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e7403-696d-49f3-a4e0-60161e10099f service glance] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:51.879588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1274/2566] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:40:51 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:40:51.944903 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bdf08-596b-4f4b-afe0-6c8961a4c990 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:51.945228 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bdf08-596b-4f4b-afe0-6c8961a4c990 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:51.945511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bdf08-596b-4f4b-afe0-6c8961a4c990 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:51.947356 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1293/2567] 10.222.0.60 () {54 vars in 921 bytes} [Wed Dec 15 13:40:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:40:51.952122 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8100f-ed23-48e1-9189-b8106d31152e None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:51.952406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8100f-ed23-48e1-9189-b8106d31152e None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:51.952687 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8100f-ed23-48e1-9189-b8106d31152e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:51.970275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-22d8100f-ed23-48e1-9189-b8106d31152e None None] MFA Rules not processed for user `c9a44a13e31941b5af9579d8bec345ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:51.971486 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-22d8100f-ed23-48e1-9189-b8106d31152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:52.021533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1275/2568] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Dec 15 13:40:51 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:52.033562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bdf08-596b-4f4b-afe0-6c8961a4c990 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:52.035219 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-634bdf08-596b-4f4b-afe0-6c8961a4c990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:52.048547 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bdf08-596b-4f4b-afe0-6c8961a4c990 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:52.052045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16573b8b-d309-4834-b05d-bd079bb3450b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:52.052677 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16573b8b-d309-4834-b05d-bd079bb3450b service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:52.052968 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16573b8b-d309-4834-b05d-bd079bb3450b service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:52.053239 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16573b8b-d309-4834-b05d-bd079bb3450b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:52.060735 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16573b8b-d309-4834-b05d-bd079bb3450b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:52.062154 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16573b8b-d309-4834-b05d-bd079bb3450b service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:52.070886 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1294/2569] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:40:52 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:40:53.629540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b5a4e-ca1f-4c8a-812d-afb4aef18f43 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:53.630012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b5a4e-ca1f-4c8a-812d-afb4aef18f43 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:53.630118 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b5a4e-ca1f-4c8a-812d-afb4aef18f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:53.648533 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-573b5a4e-ca1f-4c8a-812d-afb4aef18f43 None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:53.649714 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-573b5a4e-ca1f-4c8a-812d-afb4aef18f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:53.656842 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1276/2570] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:40:53 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:53.669209 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16573b8b-d309-4834-b05d-bd079bb3450b service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:53.681420 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16573b8b-d309-4834-b05d-bd079bb3450b service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:53.686363 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f322aa6-f4d3-493d-930f-54552186db5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:53.687035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f322aa6-f4d3-493d-930f-54552186db5f service swift] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:53.687324 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f322aa6-f4d3-493d-930f-54552186db5f service swift] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:53.687606 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f322aa6-f4d3-493d-930f-54552186db5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:53.695769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f322aa6-f4d3-493d-930f-54552186db5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:53.698011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f322aa6-f4d3-493d-930f-54552186db5f service swift] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:53.705819 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1295/2571] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:40:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:40:58.771983 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b5a4e-ca1f-4c8a-812d-afb4aef18f43 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:58.781337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b5a4e-ca1f-4c8a-812d-afb4aef18f43 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:58.785022 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed5c79-eed8-42d1-a4a6-28bd0b25031a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:58.785736 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed5c79-eed8-42d1-a4a6-28bd0b25031a service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:58.786091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed5c79-eed8-42d1-a4a6-28bd0b25031a service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:58.786572 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed5c79-eed8-42d1-a4a6-28bd0b25031a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:58.788463 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-50ed5c79-eed8-42d1-a4a6-28bd0b25031a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:58.802925 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed5c79-eed8-42d1-a4a6-28bd0b25031a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:58.804388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed5c79-eed8-42d1-a4a6-28bd0b25031a service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:58.816213 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1277/2572] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:40:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:07.007226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f322aa6-f4d3-493d-930f-54552186db5f service swift] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:07.008719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2f322aa6-f4d3-493d-930f-54552186db5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:07.023572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f322aa6-f4d3-493d-930f-54552186db5f service swift] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:07.029401 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decda01-e23f-4293-8705-9900cecf9ccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:07.030026 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decda01-e23f-4293-8705-9900cecf9ccb service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:07.030310 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decda01-e23f-4293-8705-9900cecf9ccb service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:07.030585 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decda01-e23f-4293-8705-9900cecf9ccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:07.032265 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-6decda01-e23f-4293-8705-9900cecf9ccb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:07.109295 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decda01-e23f-4293-8705-9900cecf9ccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:07.110869 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decda01-e23f-4293-8705-9900cecf9ccb service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:07.128263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1296/2573] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:07 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:08.472169 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed5c79-eed8-42d1-a4a6-28bd0b25031a service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:08.473601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-50ed5c79-eed8-42d1-a4a6-28bd0b25031a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:08.528042 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed5c79-eed8-42d1-a4a6-28bd0b25031a service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:08.531613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841efa4-f496-4c3e-8904-3c9d65e522df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:08.532246 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841efa4-f496-4c3e-8904-3c9d65e522df service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:08.532529 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841efa4-f496-4c3e-8904-3c9d65e522df service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:08.532807 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841efa4-f496-4c3e-8904-3c9d65e522df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:08.534570 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4841efa4-f496-4c3e-8904-3c9d65e522df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:08.547601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841efa4-f496-4c3e-8904-3c9d65e522df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:08.548966 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841efa4-f496-4c3e-8904-3c9d65e522df service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:08.560237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1278/2574] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:14.586143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a4c7-bc50-46cd-a8fa-e8ab4d620cef None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:14.586634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a4c7-bc50-46cd-a8fa-e8ab4d620cef None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:14.586826 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a4c7-bc50-46cd-a8fa-e8ab4d620cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:14.604333 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-3b37a4c7-bc50-46cd-a8fa-e8ab4d620cef None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:14.605592 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3b37a4c7-bc50-46cd-a8fa-e8ab4d620cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:14.613595 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1297/2575] 10.222.0.60 () {58 vars in 967 bytes} [Wed Dec 15 13:41:14 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:14.627825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841efa4-f496-4c3e-8904-3c9d65e522df service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:14.639303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841efa4-f496-4c3e-8904-3c9d65e522df service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:14.644217 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d9df8-24b6-497e-99ad-0c161939d933 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:14.644862 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d9df8-24b6-497e-99ad-0c161939d933 service swift] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:14.645141 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d9df8-24b6-497e-99ad-0c161939d933 service swift] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:14.645414 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d9df8-24b6-497e-99ad-0c161939d933 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:14.653162 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d9df8-24b6-497e-99ad-0c161939d933 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:14.654737 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d9df8-24b6-497e-99ad-0c161939d933 service swift] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:14.663001 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1279/2576] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:41:14 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:41:37.417056 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37a4c7-bc50-46cd-a8fa-e8ab4d620cef None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:37.426672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37a4c7-bc50-46cd-a8fa-e8ab4d620cef None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:37.430381 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38031c69-0f9c-4770-a738-2d3085724593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:37.431046 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031c69-0f9c-4770-a738-2d3085724593 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:37.431334 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031c69-0f9c-4770-a738-2d3085724593 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:37.431610 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031c69-0f9c-4770-a738-2d3085724593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:37.433982 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-38031c69-0f9c-4770-a738-2d3085724593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:37.500924 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38031c69-0f9c-4770-a738-2d3085724593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:37.502346 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38031c69-0f9c-4770-a738-2d3085724593 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:37.511832 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1298/2577] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:40.384547 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d9df8-24b6-497e-99ad-0c161939d933 service swift] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:40.386091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-fa7d9df8-24b6-497e-99ad-0c161939d933 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:40.402693 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d9df8-24b6-497e-99ad-0c161939d933 service swift] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:40.407342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42426a6b-3838-44c1-a033-099221ecdb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:40.408199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42426a6b-3838-44c1-a033-099221ecdb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:40.408481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42426a6b-3838-44c1-a033-099221ecdb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:40.408756 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42426a6b-3838-44c1-a033-099221ecdb23 admin admin] PATH_INFO: `/v3/users/e2f51c315df74089bc6873e889cf80d7` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:40.422714 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42426a6b-3838-44c1-a033-099221ecdb23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2f51c315df74089bc6873e889cf80d7)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:40.424667 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42426a6b-3838-44c1-a033-099221ecdb23 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:40.469714 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-42426a6b-3838-44c1-a033-099221ecdb23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2f51c315df74089bc6873e889cf80d7'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:40.481518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-42426a6b-3838-44c1-a033-099221ecdb23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2f51c315df74089bc6873e889cf80d7'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:40.488337 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-42426a6b-3838-44c1-a033-099221ecdb23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2f51c315df74089bc6873e889cf80d7'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:40.494831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-42426a6b-3838-44c1-a033-099221ecdb23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2f51c315df74089bc6873e889cf80d7'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:40.496180 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-42426a6b-3838-44c1-a033-099221ecdb23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2f51c315df74089bc6873e889cf80d7'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:40.501900 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1280/2578] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:41:40 2021] DELETE /identity/v3/users/e2f51c315df74089bc6873e889cf80d7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:40.676372 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38031c69-0f9c-4770-a738-2d3085724593 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:40.690871 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38031c69-0f9c-4770-a738-2d3085724593 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:40.745939 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f71f7-76b5-4010-956d-f8dc94792f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:40.746722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f71f7-76b5-4010-956d-f8dc94792f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:40.747064 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f71f7-76b5-4010-956d-f8dc94792f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:40.747335 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f71f7-76b5-4010-956d-f8dc94792f54 admin admin] PATH_INFO: `/v3/projects/4cde9c0e34334ad7a7e79bfeb8963935` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:40.757467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f71f7-76b5-4010-956d-f8dc94792f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cde9c0e34334ad7a7e79bfeb8963935)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:40.759407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f71f7-76b5-4010-956d-f8dc94792f54 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:40.803806 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-a29f71f7-76b5-4010-956d-f8dc94792f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cde9c0e34334ad7a7e79bfeb8963935', 'request_id': 'req-a29f71f7-76b5-4010-956d-f8dc94792f54'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:40.810706 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-a29f71f7-76b5-4010-956d-f8dc94792f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cde9c0e34334ad7a7e79bfeb8963935', 'request_id': 'req-a29f71f7-76b5-4010-956d-f8dc94792f54'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:40.817130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-a29f71f7-76b5-4010-956d-f8dc94792f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cde9c0e34334ad7a7e79bfeb8963935', 'request_id': 'req-a29f71f7-76b5-4010-956d-f8dc94792f54'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:40.827621 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-a29f71f7-76b5-4010-956d-f8dc94792f54 admin admin] The token cache is being invalidate because project 4cde9c0e34334ad7a7e79bfeb8963935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:41:40.827909 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-a29f71f7-76b5-4010-956d-f8dc94792f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:40.828529 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-a29f71f7-76b5-4010-956d-f8dc94792f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:40.830030 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1299/2579] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:41:40 2021] DELETE /identity/v3/projects/4cde9c0e34334ad7a7e79bfeb8963935 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:40.835981 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24d332-41c8-4f11-8ca0-2e3997afb596 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:40.836268 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24d332-41c8-4f11-8ca0-2e3997afb596 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:40.836536 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24d332-41c8-4f11-8ca0-2e3997afb596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:40.854207 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-6f24d332-41c8-4f11-8ca0-2e3997afb596 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:40.856244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-6f24d332-41c8-4f11-8ca0-2e3997afb596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:40.913151 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1281/2580] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:40.921323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425376-f361-422c-9fdc-ee3c0a6a5f81 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:40.921622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425376-f361-422c-9fdc-ee3c0a6a5f81 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:40.921909 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425376-f361-422c-9fdc-ee3c0a6a5f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:40.939888 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-39425376-f361-422c-9fdc-ee3c0a6a5f81 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:40.941098 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-39425376-f361-422c-9fdc-ee3c0a6a5f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:40.949954 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1300/2581] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:40.954220 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24d332-41c8-4f11-8ca0-2e3997afb596 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:40.963934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24d332-41c8-4f11-8ca0-2e3997afb596 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:40.968964 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a8a04-3589-469f-a4fc-ff7d11b3a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:40.969611 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a8a04-3589-469f-a4fc-ff7d11b3a242 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:40.969889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a8a04-3589-469f-a4fc-ff7d11b3a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:40.970163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a8a04-3589-469f-a4fc-ff7d11b3a242 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:40.970925 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a8a04-3589-469f-a4fc-ff7d11b3a242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:41:40.971235 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a8a04-3589-469f-a4fc-ff7d11b3a242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:40.972831 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a8a04-3589-469f-a4fc-ff7d11b3a242 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:40.984796 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1282/2582] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:41:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:41:40.988924 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425376-f361-422c-9fdc-ee3c0a6a5f81 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:41.002307 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425376-f361-422c-9fdc-ee3c0a6a5f81 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:41.007173 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d7a1-1f5f-4193-bd55-07f1f79d30ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:41.007833 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d7a1-1f5f-4193-bd55-07f1f79d30ec admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:41.008111 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d7a1-1f5f-4193-bd55-07f1f79d30ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:41.008566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d7a1-1f5f-4193-bd55-07f1f79d30ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:41.009275 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0d7a1-1f5f-4193-bd55-07f1f79d30ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:41.013594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0d7a1-1f5f-4193-bd55-07f1f79d30ec admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:41.057662 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1301/2583] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:41:40 2021] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:41:41.059849 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a8a04-3589-469f-a4fc-ff7d11b3a242 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:41.070924 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a8a04-3589-469f-a4fc-ff7d11b3a242 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:41.124335 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309c0ca-4fd7-40ee-9c68-7d537a393df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:41.125024 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309c0ca-4fd7-40ee-9c68-7d537a393df6 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:41.125334 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309c0ca-4fd7-40ee-9c68-7d537a393df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:41.125725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309c0ca-4fd7-40ee-9c68-7d537a393df6 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:41.126621 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309c0ca-4fd7-40ee-9c68-7d537a393df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:41.128606 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309c0ca-4fd7-40ee-9c68-7d537a393df6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:41.148310 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1283/2584] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:41:41 2021] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:41:41.153391 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d7a1-1f5f-4193-bd55-07f1f79d30ec admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:41.163715 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d7a1-1f5f-4193-bd55-07f1f79d30ec admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:41.168471 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef1aac-1e6f-4a4b-b6d9-0ab86607610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:41.169121 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef1aac-1e6f-4a4b-b6d9-0ab86607610e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:41.169399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef1aac-1e6f-4a4b-b6d9-0ab86607610e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:41.169701 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef1aac-1e6f-4a4b-b6d9-0ab86607610e admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:41.170436 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef1aac-1e6f-4a4b-b6d9-0ab86607610e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:41.172047 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef1aac-1e6f-4a4b-b6d9-0ab86607610e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:41.181777 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1302/2585] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:41:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:41:41.185520 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309c0ca-4fd7-40ee-9c68-7d537a393df6 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:41.195082 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309c0ca-4fd7-40ee-9c68-7d537a393df6 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:41.200258 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7398d-b8b6-42fd-b820-ef0b50f65e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:41.200920 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7398d-b8b6-42fd-b820-ef0b50f65e9c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:41.201209 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7398d-b8b6-42fd-b820-ef0b50f65e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:41.201552 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7398d-b8b6-42fd-b820-ef0b50f65e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:41.202301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7398d-b8b6-42fd-b820-ef0b50f65e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:41.203926 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7398d-b8b6-42fd-b820-ef0b50f65e9c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:41.214091 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1284/2586] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:41:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:41:41.218399 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef1aac-1e6f-4a4b-b6d9-0ab86607610e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:41.227930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef1aac-1e6f-4a4b-b6d9-0ab86607610e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:41.232533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0d552-4e79-4b13-b7fd-f711540c1453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:41.233395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0d552-4e79-4b13-b7fd-f711540c1453 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:41.233681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0d552-4e79-4b13-b7fd-f711540c1453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:41.233961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0d552-4e79-4b13-b7fd-f711540c1453 admin admin] PATH_INFO: `/v3/projects/112ecd3f66ca495a9c13218c11a2a324/users/cec2ef87a45e4f1fa1dd0fd7f305572a/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:41.248709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0d552-4e79-4b13-b7fd-f711540c1453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112ecd3f66ca495a9c13218c11a2a324, user_id=cec2ef87a45e4f1fa1dd0fd7f305572a, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:41.251377 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0d552-4e79-4b13-b7fd-f711540c1453 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:41.264422 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1303/2587] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:41:41 2021] PUT /identity/v3/projects/112ecd3f66ca495a9c13218c11a2a324/users/cec2ef87a45e4f1fa1dd0fd7f305572a/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:41:41.273934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c8085-5731-4479-aa94-f52166fa9e42 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:41.274263 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c8085-5731-4479-aa94-f52166fa9e42 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:41.274574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c8085-5731-4479-aa94-f52166fa9e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:41.301147 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-9a3c8085-5731-4479-aa94-f52166fa9e42 None None] MFA Rules not processed for user `cec2ef87a45e4f1fa1dd0fd7f305572a`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:41.302354 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9a3c8085-5731-4479-aa94-f52166fa9e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:41.368704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1285/2588] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:41 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:41.373571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0d552-4e79-4b13-b7fd-f711540c1453 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:41.431787 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0d552-4e79-4b13-b7fd-f711540c1453 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:41.436885 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4acfa7-6fb2-47fd-97bc-d895a6e95027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:41.437535 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4acfa7-6fb2-47fd-97bc-d895a6e95027 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:41.437821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4acfa7-6fb2-47fd-97bc-d895a6e95027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:41.438101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4acfa7-6fb2-47fd-97bc-d895a6e95027 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:41.438805 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4acfa7-6fb2-47fd-97bc-d895a6e95027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:41.440722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4acfa7-6fb2-47fd-97bc-d895a6e95027 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:41.465680 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1304/2589] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:41:41 2021] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:41:41.469750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c8085-5731-4479-aa94-f52166fa9e42 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:41.480218 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c8085-5731-4479-aa94-f52166fa9e42 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:41.535325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a7fd1-857b-4b4c-99a0-4fe81549bc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:41.535909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a7fd1-857b-4b4c-99a0-4fe81549bc32 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:41.536189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a7fd1-857b-4b4c-99a0-4fe81549bc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:41.536462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a7fd1-857b-4b4c-99a0-4fe81549bc32 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:41.537171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a7fd1-857b-4b4c-99a0-4fe81549bc32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:41.539130 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a7fd1-857b-4b4c-99a0-4fe81549bc32 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:41.559652 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1286/2590] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:41:41 2021] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:41:41.563687 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4acfa7-6fb2-47fd-97bc-d895a6e95027 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:41.574617 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4acfa7-6fb2-47fd-97bc-d895a6e95027 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:41.579205 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754816f-9449-405b-8c34-7b529ce38a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:41.579853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754816f-9449-405b-8c34-7b529ce38a70 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:41.580136 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754816f-9449-405b-8c34-7b529ce38a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:41.580410 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754816f-9449-405b-8c34-7b529ce38a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:41.581146 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754816f-9449-405b-8c34-7b529ce38a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:41.582961 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754816f-9449-405b-8c34-7b529ce38a70 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:41.593745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1305/2591] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:41:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:41:41.597728 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a7fd1-857b-4b4c-99a0-4fe81549bc32 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:41.607637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a7fd1-857b-4b4c-99a0-4fe81549bc32 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:41.612429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aaa3af-0dc9-4fb2-9fe2-d9146f9e86a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:41.613303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa3af-0dc9-4fb2-9fe2-d9146f9e86a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:41.613583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa3af-0dc9-4fb2-9fe2-d9146f9e86a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:41.613892 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa3af-0dc9-4fb2-9fe2-d9146f9e86a2 admin admin] PATH_INFO: `/v3/projects/a75a902fa3b44500a07508d2cab43dbd/users/4b9366e9525d4c28ab5695e69cfab12a/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:41.628699 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aaa3af-0dc9-4fb2-9fe2-d9146f9e86a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75a902fa3b44500a07508d2cab43dbd, user_id=4b9366e9525d4c28ab5695e69cfab12a, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:41.631371 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aaa3af-0dc9-4fb2-9fe2-d9146f9e86a2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:41.646550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1287/2592] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:41:41 2021] PUT /identity/v3/projects/a75a902fa3b44500a07508d2cab43dbd/users/4b9366e9525d4c28ab5695e69cfab12a/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:41.650532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754816f-9449-405b-8c34-7b529ce38a70 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:41.660377 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754816f-9449-405b-8c34-7b529ce38a70 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:41.716248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29329af-24b9-4566-9069-4eff84f811d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:41.716911 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29329af-24b9-4566-9069-4eff84f811d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:41.717194 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29329af-24b9-4566-9069-4eff84f811d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:41.717470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29329af-24b9-4566-9069-4eff84f811d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:41.718196 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29329af-24b9-4566-9069-4eff84f811d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:41.719821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29329af-24b9-4566-9069-4eff84f811d2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:41.729442 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1306/2593] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:41:41 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:41:41.734167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aaa3af-0dc9-4fb2-9fe2-d9146f9e86a2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:41.744099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aaa3af-0dc9-4fb2-9fe2-d9146f9e86a2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:41.749212 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b39168-e9b9-44ed-a0c9-77e034613799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:41.750076 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b39168-e9b9-44ed-a0c9-77e034613799 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:41.750359 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b39168-e9b9-44ed-a0c9-77e034613799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:41.750639 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b39168-e9b9-44ed-a0c9-77e034613799 admin admin] PATH_INFO: `/v3/projects/a75a902fa3b44500a07508d2cab43dbd/users/4b9366e9525d4c28ab5695e69cfab12a/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:41.752607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b39168-e9b9-44ed-a0c9-77e034613799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75a902fa3b44500a07508d2cab43dbd, user_id=4b9366e9525d4c28ab5695e69cfab12a, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:41.755269 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b39168-e9b9-44ed-a0c9-77e034613799 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:41.765038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1288/2594] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:41:41 2021] PUT /identity/v3/projects/a75a902fa3b44500a07508d2cab43dbd/users/4b9366e9525d4c28ab5695e69cfab12a/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:41.774612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4596e0d-dbe9-4095-b1aa-9b63fc4a9eac None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:41.774944 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4596e0d-dbe9-4095-b1aa-9b63fc4a9eac None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:41.775233 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4596e0d-dbe9-4095-b1aa-9b63fc4a9eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:41.804916 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-d4596e0d-dbe9-4095-b1aa-9b63fc4a9eac None None] MFA Rules not processed for user `4b9366e9525d4c28ab5695e69cfab12a`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:41.806058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d4596e0d-dbe9-4095-b1aa-9b63fc4a9eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:41.870292 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1307/2595] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:41 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:41.881339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b39168-e9b9-44ed-a0c9-77e034613799 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:41.883016 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-d4b39168-e9b9-44ed-a0c9-77e034613799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:41.937261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b39168-e9b9-44ed-a0c9-77e034613799 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:41.940840 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ed70b-3ba2-4911-9760-0ffe40b01f76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:41.941461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ed70b-3ba2-4911-9760-0ffe40b01f76 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:41.941739 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ed70b-3ba2-4911-9760-0ffe40b01f76 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:41.942012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ed70b-3ba2-4911-9760-0ffe40b01f76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:41.950790 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ed70b-3ba2-4911-9760-0ffe40b01f76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:41.952241 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ed70b-3ba2-4911-9760-0ffe40b01f76 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:41.961602 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1289/2596] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:41 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:42.209452 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4596e0d-dbe9-4095-b1aa-9b63fc4a9eac None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:42.269290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4596e0d-dbe9-4095-b1aa-9b63fc4a9eac None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:42.273817 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a19f6-f195-4d58-b270-92ffe7e39a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:42.274670 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a19f6-f195-4d58-b270-92ffe7e39a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:42.275038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a19f6-f195-4d58-b270-92ffe7e39a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:42.275326 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a19f6-f195-4d58-b270-92ffe7e39a81 admin admin] PATH_INFO: `/v3/users/cec2ef87a45e4f1fa1dd0fd7f305572a` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:42.276526 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a19f6-f195-4d58-b270-92ffe7e39a81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec2ef87a45e4f1fa1dd0fd7f305572a)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:42.278950 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a19f6-f195-4d58-b270-92ffe7e39a81 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:42.322720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-240a19f6-f195-4d58-b270-92ffe7e39a81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec2ef87a45e4f1fa1dd0fd7f305572a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:42.333883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-240a19f6-f195-4d58-b270-92ffe7e39a81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec2ef87a45e4f1fa1dd0fd7f305572a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:42.341525 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-240a19f6-f195-4d58-b270-92ffe7e39a81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec2ef87a45e4f1fa1dd0fd7f305572a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:42.348304 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-240a19f6-f195-4d58-b270-92ffe7e39a81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec2ef87a45e4f1fa1dd0fd7f305572a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:42.348969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-240a19f6-f195-4d58-b270-92ffe7e39a81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec2ef87a45e4f1fa1dd0fd7f305572a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:42.354804 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1308/2597] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:41:42 2021] DELETE /identity/v3/users/cec2ef87a45e4f1fa1dd0fd7f305572a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:42.359932 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d88f84-b2e3-4b0c-bc7d-c58084940cc4 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:42.360260 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d88f84-b2e3-4b0c-bc7d-c58084940cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:42.360536 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d88f84-b2e3-4b0c-bc7d-c58084940cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:42.377505 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-12d88f84-b2e3-4b0c-bc7d-c58084940cc4 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:42.378679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-12d88f84-b2e3-4b0c-bc7d-c58084940cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:42.433757 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1290/2598] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:42.443735 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a19f6-f195-4d58-b270-92ffe7e39a81 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:42.445122 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-240a19f6-f195-4d58-b270-92ffe7e39a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:42.501479 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a19f6-f195-4d58-b270-92ffe7e39a81 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:42.505127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f845c0-88c3-4983-85b5-af664c9399e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:42.505766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f845c0-88c3-4983-85b5-af664c9399e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:42.506056 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f845c0-88c3-4983-85b5-af664c9399e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:42.506333 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f845c0-88c3-4983-85b5-af664c9399e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:42.515768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f845c0-88c3-4983-85b5-af664c9399e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:42.517191 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f845c0-88c3-4983-85b5-af664c9399e4 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:42.526682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1309/2599] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:42.798530 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d88f84-b2e3-4b0c-bc7d-c58084940cc4 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:42.799999 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-12d88f84-b2e3-4b0c-bc7d-c58084940cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:42.815002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d88f84-b2e3-4b0c-bc7d-c58084940cc4 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:42.819855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:42.820839 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:42.821163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:42.821474 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] PATH_INFO: `/v3/projects/112ecd3f66ca495a9c13218c11a2a324` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:42.822938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=112ecd3f66ca495a9c13218c11a2a324)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:42.825596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:42.871574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112ecd3f66ca495a9c13218c11a2a324', 'request_id': 'req-f184eb03-dfab-445c-b78c-27260b38f27e'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:42.878504 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112ecd3f66ca495a9c13218c11a2a324', 'request_id': 'req-f184eb03-dfab-445c-b78c-27260b38f27e'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:42.883900 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112ecd3f66ca495a9c13218c11a2a324', 'request_id': 'req-f184eb03-dfab-445c-b78c-27260b38f27e'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:42.895067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] The token cache is being invalidate because project 112ecd3f66ca495a9c13218c11a2a324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:41:42.895358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:42.896003 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:42.897515 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1291/2600] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:41:42 2021] DELETE /identity/v3/projects/112ecd3f66ca495a9c13218c11a2a324 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:42.901430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f845c0-88c3-4983-85b5-af664c9399e4 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:42.910982 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f845c0-88c3-4983-85b5-af664c9399e4 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:42.966582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8f140-8ec3-499e-a15e-04de397f48ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:42.967477 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f140-8ec3-499e-a15e-04de397f48ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:42.967766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f140-8ec3-499e-a15e-04de397f48ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:42.968046 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f140-8ec3-499e-a15e-04de397f48ed admin admin] PATH_INFO: `/v3/users/4b9366e9525d4c28ab5695e69cfab12a` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:42.969237 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8f140-8ec3-499e-a15e-04de397f48ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b9366e9525d4c28ab5695e69cfab12a)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:42.971240 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8f140-8ec3-499e-a15e-04de397f48ed admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:43.015309 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4dd8f140-8ec3-499e-a15e-04de397f48ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b9366e9525d4c28ab5695e69cfab12a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:43.026350 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4dd8f140-8ec3-499e-a15e-04de397f48ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b9366e9525d4c28ab5695e69cfab12a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:43.032643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4dd8f140-8ec3-499e-a15e-04de397f48ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b9366e9525d4c28ab5695e69cfab12a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:43.039269 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4dd8f140-8ec3-499e-a15e-04de397f48ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b9366e9525d4c28ab5695e69cfab12a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:43.039882 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-4dd8f140-8ec3-499e-a15e-04de397f48ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b9366e9525d4c28ab5695e69cfab12a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:43.047469 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1310/2601] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:41:42 2021] DELETE /identity/v3/users/4b9366e9525d4c28ab5695e69cfab12a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:43.307396 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:43.308801 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:43.326689 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184eb03-dfab-445c-b78c-27260b38f27e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:43.382885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:43.383730 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:43.384009 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:43.384285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8 admin admin] PATH_INFO: `/v3/projects/a75a902fa3b44500a07508d2cab43dbd` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:43.385466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75a902fa3b44500a07508d2cab43dbd)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:43.387401 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:43.431968 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75a902fa3b44500a07508d2cab43dbd', 'request_id': 'req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:43.440739 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75a902fa3b44500a07508d2cab43dbd', 'request_id': 'req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:43.446651 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75a902fa3b44500a07508d2cab43dbd', 'request_id': 'req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:43.457897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8 admin admin] The token cache is being invalidate because project a75a902fa3b44500a07508d2cab43dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:41:43.458184 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:43.458829 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-62c40d22-fd6d-44b9-9bec-e50c6f21ddf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:43.460640 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1292/2602] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:41:43 2021] DELETE /identity/v3/projects/a75a902fa3b44500a07508d2cab43dbd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:43.467112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80ccfd-8839-4d6a-9bdf-871bedbdc4cd None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:43.467403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80ccfd-8839-4d6a-9bdf-871bedbdc4cd None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:43.467682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80ccfd-8839-4d6a-9bdf-871bedbdc4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:43.486110 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-8b80ccfd-8839-4d6a-9bdf-871bedbdc4cd None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:43.487325 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8b80ccfd-8839-4d6a-9bdf-871bedbdc4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:43.548578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1311/2603] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:43.557637 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3211f67-4f91-4cc1-90e6-3652fee3b145 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:43.557926 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3211f67-4f91-4cc1-90e6-3652fee3b145 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:43.558205 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3211f67-4f91-4cc1-90e6-3652fee3b145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:43.576336 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-b3211f67-4f91-4cc1-90e6-3652fee3b145 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:43.577516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b3211f67-4f91-4cc1-90e6-3652fee3b145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:43.585266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1293/2604] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:43.589569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80ccfd-8839-4d6a-9bdf-871bedbdc4cd None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:43.599589 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80ccfd-8839-4d6a-9bdf-871bedbdc4cd None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:43.604048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510af2d-02ed-4ad1-8de0-5d119e634be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:43.604695 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510af2d-02ed-4ad1-8de0-5d119e634be0 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:43.604980 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510af2d-02ed-4ad1-8de0-5d119e634be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:43.605258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510af2d-02ed-4ad1-8de0-5d119e634be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:43.606042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510af2d-02ed-4ad1-8de0-5d119e634be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:41:43.606878 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510af2d-02ed-4ad1-8de0-5d119e634be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:43.608469 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510af2d-02ed-4ad1-8de0-5d119e634be0 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:43.620138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1312/2605] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:41:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:41:43.624218 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3211f67-4f91-4cc1-90e6-3652fee3b145 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:43.633181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3211f67-4f91-4cc1-90e6-3652fee3b145 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:43.638025 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cc50c-436d-4df0-bfe0-edac3246409b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:43.638661 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cc50c-436d-4df0-bfe0-edac3246409b admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:43.638974 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cc50c-436d-4df0-bfe0-edac3246409b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:43.639252 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cc50c-436d-4df0-bfe0-edac3246409b admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:43.639957 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cc50c-436d-4df0-bfe0-edac3246409b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:43.641834 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cc50c-436d-4df0-bfe0-edac3246409b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:43.667704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1294/2606] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:41:43 2021] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:41:43.672377 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510af2d-02ed-4ad1-8de0-5d119e634be0 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:43.682108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510af2d-02ed-4ad1-8de0-5d119e634be0 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:43.737096 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a682cb5-2636-4f72-8423-88e6054ace5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:43.737754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a682cb5-2636-4f72-8423-88e6054ace5f admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:43.738057 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a682cb5-2636-4f72-8423-88e6054ace5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:43.738338 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a682cb5-2636-4f72-8423-88e6054ace5f admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:43.739064 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a682cb5-2636-4f72-8423-88e6054ace5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:43.740953 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a682cb5-2636-4f72-8423-88e6054ace5f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:43.759772 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1313/2607] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:41:43 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:41:43.763923 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cc50c-436d-4df0-bfe0-edac3246409b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:43.774259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cc50c-436d-4df0-bfe0-edac3246409b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:43.779406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b892f55-7e97-4d6e-9a22-7e57188fff94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:43.780055 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b892f55-7e97-4d6e-9a22-7e57188fff94 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:43.780346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b892f55-7e97-4d6e-9a22-7e57188fff94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:43.780626 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b892f55-7e97-4d6e-9a22-7e57188fff94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:43.781370 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b892f55-7e97-4d6e-9a22-7e57188fff94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:43.783022 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b892f55-7e97-4d6e-9a22-7e57188fff94 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:43.793162 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1295/2608] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:41:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:41:43.800128 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a682cb5-2636-4f72-8423-88e6054ace5f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:43.812227 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a682cb5-2636-4f72-8423-88e6054ace5f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:43.820003 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd5153-122c-4948-8dab-6d0e111febf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:43.821329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5153-122c-4948-8dab-6d0e111febf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:43.821504 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5153-122c-4948-8dab-6d0e111febf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:43.821846 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5153-122c-4948-8dab-6d0e111febf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:43.822690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd5153-122c-4948-8dab-6d0e111febf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:43.824316 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd5153-122c-4948-8dab-6d0e111febf2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:43.835622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1314/2609] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:41:43 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:41:43.839669 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b892f55-7e97-4d6e-9a22-7e57188fff94 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:43.850101 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b892f55-7e97-4d6e-9a22-7e57188fff94 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:43.854747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b545f-25f3-4ce8-b23a-db734c24918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:43.855653 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b545f-25f3-4ce8-b23a-db734c24918d admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:43.855979 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b545f-25f3-4ce8-b23a-db734c24918d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:43.856867 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b545f-25f3-4ce8-b23a-db734c24918d admin admin] PATH_INFO: `/v3/projects/84ff650e21f84b43876ae5a3c6dfa773/users/4d59edaee583476886e49b5001edceea/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:43.871986 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b545f-25f3-4ce8-b23a-db734c24918d admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ff650e21f84b43876ae5a3c6dfa773, user_id=4d59edaee583476886e49b5001edceea, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:43.874623 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b545f-25f3-4ce8-b23a-db734c24918d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:43.887925 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1296/2610] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:41:43 2021] PUT /identity/v3/projects/84ff650e21f84b43876ae5a3c6dfa773/users/4d59edaee583476886e49b5001edceea/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:43.898037 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c02e2-545a-4b21-80d6-b8b9e3ba81fd None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:43.898329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c02e2-545a-4b21-80d6-b8b9e3ba81fd None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:43.898612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c02e2-545a-4b21-80d6-b8b9e3ba81fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:43.926246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-d59c02e2-545a-4b21-80d6-b8b9e3ba81fd None None] MFA Rules not processed for user `4d59edaee583476886e49b5001edceea`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:43.927480 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-d59c02e2-545a-4b21-80d6-b8b9e3ba81fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:43.989759 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1315/2611] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:43 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:41:43.994332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b545f-25f3-4ce8-b23a-db734c24918d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:44.053534 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b545f-25f3-4ce8-b23a-db734c24918d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:44.058296 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cee2d3-1a38-4d66-88a3-d0e5c771ab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:44.058973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cee2d3-1a38-4d66-88a3-d0e5c771ab0d admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:44.059262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cee2d3-1a38-4d66-88a3-d0e5c771ab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:44.059543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cee2d3-1a38-4d66-88a3-d0e5c771ab0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:44.060316 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cee2d3-1a38-4d66-88a3-d0e5c771ab0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:44.062234 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cee2d3-1a38-4d66-88a3-d0e5c771ab0d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:44.087750 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1297/2612] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:41:43 2021] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:41:44.092327 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c02e2-545a-4b21-80d6-b8b9e3ba81fd None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:44.102891 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c02e2-545a-4b21-80d6-b8b9e3ba81fd None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:44.157052 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721078d4-61c9-400a-acf9-207c91155bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:44.157709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721078d4-61c9-400a-acf9-207c91155bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:44.157992 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721078d4-61c9-400a-acf9-207c91155bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:44.158268 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721078d4-61c9-400a-acf9-207c91155bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:44.158997 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721078d4-61c9-400a-acf9-207c91155bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:44.160890 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721078d4-61c9-400a-acf9-207c91155bc4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:44.180001 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1316/2613] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:41:44 2021] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:41:44.183977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cee2d3-1a38-4d66-88a3-d0e5c771ab0d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:44.193908 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cee2d3-1a38-4d66-88a3-d0e5c771ab0d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:44.198429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334b557-a9af-4e0f-931a-6236cc6ebdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:44.199123 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334b557-a9af-4e0f-931a-6236cc6ebdeb admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:44.199402 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334b557-a9af-4e0f-931a-6236cc6ebdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:44.199676 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334b557-a9af-4e0f-931a-6236cc6ebdeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:44.200907 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334b557-a9af-4e0f-931a-6236cc6ebdeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:44.202502 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334b557-a9af-4e0f-931a-6236cc6ebdeb admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:44.212982 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1298/2614] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:41:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:41:44.217234 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721078d4-61c9-400a-acf9-207c91155bc4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:44.226948 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721078d4-61c9-400a-acf9-207c91155bc4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:44.231436 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae08d89-e54c-4a67-9e9d-2390827260af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:44.232076 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae08d89-e54c-4a67-9e9d-2390827260af admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:44.232360 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae08d89-e54c-4a67-9e9d-2390827260af admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:44.232638 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae08d89-e54c-4a67-9e9d-2390827260af admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:44.233366 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae08d89-e54c-4a67-9e9d-2390827260af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:44.235036 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae08d89-e54c-4a67-9e9d-2390827260af admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:44.244694 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1317/2615] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:41:44 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:41:44.248846 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334b557-a9af-4e0f-931a-6236cc6ebdeb admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:44.258628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334b557-a9af-4e0f-931a-6236cc6ebdeb admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:44.263775 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f589b4-fea5-4d8f-943b-f6c7ff7cf2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:44.264629 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f589b4-fea5-4d8f-943b-f6c7ff7cf2a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:44.264910 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f589b4-fea5-4d8f-943b-f6c7ff7cf2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:44.265184 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f589b4-fea5-4d8f-943b-f6c7ff7cf2a8 admin admin] PATH_INFO: `/v3/projects/24928aae126449b3a8e6e84b7a088a7c/users/66e69f0b5da24ddc9ba3b005c84462c1/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:44.279098 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f589b4-fea5-4d8f-943b-f6c7ff7cf2a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24928aae126449b3a8e6e84b7a088a7c, user_id=66e69f0b5da24ddc9ba3b005c84462c1, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:44.281724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f589b4-fea5-4d8f-943b-f6c7ff7cf2a8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:44.293565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1299/2616] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:41:44 2021] PUT /identity/v3/projects/24928aae126449b3a8e6e84b7a088a7c/users/66e69f0b5da24ddc9ba3b005c84462c1/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:44.303503 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb6bf-7660-4f88-b560-c248eb346852 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:44.303797 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb6bf-7660-4f88-b560-c248eb346852 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:44.304081 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb6bf-7660-4f88-b560-c248eb346852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:44.330392 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b9dbb6bf-7660-4f88-b560-c248eb346852 None None] MFA Rules not processed for user `66e69f0b5da24ddc9ba3b005c84462c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:44.331621 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b9dbb6bf-7660-4f88-b560-c248eb346852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:44.393518 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1318/2617] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:44 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:44.398184 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f589b4-fea5-4d8f-943b-f6c7ff7cf2a8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:44.457922 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f589b4-fea5-4d8f-943b-f6c7ff7cf2a8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:44.463301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62378985-e6a9-4af8-86fd-436cfa44296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:44.464125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378985-e6a9-4af8-86fd-436cfa44296e admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:44.464410 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378985-e6a9-4af8-86fd-436cfa44296e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:44.464724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378985-e6a9-4af8-86fd-436cfa44296e admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:44.465479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62378985-e6a9-4af8-86fd-436cfa44296e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:44.467457 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62378985-e6a9-4af8-86fd-436cfa44296e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:44.491486 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1300/2618] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:41:44 2021] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:41:44.495698 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbb6bf-7660-4f88-b560-c248eb346852 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:44.506455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbb6bf-7660-4f88-b560-c248eb346852 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:44.561071 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c3960-8f3d-44ec-a33e-c54bdc4a6e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:44.561729 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c3960-8f3d-44ec-a33e-c54bdc4a6e1a admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:44.562027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c3960-8f3d-44ec-a33e-c54bdc4a6e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:44.562419 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c3960-8f3d-44ec-a33e-c54bdc4a6e1a admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:44.563407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c3960-8f3d-44ec-a33e-c54bdc4a6e1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:44.565330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c3960-8f3d-44ec-a33e-c54bdc4a6e1a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:44.584056 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1319/2619] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:41:44 2021] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:41:44.588341 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62378985-e6a9-4af8-86fd-436cfa44296e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:44.598861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62378985-e6a9-4af8-86fd-436cfa44296e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:44.603743 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959bf58-cae0-4555-ad83-8d001d0df51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:44.604466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959bf58-cae0-4555-ad83-8d001d0df51f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:44.604773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959bf58-cae0-4555-ad83-8d001d0df51f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:44.605074 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959bf58-cae0-4555-ad83-8d001d0df51f admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:44.605854 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959bf58-cae0-4555-ad83-8d001d0df51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:44.608070 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959bf58-cae0-4555-ad83-8d001d0df51f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:44.618404 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1301/2620] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:41:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:41:44.622996 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c3960-8f3d-44ec-a33e-c54bdc4a6e1a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:44.632743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c3960-8f3d-44ec-a33e-c54bdc4a6e1a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:44.637282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a268e-0952-4c1c-8acd-f57c7c7149a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:44.638358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a268e-0952-4c1c-8acd-f57c7c7149a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:44.638659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a268e-0952-4c1c-8acd-f57c7c7149a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:44.642495 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a268e-0952-4c1c-8acd-f57c7c7149a6 admin admin] PATH_INFO: `/v3/projects/c4bcda6d27ef4fd4b808f0c117a08b29/users/35294205231e410b928580e642eaaef6/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:44.660279 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a268e-0952-4c1c-8acd-f57c7c7149a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bcda6d27ef4fd4b808f0c117a08b29, user_id=35294205231e410b928580e642eaaef6, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:44.662947 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a268e-0952-4c1c-8acd-f57c7c7149a6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:44.676173 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1320/2621] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:41:44 2021] PUT /identity/v3/projects/c4bcda6d27ef4fd4b808f0c117a08b29/users/35294205231e410b928580e642eaaef6/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:41:44.680116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959bf58-cae0-4555-ad83-8d001d0df51f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:44.690958 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959bf58-cae0-4555-ad83-8d001d0df51f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:44.744653 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60cdca-9e19-4149-9ed6-b8e8c2423395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:44.745302 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60cdca-9e19-4149-9ed6-b8e8c2423395 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:44.745583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60cdca-9e19-4149-9ed6-b8e8c2423395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:44.745909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60cdca-9e19-4149-9ed6-b8e8c2423395 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:44.746587 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60cdca-9e19-4149-9ed6-b8e8c2423395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:44.748747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60cdca-9e19-4149-9ed6-b8e8c2423395 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:44.758922 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1302/2622] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:41:44 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:41:44.762581 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a268e-0952-4c1c-8acd-f57c7c7149a6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:44.772936 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a268e-0952-4c1c-8acd-f57c7c7149a6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:44.777653 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f90a2d-be67-423c-9e8a-ac50adbc723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:44.778541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f90a2d-be67-423c-9e8a-ac50adbc723c admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:44.778856 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f90a2d-be67-423c-9e8a-ac50adbc723c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:44.779157 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f90a2d-be67-423c-9e8a-ac50adbc723c admin admin] PATH_INFO: `/v3/projects/c4bcda6d27ef4fd4b808f0c117a08b29/users/35294205231e410b928580e642eaaef6/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:44.781148 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f90a2d-be67-423c-9e8a-ac50adbc723c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bcda6d27ef4fd4b808f0c117a08b29, user_id=35294205231e410b928580e642eaaef6, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:44.783848 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f90a2d-be67-423c-9e8a-ac50adbc723c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:44.794533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1321/2623] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:41:44 2021] PUT /identity/v3/projects/c4bcda6d27ef4fd4b808f0c117a08b29/users/35294205231e410b928580e642eaaef6/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:44.805189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cac93-3471-498b-9c8a-9b8482d8b7c9 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:44.805479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cac93-3471-498b-9c8a-9b8482d8b7c9 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:44.805756 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cac93-3471-498b-9c8a-9b8482d8b7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:44.832524 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-a84cac93-3471-498b-9c8a-9b8482d8b7c9 None None] MFA Rules not processed for user `35294205231e410b928580e642eaaef6`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:44.833705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a84cac93-3471-498b-9c8a-9b8482d8b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:44.898430 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1303/2624] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:44 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:41:44.908214 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f90a2d-be67-423c-9e8a-ac50adbc723c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:44.909981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-19f90a2d-be67-423c-9e8a-ac50adbc723c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:44.967433 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f90a2d-be67-423c-9e8a-ac50adbc723c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:44.971122 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78be1d9-538f-42ca-8806-91b5a4be78b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:44.971762 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be1d9-538f-42ca-8806-91b5a4be78b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:44.972047 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be1d9-538f-42ca-8806-91b5a4be78b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:44.972327 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be1d9-538f-42ca-8806-91b5a4be78b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:44.981200 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78be1d9-538f-42ca-8806-91b5a4be78b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:44.983111 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78be1d9-538f-42ca-8806-91b5a4be78b5 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:44.992320 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1322/2625] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:44 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:45.437805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cac93-3471-498b-9c8a-9b8482d8b7c9 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:45.439198 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a84cac93-3471-498b-9c8a-9b8482d8b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:45.451095 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cac93-3471-498b-9c8a-9b8482d8b7c9 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:45.454545 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0ccc7-c7da-4752-b9a0-cda01ae05c2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:45.455197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0ccc7-c7da-4752-b9a0-cda01ae05c2d service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:45.455478 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0ccc7-c7da-4752-b9a0-cda01ae05c2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:45.455753 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0ccc7-c7da-4752-b9a0-cda01ae05c2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:45.512059 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0ccc7-c7da-4752-b9a0-cda01ae05c2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:45.514231 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0ccc7-c7da-4752-b9a0-cda01ae05c2d service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:45.528046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1304/2626] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:45 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:49.443017 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78be1d9-538f-42ca-8806-91b5a4be78b5 service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:49.451618 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78be1d9-538f-42ca-8806-91b5a4be78b5 service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:49.455771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d522ea-115e-4eac-bef3-e8bd37b03dfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:49.456485 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d522ea-115e-4eac-bef3-e8bd37b03dfc service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:49.456773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d522ea-115e-4eac-bef3-e8bd37b03dfc service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:49.457051 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d522ea-115e-4eac-bef3-e8bd37b03dfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:49.512536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d522ea-115e-4eac-bef3-e8bd37b03dfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:49.513906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d522ea-115e-4eac-bef3-e8bd37b03dfc service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:49.522514 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1323/2627] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:49 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:51.490035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0ccc7-c7da-4752-b9a0-cda01ae05c2d service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:51.550432 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0ccc7-c7da-4752-b9a0-cda01ae05c2d service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:51.554955 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cead1-9054-48d3-a2c2-e21e2797e00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:51.555849 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cead1-9054-48d3-a2c2-e21e2797e00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:51.556133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cead1-9054-48d3-a2c2-e21e2797e00b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:51.556410 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cead1-9054-48d3-a2c2-e21e2797e00b admin admin] PATH_INFO: `/v3/users/4d59edaee583476886e49b5001edceea` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:51.557603 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cead1-9054-48d3-a2c2-e21e2797e00b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d59edaee583476886e49b5001edceea)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:51.559602 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cead1-9054-48d3-a2c2-e21e2797e00b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:51.604820 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1d1cead1-9054-48d3-a2c2-e21e2797e00b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d59edaee583476886e49b5001edceea'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:51.616087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1d1cead1-9054-48d3-a2c2-e21e2797e00b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d59edaee583476886e49b5001edceea'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:51.624251 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1d1cead1-9054-48d3-a2c2-e21e2797e00b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d59edaee583476886e49b5001edceea'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:51.633757 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1d1cead1-9054-48d3-a2c2-e21e2797e00b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d59edaee583476886e49b5001edceea'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:51.634422 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1d1cead1-9054-48d3-a2c2-e21e2797e00b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d59edaee583476886e49b5001edceea'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:51.640934 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1305/2628] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:41:51 2021] DELETE /identity/v3/users/4d59edaee583476886e49b5001edceea => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:51.646587 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c21849-394c-4cf4-bf5a-4dcc68838af1 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:51.647085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c21849-394c-4cf4-bf5a-4dcc68838af1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:51.647198 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c21849-394c-4cf4-bf5a-4dcc68838af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:51.665443 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-c7c21849-394c-4cf4-bf5a-4dcc68838af1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:51.666644 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c7c21849-394c-4cf4-bf5a-4dcc68838af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:51.725112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1324/2629] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:51.734967 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cead1-9054-48d3-a2c2-e21e2797e00b admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:51.736379 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-1d1cead1-9054-48d3-a2c2-e21e2797e00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:51.790754 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cead1-9054-48d3-a2c2-e21e2797e00b admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:51.794363 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2503a85-bc39-41fb-927d-80a2595318c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:51.795027 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2503a85-bc39-41fb-927d-80a2595318c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:51.795305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2503a85-bc39-41fb-927d-80a2595318c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:51.795577 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2503a85-bc39-41fb-927d-80a2595318c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:51.804174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2503a85-bc39-41fb-927d-80a2595318c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:51.805595 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2503a85-bc39-41fb-927d-80a2595318c4 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:51.815170 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1306/2630] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:52.071285 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c21849-394c-4cf4-bf5a-4dcc68838af1 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:52.072896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c7c21849-394c-4cf4-bf5a-4dcc68838af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:52.085807 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c21849-394c-4cf4-bf5a-4dcc68838af1 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:52.090635 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:52.091557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:52.091838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:52.092108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] PATH_INFO: `/v3/projects/84ff650e21f84b43876ae5a3c6dfa773` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:52.093301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ff650e21f84b43876ae5a3c6dfa773)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:52.095226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:52.142868 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ff650e21f84b43876ae5a3c6dfa773', 'request_id': 'req-bdacf9da-e710-4f57-90d2-f94a99e33371'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.149244 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ff650e21f84b43876ae5a3c6dfa773', 'request_id': 'req-bdacf9da-e710-4f57-90d2-f94a99e33371'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.155622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ff650e21f84b43876ae5a3c6dfa773', 'request_id': 'req-bdacf9da-e710-4f57-90d2-f94a99e33371'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.165682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] The token cache is being invalidate because project 84ff650e21f84b43876ae5a3c6dfa773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:41:52.165976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.166609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.168120 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1325/2631] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:41:52 2021] DELETE /identity/v3/projects/84ff650e21f84b43876ae5a3c6dfa773 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:52.172528 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2503a85-bc39-41fb-927d-80a2595318c4 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:52.181906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2503a85-bc39-41fb-927d-80a2595318c4 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:52.236097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbd504-07f4-497e-8b7f-cd66ccb9de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:52.236987 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbd504-07f4-497e-8b7f-cd66ccb9de76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:52.237271 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbd504-07f4-497e-8b7f-cd66ccb9de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:52.237551 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbd504-07f4-497e-8b7f-cd66ccb9de76 admin admin] PATH_INFO: `/v3/users/66e69f0b5da24ddc9ba3b005c84462c1` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:52.238745 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbd504-07f4-497e-8b7f-cd66ccb9de76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e69f0b5da24ddc9ba3b005c84462c1)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:52.240694 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbd504-07f4-497e-8b7f-cd66ccb9de76 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:52.285116 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-20cbd504-07f4-497e-8b7f-cd66ccb9de76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e69f0b5da24ddc9ba3b005c84462c1'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.296942 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-20cbd504-07f4-497e-8b7f-cd66ccb9de76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e69f0b5da24ddc9ba3b005c84462c1'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.303794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-20cbd504-07f4-497e-8b7f-cd66ccb9de76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e69f0b5da24ddc9ba3b005c84462c1'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.311228 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-20cbd504-07f4-497e-8b7f-cd66ccb9de76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e69f0b5da24ddc9ba3b005c84462c1'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.311860 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-20cbd504-07f4-497e-8b7f-cd66ccb9de76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e69f0b5da24ddc9ba3b005c84462c1'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.317514 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1307/2632] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:41:52 2021] DELETE /identity/v3/users/66e69f0b5da24ddc9ba3b005c84462c1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:52.575909 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:52.577422 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:52.590239 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacf9da-e710-4f57-90d2-f94a99e33371 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:52.645977 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:52.646829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:52.647468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:52.647468 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] PATH_INFO: `/v3/projects/24928aae126449b3a8e6e84b7a088a7c` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:52.648564 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24928aae126449b3a8e6e84b7a088a7c)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:52.650458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:52.694532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24928aae126449b3a8e6e84b7a088a7c', 'request_id': 'req-ef73be81-3759-4a83-adde-cfade8633603'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.701059 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24928aae126449b3a8e6e84b7a088a7c', 'request_id': 'req-ef73be81-3759-4a83-adde-cfade8633603'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.707074 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24928aae126449b3a8e6e84b7a088a7c', 'request_id': 'req-ef73be81-3759-4a83-adde-cfade8633603'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.717936 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] The token cache is being invalidate because project 24928aae126449b3a8e6e84b7a088a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:41:52.718228 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.718911 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.720488 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1326/2633] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:41:52 2021] DELETE /identity/v3/projects/24928aae126449b3a8e6e84b7a088a7c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:52.724467 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbd504-07f4-497e-8b7f-cd66ccb9de76 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:52.725946 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-20cbd504-07f4-497e-8b7f-cd66ccb9de76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:52.738930 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbd504-07f4-497e-8b7f-cd66ccb9de76 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:52.792468 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdb985-00f8-40db-937b-98b4abf5624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:52.793263 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdb985-00f8-40db-937b-98b4abf5624a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:52.793546 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdb985-00f8-40db-937b-98b4abf5624a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:52.793823 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdb985-00f8-40db-937b-98b4abf5624a admin admin] PATH_INFO: `/v3/users/35294205231e410b928580e642eaaef6` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:52.795649 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdb985-00f8-40db-937b-98b4abf5624a admin admin] RBAC: Authorizing `identity:delete_user(user_id=35294205231e410b928580e642eaaef6)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:52.797557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdb985-00f8-40db-937b-98b4abf5624a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:52.839834 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-49cdb985-00f8-40db-937b-98b4abf5624a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35294205231e410b928580e642eaaef6'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.851567 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-49cdb985-00f8-40db-937b-98b4abf5624a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35294205231e410b928580e642eaaef6'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.859205 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-49cdb985-00f8-40db-937b-98b4abf5624a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35294205231e410b928580e642eaaef6'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.865912 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-49cdb985-00f8-40db-937b-98b4abf5624a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35294205231e410b928580e642eaaef6'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.866544 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-49cdb985-00f8-40db-937b-98b4abf5624a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35294205231e410b928580e642eaaef6'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:52.872202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1308/2634] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:41:52 2021] DELETE /identity/v3/users/35294205231e410b928580e642eaaef6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:53.127561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:53.129017 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:53.142154 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73be81-3759-4a83-adde-cfade8633603 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:53.197769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:53.198614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:53.198926 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:53.199220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed admin admin] PATH_INFO: `/v3/projects/c4bcda6d27ef4fd4b808f0c117a08b29` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:53.200398 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4bcda6d27ef4fd4b808f0c117a08b29)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:53.202873 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:53.247177 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bcda6d27ef4fd4b808f0c117a08b29', 'request_id': 'req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:53.254630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bcda6d27ef4fd4b808f0c117a08b29', 'request_id': 'req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:53.260877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bcda6d27ef4fd4b808f0c117a08b29', 'request_id': 'req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:53.271533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed admin admin] The token cache is being invalidate because project c4bcda6d27ef4fd4b808f0c117a08b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:41:53.271827 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:53.272467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-6cdaea7e-a8e6-488e-9732-5e3bdaf682ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:53.274028 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1327/2635] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:41:53 2021] DELETE /identity/v3/projects/c4bcda6d27ef4fd4b808f0c117a08b29 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:53.280731 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51d9fe-4e88-4c39-81bd-efd226c3ea4f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:53.281021 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51d9fe-4e88-4c39-81bd-efd226c3ea4f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:53.281302 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51d9fe-4e88-4c39-81bd-efd226c3ea4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:53.299234 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-8e51d9fe-4e88-4c39-81bd-efd226c3ea4f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:53.300427 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-8e51d9fe-4e88-4c39-81bd-efd226c3ea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:53.357848 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1309/2636] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:53.366229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8755c-011d-45d8-92ce-32fb1a009ff6 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:53.366521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8755c-011d-45d8-92ce-32fb1a009ff6 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:53.366809 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8755c-011d-45d8-92ce-32fb1a009ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:53.385098 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-1ec8755c-011d-45d8-92ce-32fb1a009ff6 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:53.386289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-1ec8755c-011d-45d8-92ce-32fb1a009ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:53.394628 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1328/2637] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:53.398809 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51d9fe-4e88-4c39-81bd-efd226c3ea4f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:53.408540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51d9fe-4e88-4c39-81bd-efd226c3ea4f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:53.413210 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30d2f6-d734-40fa-a572-bcf7f2bdc799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:53.413858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30d2f6-d734-40fa-a572-bcf7f2bdc799 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:53.414160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30d2f6-d734-40fa-a572-bcf7f2bdc799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:53.414437 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30d2f6-d734-40fa-a572-bcf7f2bdc799 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:53.415208 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30d2f6-d734-40fa-a572-bcf7f2bdc799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:41:53.415520 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30d2f6-d734-40fa-a572-bcf7f2bdc799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:53.417133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30d2f6-d734-40fa-a572-bcf7f2bdc799 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:53.428482 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1310/2638] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:41:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:41:53.432813 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8755c-011d-45d8-92ce-32fb1a009ff6 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:53.442516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8755c-011d-45d8-92ce-32fb1a009ff6 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:53.447153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adcf64-d318-44a9-813a-bb7ea8584ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:53.447834 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adcf64-d318-44a9-813a-bb7ea8584ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:53.448112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adcf64-d318-44a9-813a-bb7ea8584ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:53.448383 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adcf64-d318-44a9-813a-bb7ea8584ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:53.449072 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adcf64-d318-44a9-813a-bb7ea8584ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:53.451650 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adcf64-d318-44a9-813a-bb7ea8584ba5 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:53.475921 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1329/2639] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:41:53 2021] POST /identity/v3/projects => generated 401 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:41:53.479937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30d2f6-d734-40fa-a572-bcf7f2bdc799 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:53.489639 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30d2f6-d734-40fa-a572-bcf7f2bdc799 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:53.543937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426faf27-3ca4-4650-971d-e7d012aac4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:53.544636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426faf27-3ca4-4650-971d-e7d012aac4ca admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:53.544922 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426faf27-3ca4-4650-971d-e7d012aac4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:53.545203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426faf27-3ca4-4650-971d-e7d012aac4ca admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:53.545906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426faf27-3ca4-4650-971d-e7d012aac4ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:53.547969 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426faf27-3ca4-4650-971d-e7d012aac4ca admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:53.567598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1311/2640] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:41:53 2021] POST /identity/v3/users => generated 301 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:41:53.571626 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adcf64-d318-44a9-813a-bb7ea8584ba5 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:53.582876 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adcf64-d318-44a9-813a-bb7ea8584ba5 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:53.587950 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77401a45-e09b-4483-ac62-200350dfbf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:53.588612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77401a45-e09b-4483-ac62-200350dfbf28 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:53.588896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77401a45-e09b-4483-ac62-200350dfbf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:53.589175 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77401a45-e09b-4483-ac62-200350dfbf28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:53.589949 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77401a45-e09b-4483-ac62-200350dfbf28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:53.591602 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77401a45-e09b-4483-ac62-200350dfbf28 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:53.602202 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1330/2641] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:41:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:41:53.606123 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426faf27-3ca4-4650-971d-e7d012aac4ca admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:53.616324 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426faf27-3ca4-4650-971d-e7d012aac4ca admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:53.620864 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b302e-e782-4e19-a0c4-3486d54fb74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:53.621501 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b302e-e782-4e19-a0c4-3486d54fb74d admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:53.621779 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b302e-e782-4e19-a0c4-3486d54fb74d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:53.622054 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b302e-e782-4e19-a0c4-3486d54fb74d admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:53.623461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b302e-e782-4e19-a0c4-3486d54fb74d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:53.625049 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b302e-e782-4e19-a0c4-3486d54fb74d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:53.635194 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1312/2642] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:41:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:41:53.638925 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77401a45-e09b-4483-ac62-200350dfbf28 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:53.648523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77401a45-e09b-4483-ac62-200350dfbf28 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:53.653115 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a74f27-ab3b-49d5-9be7-024b062ec233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:53.654020 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74f27-ab3b-49d5-9be7-024b062ec233 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:53.654308 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74f27-ab3b-49d5-9be7-024b062ec233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:53.654589 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74f27-ab3b-49d5-9be7-024b062ec233 admin admin] PATH_INFO: `/v3/projects/532bcee7134340728729469b6bb1f5b6/users/b6502e3da7654dedb23fd70e359332fc/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:53.669069 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a74f27-ab3b-49d5-9be7-024b062ec233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532bcee7134340728729469b6bb1f5b6, user_id=b6502e3da7654dedb23fd70e359332fc, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:53.672264 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a74f27-ab3b-49d5-9be7-024b062ec233 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:53.690055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1331/2643] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:41:53 2021] PUT /identity/v3/projects/532bcee7134340728729469b6bb1f5b6/users/b6502e3da7654dedb23fd70e359332fc/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:53.697146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa968e-0b9d-4c92-a5be-9a972dac346f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:53.697438 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa968e-0b9d-4c92-a5be-9a972dac346f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:53.697725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa968e-0b9d-4c92-a5be-9a972dac346f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:53.724678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-03aa968e-0b9d-4c92-a5be-9a972dac346f None None] MFA Rules not processed for user `b6502e3da7654dedb23fd70e359332fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:53.725949 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-03aa968e-0b9d-4c92-a5be-9a972dac346f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:53.787769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1313/2644] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:53 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:53.792260 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a74f27-ab3b-49d5-9be7-024b062ec233 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:53.852004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a74f27-ab3b-49d5-9be7-024b062ec233 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:53.856667 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed5a07-fd8e-48a1-a139-96e65f6ee4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:53.857809 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed5a07-fd8e-48a1-a139-96e65f6ee4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:53.858095 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed5a07-fd8e-48a1-a139-96e65f6ee4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:53.858374 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed5a07-fd8e-48a1-a139-96e65f6ee4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:53.859111 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed5a07-fd8e-48a1-a139-96e65f6ee4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:53.861039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed5a07-fd8e-48a1-a139-96e65f6ee4d4 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:53.887512 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1332/2645] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:41:53 2021] POST /identity/v3/projects => generated 399 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:41:53.891560 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa968e-0b9d-4c92-a5be-9a972dac346f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:53.902015 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa968e-0b9d-4c92-a5be-9a972dac346f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:53.956542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f385b-e0a5-4354-99ab-44fb44454746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:53.957188 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f385b-e0a5-4354-99ab-44fb44454746 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:53.957473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f385b-e0a5-4354-99ab-44fb44454746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:53.957752 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f385b-e0a5-4354-99ab-44fb44454746 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:53.958460 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f385b-e0a5-4354-99ab-44fb44454746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:53.960413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f385b-e0a5-4354-99ab-44fb44454746 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:53.980152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1314/2646] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:41:53 2021] POST /identity/v3/users => generated 306 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:41:53.984820 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed5a07-fd8e-48a1-a139-96e65f6ee4d4 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:53.994792 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed5a07-fd8e-48a1-a139-96e65f6ee4d4 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:53.999598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef3766-8ea3-4971-a7e3-ccda3f1cf4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:54.000246 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef3766-8ea3-4971-a7e3-ccda3f1cf4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:54.000530 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef3766-8ea3-4971-a7e3-ccda3f1cf4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:54.000812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef3766-8ea3-4971-a7e3-ccda3f1cf4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:54.001545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef3766-8ea3-4971-a7e3-ccda3f1cf4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:54.003176 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef3766-8ea3-4971-a7e3-ccda3f1cf4e2 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:54.013595 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1333/2647] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:41:53 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:41:54.017473 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f385b-e0a5-4354-99ab-44fb44454746 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:54.027128 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f385b-e0a5-4354-99ab-44fb44454746 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:54.032259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac826ee5-956d-4703-940d-b8804dc169fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:54.033121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac826ee5-956d-4703-940d-b8804dc169fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:54.033403 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac826ee5-956d-4703-940d-b8804dc169fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:54.033688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac826ee5-956d-4703-940d-b8804dc169fa admin admin] PATH_INFO: `/v3/projects/ac85c07e083a4df793c78c9395aa0666/users/4fc06f5a89304a519043b452a8378381/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:54.048286 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac826ee5-956d-4703-940d-b8804dc169fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac85c07e083a4df793c78c9395aa0666, user_id=4fc06f5a89304a519043b452a8378381, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:54.050954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac826ee5-956d-4703-940d-b8804dc169fa admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:54.064105 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1315/2648] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:41:54 2021] PUT /identity/v3/projects/ac85c07e083a4df793c78c9395aa0666/users/4fc06f5a89304a519043b452a8378381/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:54.067931 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef3766-8ea3-4971-a7e3-ccda3f1cf4e2 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:54.077694 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef3766-8ea3-4971-a7e3-ccda3f1cf4e2 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:54.131924 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58908753-b866-4233-ab70-1df4d315e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:54.132586 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908753-b866-4233-ab70-1df4d315e67c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:54.132871 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908753-b866-4233-ab70-1df4d315e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:54.133153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908753-b866-4233-ab70-1df4d315e67c admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:54.133887 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58908753-b866-4233-ab70-1df4d315e67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:54.135514 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58908753-b866-4233-ab70-1df4d315e67c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:54.145033 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1334/2649] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:41:54 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:41:54.148947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac826ee5-956d-4703-940d-b8804dc169fa admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:54.159697 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac826ee5-956d-4703-940d-b8804dc169fa admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:54.164251 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf69a9-04e3-468e-9832-e5ab8dac61db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:54.165133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf69a9-04e3-468e-9832-e5ab8dac61db admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:54.165412 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf69a9-04e3-468e-9832-e5ab8dac61db admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:54.165685 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf69a9-04e3-468e-9832-e5ab8dac61db admin admin] PATH_INFO: `/v3/projects/ac85c07e083a4df793c78c9395aa0666/users/4fc06f5a89304a519043b452a8378381/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:54.167679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf69a9-04e3-468e-9832-e5ab8dac61db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac85c07e083a4df793c78c9395aa0666, user_id=4fc06f5a89304a519043b452a8378381, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:54.170912 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf69a9-04e3-468e-9832-e5ab8dac61db admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:54.180555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1316/2650] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:41:54 2021] PUT /identity/v3/projects/ac85c07e083a4df793c78c9395aa0666/users/4fc06f5a89304a519043b452a8378381/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:41:54.190366 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6d65a-51a0-4120-a248-8ff2718f947f None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:54.190659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6d65a-51a0-4120-a248-8ff2718f947f None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:54.191004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6d65a-51a0-4120-a248-8ff2718f947f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:54.217661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-67c6d65a-51a0-4120-a248-8ff2718f947f None None] MFA Rules not processed for user `4fc06f5a89304a519043b452a8378381`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:54.218941 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-67c6d65a-51a0-4120-a248-8ff2718f947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:54.283585 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1335/2651] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:54 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:54.293711 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf69a9-04e3-468e-9832-e5ab8dac61db admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:54.296127 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f8cf69a9-04e3-468e-9832-e5ab8dac61db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:54.352003 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf69a9-04e3-468e-9832-e5ab8dac61db admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:54.355677 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1f33d-c2d2-4009-a755-b487ab2ad738 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:54.356305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f33d-c2d2-4009-a755-b487ab2ad738 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:54.356588 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f33d-c2d2-4009-a755-b487ab2ad738 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:54.357383 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f33d-c2d2-4009-a755-b487ab2ad738 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:54.366160 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1f33d-c2d2-4009-a755-b487ab2ad738 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:54.367615 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1f33d-c2d2-4009-a755-b487ab2ad738 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:54.378078 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1317/2652] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:54 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:54.448529 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6d65a-51a0-4120-a248-8ff2718f947f None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:54.458022 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6d65a-51a0-4120-a248-8ff2718f947f None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:54.461925 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0247fc4-1b7f-401a-8e5c-7b47c0b12fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:54.462562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0247fc4-1b7f-401a-8e5c-7b47c0b12fca service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:54.462871 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0247fc4-1b7f-401a-8e5c-7b47c0b12fca service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:54.463156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0247fc4-1b7f-401a-8e5c-7b47c0b12fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:54.519612 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0247fc4-1b7f-401a-8e5c-7b47c0b12fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:54.521079 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0247fc4-1b7f-401a-8e5c-7b47c0b12fca service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:54.529957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1336/2653] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:54 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:58.479964 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1f33d-c2d2-4009-a755-b487ab2ad738 service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:58.540733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1f33d-c2d2-4009-a755-b487ab2ad738 service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:58.545760 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cac81-ee62-4005-8ec3-01f79caf84ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:58.546608 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cac81-ee62-4005-8ec3-01f79caf84ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:58.546919 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cac81-ee62-4005-8ec3-01f79caf84ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:58.547196 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cac81-ee62-4005-8ec3-01f79caf84ce admin admin] PATH_INFO: `/v3/users/b6502e3da7654dedb23fd70e359332fc` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:58.548367 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cac81-ee62-4005-8ec3-01f79caf84ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6502e3da7654dedb23fd70e359332fc)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:58.550268 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cac81-ee62-4005-8ec3-01f79caf84ce admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:58.593911 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-259cac81-ee62-4005-8ec3-01f79caf84ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6502e3da7654dedb23fd70e359332fc'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:58.605232 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-259cac81-ee62-4005-8ec3-01f79caf84ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6502e3da7654dedb23fd70e359332fc'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:58.612989 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-259cac81-ee62-4005-8ec3-01f79caf84ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6502e3da7654dedb23fd70e359332fc'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:58.619578 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-259cac81-ee62-4005-8ec3-01f79caf84ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6502e3da7654dedb23fd70e359332fc'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:58.620228 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-259cac81-ee62-4005-8ec3-01f79caf84ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6502e3da7654dedb23fd70e359332fc'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:58.625893 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1318/2654] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:41:58 2021] DELETE /identity/v3/users/b6502e3da7654dedb23fd70e359332fc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:58.630319 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99aa5a-1631-48c1-9cfc-fe1520059829 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:58.630801 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99aa5a-1631-48c1-9cfc-fe1520059829 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:58.630951 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99aa5a-1631-48c1-9cfc-fe1520059829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:58.647856 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-3a99aa5a-1631-48c1-9cfc-fe1520059829 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:58.649044 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3a99aa5a-1631-48c1-9cfc-fe1520059829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:58.706137 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1337/2655] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:58.716135 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cac81-ee62-4005-8ec3-01f79caf84ce admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:58.718002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-259cac81-ee62-4005-8ec3-01f79caf84ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:58.771972 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cac81-ee62-4005-8ec3-01f79caf84ce admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:58.775621 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abf6ae-0c56-43de-86ee-12973d0fc6ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:58.776250 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abf6ae-0c56-43de-86ee-12973d0fc6ea service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:58.776530 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abf6ae-0c56-43de-86ee-12973d0fc6ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:58.776806 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abf6ae-0c56-43de-86ee-12973d0fc6ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:58.786243 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abf6ae-0c56-43de-86ee-12973d0fc6ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:58.787700 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abf6ae-0c56-43de-86ee-12973d0fc6ea service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:58.797449 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1319/2656] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:59.050565 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99aa5a-1631-48c1-9cfc-fe1520059829 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:59.052095 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3a99aa5a-1631-48c1-9cfc-fe1520059829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:59.063659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99aa5a-1631-48c1-9cfc-fe1520059829 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:59.068390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:59.069249 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:59.069533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:59.069874 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] PATH_INFO: `/v3/projects/532bcee7134340728729469b6bb1f5b6` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:59.071083 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] RBAC: Authorizing `identity:delete_project(project_id=532bcee7134340728729469b6bb1f5b6)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:59.073061 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:59.118777 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532bcee7134340728729469b6bb1f5b6', 'request_id': 'req-3d6f76f0-8eec-4526-ad17-0ba66407805f'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.126344 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532bcee7134340728729469b6bb1f5b6', 'request_id': 'req-3d6f76f0-8eec-4526-ad17-0ba66407805f'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.132611 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532bcee7134340728729469b6bb1f5b6', 'request_id': 'req-3d6f76f0-8eec-4526-ad17-0ba66407805f'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.142888 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] The token cache is being invalidate because project 532bcee7134340728729469b6bb1f5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:41:59.143151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.143760 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.145282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1338/2657] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:41:59 2021] DELETE /identity/v3/projects/532bcee7134340728729469b6bb1f5b6 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:59.149185 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abf6ae-0c56-43de-86ee-12973d0fc6ea service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:59.159259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abf6ae-0c56-43de-86ee-12973d0fc6ea service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:59.212679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a4b6-00bf-48a8-ab33-c57f57900f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:59.213543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a4b6-00bf-48a8-ab33-c57f57900f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:59.213828 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a4b6-00bf-48a8-ab33-c57f57900f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:59.214105 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a4b6-00bf-48a8-ab33-c57f57900f1b admin admin] PATH_INFO: `/v3/users/4fc06f5a89304a519043b452a8378381` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:59.215338 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138a4b6-00bf-48a8-ab33-c57f57900f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc06f5a89304a519043b452a8378381)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:59.217902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138a4b6-00bf-48a8-ab33-c57f57900f1b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:59.260553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4138a4b6-00bf-48a8-ab33-c57f57900f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc06f5a89304a519043b452a8378381'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.272629 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4138a4b6-00bf-48a8-ab33-c57f57900f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc06f5a89304a519043b452a8378381'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.279424 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4138a4b6-00bf-48a8-ab33-c57f57900f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc06f5a89304a519043b452a8378381'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.286000 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4138a4b6-00bf-48a8-ab33-c57f57900f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc06f5a89304a519043b452a8378381'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.286651 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4138a4b6-00bf-48a8-ab33-c57f57900f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc06f5a89304a519043b452a8378381'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.292327 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1320/2658] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:41:59 2021] DELETE /identity/v3/users/4fc06f5a89304a519043b452a8378381 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:59.549435 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:59.550938 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:59.564557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f76f0-8eec-4526-ad17-0ba66407805f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:59.622304 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:59.623589 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:59.623874 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:59.624155 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7 admin admin] PATH_INFO: `/v3/projects/ac85c07e083a4df793c78c9395aa0666` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:59.625362 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac85c07e083a4df793c78c9395aa0666)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:59.627330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:59.676649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac85c07e083a4df793c78c9395aa0666', 'request_id': 'req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.683473 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac85c07e083a4df793c78c9395aa0666', 'request_id': 'req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.691571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac85c07e083a4df793c78c9395aa0666', 'request_id': 'req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.701854 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7 admin admin] The token cache is being invalidate because project ac85c07e083a4df793c78c9395aa0666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:41:59.702139 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.702780 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-93f7ea04-f10f-41bf-8fef-7e476bbd79c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:41:59.704351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1339/2659] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:41:59 2021] DELETE /identity/v3/projects/ac85c07e083a4df793c78c9395aa0666 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:41:59.709920 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e0f9f-1f8c-4bfa-89ea-2bb2ea2b241a None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:59.710364 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e0f9f-1f8c-4bfa-89ea-2bb2ea2b241a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:59.710461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e0f9f-1f8c-4bfa-89ea-2bb2ea2b241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:59.727900 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-db4e0f9f-1f8c-4bfa-89ea-2bb2ea2b241a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:59.729082 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-db4e0f9f-1f8c-4bfa-89ea-2bb2ea2b241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:59.784781 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1321/2660] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:59.793444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99bda1-f6ba-4721-9387-f60a50070988 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:59.793734 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99bda1-f6ba-4721-9387-f60a50070988 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:59.794015 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99bda1-f6ba-4721-9387-f60a50070988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:59.813194 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-5f99bda1-f6ba-4721-9387-f60a50070988 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:59.814389 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5f99bda1-f6ba-4721-9387-f60a50070988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:59.822340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1340/2661] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:41:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:59.826319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e0f9f-1f8c-4bfa-89ea-2bb2ea2b241a None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:59.835679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e0f9f-1f8c-4bfa-89ea-2bb2ea2b241a None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:59.840452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b676252-8c4b-4981-8cd1-13adfc706e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:59.841086 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b676252-8c4b-4981-8cd1-13adfc706e36 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:59.841388 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b676252-8c4b-4981-8cd1-13adfc706e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:59.841667 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b676252-8c4b-4981-8cd1-13adfc706e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:59.842393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b676252-8c4b-4981-8cd1-13adfc706e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:41:59.842698 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b676252-8c4b-4981-8cd1-13adfc706e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:59.844319 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b676252-8c4b-4981-8cd1-13adfc706e36 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:59.855458 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1322/2662] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:41:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:41:59.860027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99bda1-f6ba-4721-9387-f60a50070988 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:59.868892 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99bda1-f6ba-4721-9387-f60a50070988 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:59.874121 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3b09a-6752-4b80-97a0-9df05132dd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:59.874740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3b09a-6752-4b80-97a0-9df05132dd67 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:59.875167 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3b09a-6752-4b80-97a0-9df05132dd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:59.875454 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3b09a-6752-4b80-97a0-9df05132dd67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:59.876165 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3b09a-6752-4b80-97a0-9df05132dd67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:59.878039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3b09a-6752-4b80-97a0-9df05132dd67 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:59.902626 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1341/2663] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:41:59 2021] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:41:59.909048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b676252-8c4b-4981-8cd1-13adfc706e36 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:59.920742 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b676252-8c4b-4981-8cd1-13adfc706e36 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:59.975069 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa46c80-38a0-4d8b-aefa-7becfa4c6661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:59.975726 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa46c80-38a0-4d8b-aefa-7becfa4c6661 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:59.976008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa46c80-38a0-4d8b-aefa-7becfa4c6661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:59.976281 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa46c80-38a0-4d8b-aefa-7becfa4c6661 admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:59.976971 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa46c80-38a0-4d8b-aefa-7becfa4c6661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:59.978948 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa46c80-38a0-4d8b-aefa-7becfa4c6661 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:59.998324 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1323/2664] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:41:59 2021] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:00.007638 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3b09a-6752-4b80-97a0-9df05132dd67 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:00.020293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3b09a-6752-4b80-97a0-9df05132dd67 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:00.024914 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0ab9c-f743-405e-bdb7-bf93a683c42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:00.025568 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ab9c-f743-405e-bdb7-bf93a683c42d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:00.025853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ab9c-f743-405e-bdb7-bf93a683c42d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:00.026130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ab9c-f743-405e-bdb7-bf93a683c42d admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:00.026889 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0ab9c-f743-405e-bdb7-bf93a683c42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:00.028477 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0ab9c-f743-405e-bdb7-bf93a683c42d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:00.038929 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1342/2665] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:00.042798 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa46c80-38a0-4d8b-aefa-7becfa4c6661 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:00.052681 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa46c80-38a0-4d8b-aefa-7becfa4c6661 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:00.057224 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724890de-2ba0-4f56-b95f-e5066de5ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:00.057861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724890de-2ba0-4f56-b95f-e5066de5ad2b admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:00.058141 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724890de-2ba0-4f56-b95f-e5066de5ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:00.058415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724890de-2ba0-4f56-b95f-e5066de5ad2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:00.059186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724890de-2ba0-4f56-b95f-e5066de5ad2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:00.061336 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724890de-2ba0-4f56-b95f-e5066de5ad2b admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:00.071291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1324/2666] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:00.075190 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0ab9c-f743-405e-bdb7-bf93a683c42d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:00.085393 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0ab9c-f743-405e-bdb7-bf93a683c42d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:00.090175 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2e415-bf55-44e8-8c0e-54306052ce25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:00.091072 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2e415-bf55-44e8-8c0e-54306052ce25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:00.091373 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2e415-bf55-44e8-8c0e-54306052ce25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:00.091635 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2e415-bf55-44e8-8c0e-54306052ce25 admin admin] PATH_INFO: `/v3/projects/7f8c03152ffc421c9868941bde3d31de/users/7d0d38105e674688be70b147d69527f0/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:00.105476 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2e415-bf55-44e8-8c0e-54306052ce25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8c03152ffc421c9868941bde3d31de, user_id=7d0d38105e674688be70b147d69527f0, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:00.108108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2e415-bf55-44e8-8c0e-54306052ce25 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:00.120375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1343/2667] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:00 2021] PUT /identity/v3/projects/7f8c03152ffc421c9868941bde3d31de/users/7d0d38105e674688be70b147d69527f0/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:00.131689 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc506-5c9e-4ea0-b39d-5291d3b1cf9d None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:00.131978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc506-5c9e-4ea0-b39d-5291d3b1cf9d None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:00.132256 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc506-5c9e-4ea0-b39d-5291d3b1cf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:00.159803 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e84dc506-5c9e-4ea0-b39d-5291d3b1cf9d None None] MFA Rules not processed for user `7d0d38105e674688be70b147d69527f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:00.160983 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e84dc506-5c9e-4ea0-b39d-5291d3b1cf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:00.223816 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1325/2668] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:00 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:00.228300 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2e415-bf55-44e8-8c0e-54306052ce25 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:00.287683 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2e415-bf55-44e8-8c0e-54306052ce25 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:00.292254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c528f-fe10-421e-bbd6-529bf57dd96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:00.292905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c528f-fe10-421e-bbd6-529bf57dd96a admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:00.293184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c528f-fe10-421e-bbd6-529bf57dd96a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:00.293459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c528f-fe10-421e-bbd6-529bf57dd96a admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:00.294159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c528f-fe10-421e-bbd6-529bf57dd96a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:00.296083 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c528f-fe10-421e-bbd6-529bf57dd96a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:00.320799 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1344/2669] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:42:00 2021] POST /identity/v3/projects => generated 389 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:00.324762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dc506-5c9e-4ea0-b39d-5291d3b1cf9d None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:00.335812 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dc506-5c9e-4ea0-b39d-5291d3b1cf9d None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:00.395394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a513f3-665f-4a67-854e-117d88aaed2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:00.396059 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a513f3-665f-4a67-854e-117d88aaed2f admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:00.396345 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a513f3-665f-4a67-854e-117d88aaed2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:00.396640 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a513f3-665f-4a67-854e-117d88aaed2f admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:00.397322 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a513f3-665f-4a67-854e-117d88aaed2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:00.399271 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a513f3-665f-4a67-854e-117d88aaed2f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:00.417996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1326/2670] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:42:00 2021] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:00.422434 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c528f-fe10-421e-bbd6-529bf57dd96a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:00.432652 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c528f-fe10-421e-bbd6-529bf57dd96a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:00.438111 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516dba54-ca80-41ea-add1-f02973a94ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:00.438773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516dba54-ca80-41ea-add1-f02973a94ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:00.439160 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516dba54-ca80-41ea-add1-f02973a94ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:00.439444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516dba54-ca80-41ea-add1-f02973a94ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:00.440178 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516dba54-ca80-41ea-add1-f02973a94ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:00.441755 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516dba54-ca80-41ea-add1-f02973a94ba7 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:00.452242 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1345/2671] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:00.456181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a513f3-665f-4a67-854e-117d88aaed2f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:00.466509 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a513f3-665f-4a67-854e-117d88aaed2f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:00.471157 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299fe7e-55a3-4d67-8400-e60a97f6c879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:00.472025 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299fe7e-55a3-4d67-8400-e60a97f6c879 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:00.472308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299fe7e-55a3-4d67-8400-e60a97f6c879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:00.472586 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299fe7e-55a3-4d67-8400-e60a97f6c879 admin admin] PATH_INFO: `/v3/projects/eb93747827d84e2eb20e07f24e579506/users/46a1e13dc9c048e2939e91a2f4b63fce/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:00.487324 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299fe7e-55a3-4d67-8400-e60a97f6c879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb93747827d84e2eb20e07f24e579506, user_id=46a1e13dc9c048e2939e91a2f4b63fce, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:00.489885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299fe7e-55a3-4d67-8400-e60a97f6c879 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:00.502880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1327/2672] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:00 2021] PUT /identity/v3/projects/eb93747827d84e2eb20e07f24e579506/users/46a1e13dc9c048e2939e91a2f4b63fce/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:00.506764 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516dba54-ca80-41ea-add1-f02973a94ba7 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:00.517106 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516dba54-ca80-41ea-add1-f02973a94ba7 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:00.571220 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975b48f-2fa5-46d4-b773-abc5e7a26752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:00.571879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975b48f-2fa5-46d4-b773-abc5e7a26752 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:00.572163 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975b48f-2fa5-46d4-b773-abc5e7a26752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:00.572484 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975b48f-2fa5-46d4-b773-abc5e7a26752 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:00.573181 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975b48f-2fa5-46d4-b773-abc5e7a26752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:00.574760 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975b48f-2fa5-46d4-b773-abc5e7a26752 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:00.584400 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1346/2673] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:00 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:00.588939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299fe7e-55a3-4d67-8400-e60a97f6c879 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:00.599534 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299fe7e-55a3-4d67-8400-e60a97f6c879 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:00.604061 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1003950-d785-438e-94a9-61671f25e80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:00.604925 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1003950-d785-438e-94a9-61671f25e80f admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:00.605205 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1003950-d785-438e-94a9-61671f25e80f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:00.605479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1003950-d785-438e-94a9-61671f25e80f admin admin] PATH_INFO: `/v3/projects/eb93747827d84e2eb20e07f24e579506/users/46a1e13dc9c048e2939e91a2f4b63fce/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:00.608022 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1003950-d785-438e-94a9-61671f25e80f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb93747827d84e2eb20e07f24e579506, user_id=46a1e13dc9c048e2939e91a2f4b63fce, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:00.610675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1003950-d785-438e-94a9-61671f25e80f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:00.620800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1328/2674] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:00 2021] PUT /identity/v3/projects/eb93747827d84e2eb20e07f24e579506/users/46a1e13dc9c048e2939e91a2f4b63fce/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:00.631414 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda08c48-a1d5-488a-8c7b-b2aa9237f989 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:00.631703 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda08c48-a1d5-488a-8c7b-b2aa9237f989 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:00.631983 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda08c48-a1d5-488a-8c7b-b2aa9237f989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:00.658496 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-cda08c48-a1d5-488a-8c7b-b2aa9237f989 None None] MFA Rules not processed for user `46a1e13dc9c048e2939e91a2f4b63fce`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:00.660211 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-cda08c48-a1d5-488a-8c7b-b2aa9237f989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:00.727665 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1347/2675] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:00 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:00.738211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1003950-d785-438e-94a9-61671f25e80f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:00.739873 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f1003950-d785-438e-94a9-61671f25e80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:00.794189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1003950-d785-438e-94a9-61671f25e80f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:00.798465 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f01e8-179c-4f18-9396-895b0bad086a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:00.799121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f01e8-179c-4f18-9396-895b0bad086a service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:00.799408 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f01e8-179c-4f18-9396-895b0bad086a service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:00.799686 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f01e8-179c-4f18-9396-895b0bad086a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:00.808382 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f01e8-179c-4f18-9396-895b0bad086a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:00.809811 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f01e8-179c-4f18-9396-895b0bad086a service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:00.819044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1329/2676] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:00 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:00.934334 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda08c48-a1d5-488a-8c7b-b2aa9237f989 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:00.995694 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda08c48-a1d5-488a-8c7b-b2aa9237f989 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:01.000133 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203c51a-523b-45ba-afb2-363c1d24fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:01.000979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203c51a-523b-45ba-afb2-363c1d24fd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:01.001260 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203c51a-523b-45ba-afb2-363c1d24fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:01.001535 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203c51a-523b-45ba-afb2-363c1d24fd03 admin admin] PATH_INFO: `/v3/users/7d0d38105e674688be70b147d69527f0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:01.002714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203c51a-523b-45ba-afb2-363c1d24fd03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d0d38105e674688be70b147d69527f0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:01.004659 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203c51a-523b-45ba-afb2-363c1d24fd03 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:01.049110 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c203c51a-523b-45ba-afb2-363c1d24fd03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d0d38105e674688be70b147d69527f0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.060160 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c203c51a-523b-45ba-afb2-363c1d24fd03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d0d38105e674688be70b147d69527f0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.067095 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c203c51a-523b-45ba-afb2-363c1d24fd03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d0d38105e674688be70b147d69527f0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.074079 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c203c51a-523b-45ba-afb2-363c1d24fd03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d0d38105e674688be70b147d69527f0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.074707 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c203c51a-523b-45ba-afb2-363c1d24fd03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d0d38105e674688be70b147d69527f0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.080494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1348/2677] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:00 2021] DELETE /identity/v3/users/7d0d38105e674688be70b147d69527f0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:01.085122 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f07143-fdff-41bd-baf6-c47b0b137b65 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:01.085442 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f07143-fdff-41bd-baf6-c47b0b137b65 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:01.085727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f07143-fdff-41bd-baf6-c47b0b137b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:01.103958 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-66f07143-fdff-41bd-baf6-c47b0b137b65 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:01.105229 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-66f07143-fdff-41bd-baf6-c47b0b137b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:01.162019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1330/2678] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:01.171859 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203c51a-523b-45ba-afb2-363c1d24fd03 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:01.173259 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c203c51a-523b-45ba-afb2-363c1d24fd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:01.228096 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203c51a-523b-45ba-afb2-363c1d24fd03 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:01.231770 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16998917-4536-4242-8b5c-954be0e8316e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:01.232403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16998917-4536-4242-8b5c-954be0e8316e service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:01.232687 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16998917-4536-4242-8b5c-954be0e8316e service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:01.232965 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16998917-4536-4242-8b5c-954be0e8316e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:01.241664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16998917-4536-4242-8b5c-954be0e8316e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:01.243099 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16998917-4536-4242-8b5c-954be0e8316e service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:01.252182 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1349/2679] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:42:01.505048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f07143-fdff-41bd-baf6-c47b0b137b65 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:01.506490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-66f07143-fdff-41bd-baf6-c47b0b137b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:01.518987 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f07143-fdff-41bd-baf6-c47b0b137b65 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:01.524092 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:01.524944 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:01.525227 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:01.525502 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] PATH_INFO: `/v3/projects/7f8c03152ffc421c9868941bde3d31de` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:01.526747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f8c03152ffc421c9868941bde3d31de)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:01.528677 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:01.575149 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f8c03152ffc421c9868941bde3d31de', 'request_id': 'req-0e92483e-4db7-4b07-9fa3-3369566bc38c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.582593 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f8c03152ffc421c9868941bde3d31de', 'request_id': 'req-0e92483e-4db7-4b07-9fa3-3369566bc38c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.588274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f8c03152ffc421c9868941bde3d31de', 'request_id': 'req-0e92483e-4db7-4b07-9fa3-3369566bc38c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.598957 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] The token cache is being invalidate because project 7f8c03152ffc421c9868941bde3d31de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:01.599244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.599864 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.601394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1331/2680] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:01 2021] DELETE /identity/v3/projects/7f8c03152ffc421c9868941bde3d31de => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:01.605286 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16998917-4536-4242-8b5c-954be0e8316e service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:01.614761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16998917-4536-4242-8b5c-954be0e8316e service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:01.673733 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80630-e9f3-4122-8562-1a815ead5b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:01.674598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80630-e9f3-4122-8562-1a815ead5b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:01.675045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80630-e9f3-4122-8562-1a815ead5b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:01.675409 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80630-e9f3-4122-8562-1a815ead5b21 admin admin] PATH_INFO: `/v3/users/46a1e13dc9c048e2939e91a2f4b63fce` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:01.676672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af80630-e9f3-4122-8562-1a815ead5b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a1e13dc9c048e2939e91a2f4b63fce)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:01.678555 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af80630-e9f3-4122-8562-1a815ead5b21 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:01.727113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-1af80630-e9f3-4122-8562-1a815ead5b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a1e13dc9c048e2939e91a2f4b63fce'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.738273 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-1af80630-e9f3-4122-8562-1a815ead5b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a1e13dc9c048e2939e91a2f4b63fce'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.745480 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-1af80630-e9f3-4122-8562-1a815ead5b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a1e13dc9c048e2939e91a2f4b63fce'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.752880 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-1af80630-e9f3-4122-8562-1a815ead5b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a1e13dc9c048e2939e91a2f4b63fce'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.753535 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-1af80630-e9f3-4122-8562-1a815ead5b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a1e13dc9c048e2939e91a2f4b63fce'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:01.759289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1350/2681] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:01 2021] DELETE /identity/v3/users/46a1e13dc9c048e2939e91a2f4b63fce => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:02.028564 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:02.030023 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:02.050864 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92483e-4db7-4b07-9fa3-3369566bc38c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:02.107480 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f141c7-9e48-4d66-aa98-3e1544617598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:02.108339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f141c7-9e48-4d66-aa98-3e1544617598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.109125 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f141c7-9e48-4d66-aa98-3e1544617598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.109402 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f141c7-9e48-4d66-aa98-3e1544617598 admin admin] PATH_INFO: `/v3/projects/eb93747827d84e2eb20e07f24e579506` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.110604 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f141c7-9e48-4d66-aa98-3e1544617598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb93747827d84e2eb20e07f24e579506)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:02.112567 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f141c7-9e48-4d66-aa98-3e1544617598 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:02.156753 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-61f141c7-9e48-4d66-aa98-3e1544617598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb93747827d84e2eb20e07f24e579506', 'request_id': 'req-61f141c7-9e48-4d66-aa98-3e1544617598'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:02.164001 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-61f141c7-9e48-4d66-aa98-3e1544617598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb93747827d84e2eb20e07f24e579506', 'request_id': 'req-61f141c7-9e48-4d66-aa98-3e1544617598'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:02.169480 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-61f141c7-9e48-4d66-aa98-3e1544617598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb93747827d84e2eb20e07f24e579506', 'request_id': 'req-61f141c7-9e48-4d66-aa98-3e1544617598'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:02.180691 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-61f141c7-9e48-4d66-aa98-3e1544617598 admin admin] The token cache is being invalidate because project eb93747827d84e2eb20e07f24e579506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:02.180973 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-61f141c7-9e48-4d66-aa98-3e1544617598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:02.181586 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-61f141c7-9e48-4d66-aa98-3e1544617598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:02.183382 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1332/2682] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:02 2021] DELETE /identity/v3/projects/eb93747827d84e2eb20e07f24e579506 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:02.189821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277036a-3cf4-402c-bc40-acfe0ff12fae None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.190114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277036a-3cf4-402c-bc40-acfe0ff12fae None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.190392 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277036a-3cf4-402c-bc40-acfe0ff12fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.207956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b277036a-3cf4-402c-bc40-acfe0ff12fae None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:02.209135 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b277036a-3cf4-402c-bc40-acfe0ff12fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:02.265078 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1351/2683] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:02.273540 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff66ea6-fc4d-476d-ab3a-bc3cde29c432 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.273819 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff66ea6-fc4d-476d-ab3a-bc3cde29c432 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.274100 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff66ea6-fc4d-476d-ab3a-bc3cde29c432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.292398 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-aff66ea6-fc4d-476d-ab3a-bc3cde29c432 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:02.293579 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-aff66ea6-fc4d-476d-ab3a-bc3cde29c432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:02.301787 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1333/2684] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:02.305796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277036a-3cf4-402c-bc40-acfe0ff12fae None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:02.315136 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277036a-3cf4-402c-bc40-acfe0ff12fae None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:02.319750 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89b690-464b-4f1f-9c7e-5e8d8593a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:02.320415 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b690-464b-4f1f-9c7e-5e8d8593a92a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.320695 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b690-464b-4f1f-9c7e-5e8d8593a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.320968 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b690-464b-4f1f-9c7e-5e8d8593a92a admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.321693 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89b690-464b-4f1f-9c7e-5e8d8593a92a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:42:02.321997 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89b690-464b-4f1f-9c7e-5e8d8593a92a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:02.323616 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89b690-464b-4f1f-9c7e-5e8d8593a92a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:02.334829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1352/2685] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:42:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:42:02.339409 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff66ea6-fc4d-476d-ab3a-bc3cde29c432 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:02.350739 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff66ea6-fc4d-476d-ab3a-bc3cde29c432 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:02.355725 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db67168-ef31-4fe9-a61b-d218802a02c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:02.356378 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67168-ef31-4fe9-a61b-d218802a02c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.356664 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67168-ef31-4fe9-a61b-d218802a02c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.356943 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67168-ef31-4fe9-a61b-d218802a02c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.357660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db67168-ef31-4fe9-a61b-d218802a02c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:02.360249 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db67168-ef31-4fe9-a61b-d218802a02c4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:02.384795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1334/2686] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:42:02 2021] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:42:02.389004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89b690-464b-4f1f-9c7e-5e8d8593a92a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:02.398558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89b690-464b-4f1f-9c7e-5e8d8593a92a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:02.454803 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b0924-1aa4-465a-8068-acedaefcc26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:02.455532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b0924-1aa4-465a-8068-acedaefcc26b admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.455836 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b0924-1aa4-465a-8068-acedaefcc26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.456110 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b0924-1aa4-465a-8068-acedaefcc26b admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.456810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b0924-1aa4-465a-8068-acedaefcc26b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:02.458721 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b0924-1aa4-465a-8068-acedaefcc26b admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:02.478717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1353/2687] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:42:02 2021] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:02.482836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db67168-ef31-4fe9-a61b-d218802a02c4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:02.493608 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db67168-ef31-4fe9-a61b-d218802a02c4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:02.498258 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938f218-1234-4433-a074-6a46da3bde79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:02.498929 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938f218-1234-4433-a074-6a46da3bde79 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.499242 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938f218-1234-4433-a074-6a46da3bde79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.499521 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938f218-1234-4433-a074-6a46da3bde79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.500259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938f218-1234-4433-a074-6a46da3bde79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:02.501843 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938f218-1234-4433-a074-6a46da3bde79 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:02.512152 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1335/2688] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:02.515921 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b0924-1aa4-465a-8068-acedaefcc26b admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:02.525789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b0924-1aa4-465a-8068-acedaefcc26b admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:02.530327 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb67cf4-7275-44e2-a2b0-cf9313d14d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:02.531522 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb67cf4-7275-44e2-a2b0-cf9313d14d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.531807 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb67cf4-7275-44e2-a2b0-cf9313d14d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.532084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb67cf4-7275-44e2-a2b0-cf9313d14d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.532819 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb67cf4-7275-44e2-a2b0-cf9313d14d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:02.534397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb67cf4-7275-44e2-a2b0-cf9313d14d3c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:02.544523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1354/2689] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:02.549053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938f218-1234-4433-a074-6a46da3bde79 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:02.558789 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938f218-1234-4433-a074-6a46da3bde79 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:02.563441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66abeb6-3963-44e0-8e1a-6ee2f5b86a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:02.564302 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66abeb6-3963-44e0-8e1a-6ee2f5b86a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.564587 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66abeb6-3963-44e0-8e1a-6ee2f5b86a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.564864 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66abeb6-3963-44e0-8e1a-6ee2f5b86a33 admin admin] PATH_INFO: `/v3/projects/a687667052f6449ba564a5b251f8aeb8/users/6947533c48dd4d418c37de6cd2e3ba92/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.580360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66abeb6-3963-44e0-8e1a-6ee2f5b86a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a687667052f6449ba564a5b251f8aeb8, user_id=6947533c48dd4d418c37de6cd2e3ba92, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:02.583059 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66abeb6-3963-44e0-8e1a-6ee2f5b86a33 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:02.596167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1336/2690] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:02 2021] PUT /identity/v3/projects/a687667052f6449ba564a5b251f8aeb8/users/6947533c48dd4d418c37de6cd2e3ba92/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:42:02.606217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cadf70-80b8-4beb-b83d-bb4bc24aa524 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.606504 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cadf70-80b8-4beb-b83d-bb4bc24aa524 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.606786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cadf70-80b8-4beb-b83d-bb4bc24aa524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.632630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-60cadf70-80b8-4beb-b83d-bb4bc24aa524 None None] MFA Rules not processed for user `6947533c48dd4d418c37de6cd2e3ba92`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:02.633821 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-60cadf70-80b8-4beb-b83d-bb4bc24aa524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:02.701905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1355/2691] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:02 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:02.706892 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66abeb6-3963-44e0-8e1a-6ee2f5b86a33 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:02.766474 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66abeb6-3963-44e0-8e1a-6ee2f5b86a33 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:02.771143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce6f94-6e46-410e-add8-e3e627c0fad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:02.771797 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce6f94-6e46-410e-add8-e3e627c0fad4 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.772080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce6f94-6e46-410e-add8-e3e627c0fad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.772358 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce6f94-6e46-410e-add8-e3e627c0fad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.773067 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce6f94-6e46-410e-add8-e3e627c0fad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:02.774977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce6f94-6e46-410e-add8-e3e627c0fad4 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:02.799810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1337/2692] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:42:02 2021] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:42:02.803791 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cadf70-80b8-4beb-b83d-bb4bc24aa524 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:02.814178 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cadf70-80b8-4beb-b83d-bb4bc24aa524 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:02.868744 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8446099-d4ce-4dca-be4b-8243bef05134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:02.869394 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8446099-d4ce-4dca-be4b-8243bef05134 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.869672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8446099-d4ce-4dca-be4b-8243bef05134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.870065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8446099-d4ce-4dca-be4b-8243bef05134 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.870754 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8446099-d4ce-4dca-be4b-8243bef05134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:02.872666 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8446099-d4ce-4dca-be4b-8243bef05134 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:02.892342 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1356/2693] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:42:02 2021] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:42:02.896226 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce6f94-6e46-410e-add8-e3e627c0fad4 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:02.906683 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce6f94-6e46-410e-add8-e3e627c0fad4 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:02.911211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007af5ec-6ab6-4a8e-bc40-a774e3eff816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:02.911856 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af5ec-6ab6-4a8e-bc40-a774e3eff816 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.912135 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af5ec-6ab6-4a8e-bc40-a774e3eff816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.912407 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af5ec-6ab6-4a8e-bc40-a774e3eff816 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.913140 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007af5ec-6ab6-4a8e-bc40-a774e3eff816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:02.914724 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007af5ec-6ab6-4a8e-bc40-a774e3eff816 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:02.924983 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1338/2694] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:02.928653 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8446099-d4ce-4dca-be4b-8243bef05134 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:02.938726 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8446099-d4ce-4dca-be4b-8243bef05134 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:02.943288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20219e90-e117-4f3b-89d3-18c06baa9e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:02.943932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20219e90-e117-4f3b-89d3-18c06baa9e8c admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.944221 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20219e90-e117-4f3b-89d3-18c06baa9e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.944500 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20219e90-e117-4f3b-89d3-18c06baa9e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.945233 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20219e90-e117-4f3b-89d3-18c06baa9e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:02.946810 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20219e90-e117-4f3b-89d3-18c06baa9e8c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:02.957252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1357/2695] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:02.961244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007af5ec-6ab6-4a8e-bc40-a774e3eff816 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:02.971176 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007af5ec-6ab6-4a8e-bc40-a774e3eff816 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:02.975790 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047ec46-f9e5-4f95-90e9-6789a6d4980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:02.976670 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047ec46-f9e5-4f95-90e9-6789a6d4980a admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:02.976951 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047ec46-f9e5-4f95-90e9-6789a6d4980a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:02.977228 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047ec46-f9e5-4f95-90e9-6789a6d4980a admin admin] PATH_INFO: `/v3/projects/8a37bedb3ea04d44a812de111c0cf34a/users/ab1ea3b0ef824975b04251822c2a048a/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:02.991601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047ec46-f9e5-4f95-90e9-6789a6d4980a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a37bedb3ea04d44a812de111c0cf34a, user_id=ab1ea3b0ef824975b04251822c2a048a, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:02.994234 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047ec46-f9e5-4f95-90e9-6789a6d4980a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:03.007571 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1339/2696] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:02 2021] PUT /identity/v3/projects/8a37bedb3ea04d44a812de111c0cf34a/users/ab1ea3b0ef824975b04251822c2a048a/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:42:03.018305 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9eb0aa-a0e3-4943-87c8-a11c6fa7f290 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:03.018591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9eb0aa-a0e3-4943-87c8-a11c6fa7f290 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:03.018922 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9eb0aa-a0e3-4943-87c8-a11c6fa7f290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:03.044331 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-fd9eb0aa-a0e3-4943-87c8-a11c6fa7f290 None None] MFA Rules not processed for user `ab1ea3b0ef824975b04251822c2a048a`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:03.045508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-fd9eb0aa-a0e3-4943-87c8-a11c6fa7f290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:03.107677 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1358/2697] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:03 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:03.111992 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047ec46-f9e5-4f95-90e9-6789a6d4980a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:03.172277 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047ec46-f9e5-4f95-90e9-6789a6d4980a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:03.176965 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bd4c4-fc0b-40ac-80cf-054d73827e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:03.177613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bd4c4-fc0b-40ac-80cf-054d73827e63 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:03.177901 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bd4c4-fc0b-40ac-80cf-054d73827e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:03.178182 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bd4c4-fc0b-40ac-80cf-054d73827e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:03.178927 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bd4c4-fc0b-40ac-80cf-054d73827e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:03.180834 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bd4c4-fc0b-40ac-80cf-054d73827e63 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:03.206181 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1340/2698] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:42:03 2021] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:03.210123 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9eb0aa-a0e3-4943-87c8-a11c6fa7f290 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:03.220769 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9eb0aa-a0e3-4943-87c8-a11c6fa7f290 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:03.274343 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ede5f5-06dc-494c-a8d7-ce9b5cbe822d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:03.275042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ede5f5-06dc-494c-a8d7-ce9b5cbe822d admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:03.275454 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ede5f5-06dc-494c-a8d7-ce9b5cbe822d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:03.275661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ede5f5-06dc-494c-a8d7-ce9b5cbe822d admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:03.276298 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ede5f5-06dc-494c-a8d7-ce9b5cbe822d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:03.278192 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ede5f5-06dc-494c-a8d7-ce9b5cbe822d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:03.296506 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1359/2699] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:42:03 2021] POST /identity/v3/users => generated 296 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:03.300489 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bd4c4-fc0b-40ac-80cf-054d73827e63 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:03.310500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bd4c4-fc0b-40ac-80cf-054d73827e63 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:03.315891 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce1599-e7fd-4f1d-8fc4-ae107cd4455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:03.316539 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1599-e7fd-4f1d-8fc4-ae107cd4455a admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:03.316826 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1599-e7fd-4f1d-8fc4-ae107cd4455a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:03.317107 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1599-e7fd-4f1d-8fc4-ae107cd4455a admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:03.317855 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce1599-e7fd-4f1d-8fc4-ae107cd4455a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:03.319484 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce1599-e7fd-4f1d-8fc4-ae107cd4455a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:03.330003 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1341/2700] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:03.333819 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ede5f5-06dc-494c-a8d7-ce9b5cbe822d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:03.343570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ede5f5-06dc-494c-a8d7-ce9b5cbe822d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:03.348100 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc4429-8728-4112-b189-8249500228a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:03.348952 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc4429-8728-4112-b189-8249500228a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:03.349226 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc4429-8728-4112-b189-8249500228a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:03.349508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc4429-8728-4112-b189-8249500228a8 admin admin] PATH_INFO: `/v3/projects/0561c8a5ca6b41d58b7171d2da2cf7b7/users/bfbe4e1c34d142ea90807bcd36494cc0/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:03.364492 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc4429-8728-4112-b189-8249500228a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0561c8a5ca6b41d58b7171d2da2cf7b7, user_id=bfbe4e1c34d142ea90807bcd36494cc0, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:03.367113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc4429-8728-4112-b189-8249500228a8 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:03.380554 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1360/2701] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:03 2021] PUT /identity/v3/projects/0561c8a5ca6b41d58b7171d2da2cf7b7/users/bfbe4e1c34d142ea90807bcd36494cc0/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:42:03.384460 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce1599-e7fd-4f1d-8fc4-ae107cd4455a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:03.394497 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce1599-e7fd-4f1d-8fc4-ae107cd4455a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:03.448284 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84321c-f5c8-49c4-8bd9-3e6da8841d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:03.448964 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84321c-f5c8-49c4-8bd9-3e6da8841d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:03.449249 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84321c-f5c8-49c4-8bd9-3e6da8841d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:03.449524 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84321c-f5c8-49c4-8bd9-3e6da8841d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:03.450256 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84321c-f5c8-49c4-8bd9-3e6da8841d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:03.451889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84321c-f5c8-49c4-8bd9-3e6da8841d77 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:03.461295 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1342/2702] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:03 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:03.465805 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc4429-8728-4112-b189-8249500228a8 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:03.475783 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc4429-8728-4112-b189-8249500228a8 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:03.480303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314da77c-9532-4b66-9eda-b59704412067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:03.481164 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da77c-9532-4b66-9eda-b59704412067 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:03.481439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da77c-9532-4b66-9eda-b59704412067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:03.481712 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da77c-9532-4b66-9eda-b59704412067 admin admin] PATH_INFO: `/v3/projects/0561c8a5ca6b41d58b7171d2da2cf7b7/users/bfbe4e1c34d142ea90807bcd36494cc0/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:03.484202 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314da77c-9532-4b66-9eda-b59704412067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0561c8a5ca6b41d58b7171d2da2cf7b7, user_id=bfbe4e1c34d142ea90807bcd36494cc0, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:03.486774 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314da77c-9532-4b66-9eda-b59704412067 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:03.496567 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1361/2703] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:03 2021] PUT /identity/v3/projects/0561c8a5ca6b41d58b7171d2da2cf7b7/users/bfbe4e1c34d142ea90807bcd36494cc0/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:03.507758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d8c75-10b4-4ff1-a836-a8c078b1909a None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:03.508049 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d8c75-10b4-4ff1-a836-a8c078b1909a None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:03.508327 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d8c75-10b4-4ff1-a836-a8c078b1909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:03.533844 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-f34d8c75-10b4-4ff1-a836-a8c078b1909a None None] MFA Rules not processed for user `bfbe4e1c34d142ea90807bcd36494cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:03.535068 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f34d8c75-10b4-4ff1-a836-a8c078b1909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:03.599158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1343/2704] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:03 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:03.610076 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314da77c-9532-4b66-9eda-b59704412067 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:03.611814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-314da77c-9532-4b66-9eda-b59704412067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:03.670235 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314da77c-9532-4b66-9eda-b59704412067 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:03.674315 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f24139-b9ba-40f2-ae0a-070d4c4d5354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:03.674985 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24139-b9ba-40f2-ae0a-070d4c4d5354 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:03.675268 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24139-b9ba-40f2-ae0a-070d4c4d5354 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:03.675543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24139-b9ba-40f2-ae0a-070d4c4d5354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:03.684528 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f24139-b9ba-40f2-ae0a-070d4c4d5354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:03.685939 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f24139-b9ba-40f2-ae0a-070d4c4d5354 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:03.695788 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1362/2705] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:03 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:03.739176 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d8c75-10b4-4ff1-a836-a8c078b1909a None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:03.740586 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f34d8c75-10b4-4ff1-a836-a8c078b1909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:03.752340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d8c75-10b4-4ff1-a836-a8c078b1909a None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:03.756002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cc2a4-28c9-43b3-863e-e015330acf4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:03.756633 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cc2a4-28c9-43b3-863e-e015330acf4b service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:03.756918 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cc2a4-28c9-43b3-863e-e015330acf4b service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:03.757199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cc2a4-28c9-43b3-863e-e015330acf4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:03.811490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271cc2a4-28c9-43b3-863e-e015330acf4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:03.813674 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271cc2a4-28c9-43b3-863e-e015330acf4b service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:03.823656 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1344/2706] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:03 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:06.616375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f24139-b9ba-40f2-ae0a-070d4c4d5354 service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:06.679114 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f24139-b9ba-40f2-ae0a-070d4c4d5354 service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:06.683667 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb5104-0887-469c-a036-d924a47d2837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:06.684534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb5104-0887-469c-a036-d924a47d2837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:06.684824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb5104-0887-469c-a036-d924a47d2837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:06.685105 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb5104-0887-469c-a036-d924a47d2837 admin admin] PATH_INFO: `/v3/users/6947533c48dd4d418c37de6cd2e3ba92` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:06.686308 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb5104-0887-469c-a036-d924a47d2837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6947533c48dd4d418c37de6cd2e3ba92)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:06.688752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb5104-0887-469c-a036-d924a47d2837 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:06.732979 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c2bb5104-0887-469c-a036-d924a47d2837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6947533c48dd4d418c37de6cd2e3ba92'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:06.744380 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c2bb5104-0887-469c-a036-d924a47d2837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6947533c48dd4d418c37de6cd2e3ba92'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:06.751441 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c2bb5104-0887-469c-a036-d924a47d2837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6947533c48dd4d418c37de6cd2e3ba92'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:06.758023 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c2bb5104-0887-469c-a036-d924a47d2837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6947533c48dd4d418c37de6cd2e3ba92'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:06.758642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c2bb5104-0887-469c-a036-d924a47d2837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6947533c48dd4d418c37de6cd2e3ba92'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:06.764359 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1363/2707] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:06 2021] DELETE /identity/v3/users/6947533c48dd4d418c37de6cd2e3ba92 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:06.769494 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f1bb1-6731-439d-82ee-c3fbd0831aa6 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:06.769984 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f1bb1-6731-439d-82ee-c3fbd0831aa6 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:06.770099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f1bb1-6731-439d-82ee-c3fbd0831aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:06.787202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-e02f1bb1-6731-439d-82ee-c3fbd0831aa6 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:06.788315 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e02f1bb1-6731-439d-82ee-c3fbd0831aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:06.851463 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1345/2708] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:42:06.861076 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb5104-0887-469c-a036-d924a47d2837 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:06.862454 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c2bb5104-0887-469c-a036-d924a47d2837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:06.917814 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb5104-0887-469c-a036-d924a47d2837 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:06.921514 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac347041-38ab-4436-94ea-13e749dc9aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:06.922154 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac347041-38ab-4436-94ea-13e749dc9aab service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:06.922436 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac347041-38ab-4436-94ea-13e749dc9aab service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:06.922743 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac347041-38ab-4436-94ea-13e749dc9aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:06.931776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac347041-38ab-4436-94ea-13e749dc9aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:06.933229 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac347041-38ab-4436-94ea-13e749dc9aab service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:06.944167 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1364/2709] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:07.200766 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f1bb1-6731-439d-82ee-c3fbd0831aa6 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:07.202225 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e02f1bb1-6731-439d-82ee-c3fbd0831aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:07.214587 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f1bb1-6731-439d-82ee-c3fbd0831aa6 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:07.219332 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:07.220217 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:07.220509 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:07.220789 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] PATH_INFO: `/v3/projects/a687667052f6449ba564a5b251f8aeb8` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:07.222012 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a687667052f6449ba564a5b251f8aeb8)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:07.224061 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:07.269755 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a687667052f6449ba564a5b251f8aeb8', 'request_id': 'req-4399b950-2ff2-4096-adba-8a0c535f1cad'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.277013 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a687667052f6449ba564a5b251f8aeb8', 'request_id': 'req-4399b950-2ff2-4096-adba-8a0c535f1cad'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.282463 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a687667052f6449ba564a5b251f8aeb8', 'request_id': 'req-4399b950-2ff2-4096-adba-8a0c535f1cad'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.293189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] The token cache is being invalidate because project a687667052f6449ba564a5b251f8aeb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:07.293420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.294047 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.295795 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1346/2710] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:07 2021] DELETE /identity/v3/projects/a687667052f6449ba564a5b251f8aeb8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:07.300233 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac347041-38ab-4436-94ea-13e749dc9aab service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:07.309560 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac347041-38ab-4436-94ea-13e749dc9aab service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:07.363487 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd95c6-4abe-42dd-95c6-37a89380b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:07.364349 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd95c6-4abe-42dd-95c6-37a89380b776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:07.364636 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd95c6-4abe-42dd-95c6-37a89380b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:07.364916 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd95c6-4abe-42dd-95c6-37a89380b776 admin admin] PATH_INFO: `/v3/users/ab1ea3b0ef824975b04251822c2a048a` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:07.366121 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd95c6-4abe-42dd-95c6-37a89380b776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1ea3b0ef824975b04251822c2a048a)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:07.368048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd95c6-4abe-42dd-95c6-37a89380b776 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:07.410532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-75cd95c6-4abe-42dd-95c6-37a89380b776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1ea3b0ef824975b04251822c2a048a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.422402 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-75cd95c6-4abe-42dd-95c6-37a89380b776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1ea3b0ef824975b04251822c2a048a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.430321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-75cd95c6-4abe-42dd-95c6-37a89380b776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1ea3b0ef824975b04251822c2a048a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.437657 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-75cd95c6-4abe-42dd-95c6-37a89380b776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1ea3b0ef824975b04251822c2a048a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.438272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-75cd95c6-4abe-42dd-95c6-37a89380b776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1ea3b0ef824975b04251822c2a048a'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.443954 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1365/2711] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:07 2021] DELETE /identity/v3/users/ab1ea3b0ef824975b04251822c2a048a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:07.699687 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:07.701121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:07.719049 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399b950-2ff2-4096-adba-8a0c535f1cad admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:07.774753 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:07.775853 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:07.775988 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:07.776171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] PATH_INFO: `/v3/projects/8a37bedb3ea04d44a812de111c0cf34a` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:07.777341 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a37bedb3ea04d44a812de111c0cf34a)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:07.779261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:07.823336 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a37bedb3ea04d44a812de111c0cf34a', 'request_id': 'req-a3f2ea25-806b-44ad-8d73-28c8d323ec21'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.831001 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a37bedb3ea04d44a812de111c0cf34a', 'request_id': 'req-a3f2ea25-806b-44ad-8d73-28c8d323ec21'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.836167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a37bedb3ea04d44a812de111c0cf34a', 'request_id': 'req-a3f2ea25-806b-44ad-8d73-28c8d323ec21'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.847416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] The token cache is being invalidate because project 8a37bedb3ea04d44a812de111c0cf34a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:07.847705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.848331 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.849830 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1347/2712] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:07 2021] DELETE /identity/v3/projects/8a37bedb3ea04d44a812de111c0cf34a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:07.853843 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd95c6-4abe-42dd-95c6-37a89380b776 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:07.855364 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-75cd95c6-4abe-42dd-95c6-37a89380b776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:07.867789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd95c6-4abe-42dd-95c6-37a89380b776 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:07.923717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee7eef-d527-4abc-ae07-8aea3b3c0178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:07.924578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee7eef-d527-4abc-ae07-8aea3b3c0178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:07.924860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee7eef-d527-4abc-ae07-8aea3b3c0178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:07.925137 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee7eef-d527-4abc-ae07-8aea3b3c0178 admin admin] PATH_INFO: `/v3/users/bfbe4e1c34d142ea90807bcd36494cc0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:07.926308 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee7eef-d527-4abc-ae07-8aea3b3c0178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfbe4e1c34d142ea90807bcd36494cc0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:07.928223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee7eef-d527-4abc-ae07-8aea3b3c0178 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:07.976366 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-58ee7eef-d527-4abc-ae07-8aea3b3c0178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfbe4e1c34d142ea90807bcd36494cc0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.987944 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-58ee7eef-d527-4abc-ae07-8aea3b3c0178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfbe4e1c34d142ea90807bcd36494cc0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:07.995071 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-58ee7eef-d527-4abc-ae07-8aea3b3c0178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfbe4e1c34d142ea90807bcd36494cc0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:08.001818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-58ee7eef-d527-4abc-ae07-8aea3b3c0178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfbe4e1c34d142ea90807bcd36494cc0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:08.002450 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-58ee7eef-d527-4abc-ae07-8aea3b3c0178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfbe4e1c34d142ea90807bcd36494cc0'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:08.008241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1366/2713] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:07 2021] DELETE /identity/v3/users/bfbe4e1c34d142ea90807bcd36494cc0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:08.261636 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:08.263121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:08.276263 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2ea25-806b-44ad-8d73-28c8d323ec21 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:08.332259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c650f-2071-4744-9c11-89b0ff12b946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:08.333154 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c650f-2071-4744-9c11-89b0ff12b946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:08.333433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c650f-2071-4744-9c11-89b0ff12b946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:08.333705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c650f-2071-4744-9c11-89b0ff12b946 admin admin] PATH_INFO: `/v3/projects/0561c8a5ca6b41d58b7171d2da2cf7b7` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:08.334906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c650f-2071-4744-9c11-89b0ff12b946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0561c8a5ca6b41d58b7171d2da2cf7b7)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:08.336845 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c650f-2071-4744-9c11-89b0ff12b946 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:08.381189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2d9c650f-2071-4744-9c11-89b0ff12b946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0561c8a5ca6b41d58b7171d2da2cf7b7', 'request_id': 'req-2d9c650f-2071-4744-9c11-89b0ff12b946'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:08.388735 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2d9c650f-2071-4744-9c11-89b0ff12b946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0561c8a5ca6b41d58b7171d2da2cf7b7', 'request_id': 'req-2d9c650f-2071-4744-9c11-89b0ff12b946'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:08.395123 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2d9c650f-2071-4744-9c11-89b0ff12b946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0561c8a5ca6b41d58b7171d2da2cf7b7', 'request_id': 'req-2d9c650f-2071-4744-9c11-89b0ff12b946'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:08.405964 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2d9c650f-2071-4744-9c11-89b0ff12b946 admin admin] The token cache is being invalidate because project 0561c8a5ca6b41d58b7171d2da2cf7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:08.406244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2d9c650f-2071-4744-9c11-89b0ff12b946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:08.406894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-2d9c650f-2071-4744-9c11-89b0ff12b946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:08.408420 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1348/2714] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:08 2021] DELETE /identity/v3/projects/0561c8a5ca6b41d58b7171d2da2cf7b7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:08.415146 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e9bc-b0de-4628-bb37-9df15a445231 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:08.415438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e9bc-b0de-4628-bb37-9df15a445231 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:08.415720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e9bc-b0de-4628-bb37-9df15a445231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:08.433558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-0584e9bc-b0de-4628-bb37-9df15a445231 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:08.434761 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-0584e9bc-b0de-4628-bb37-9df15a445231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:08.494296 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1367/2715] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:08.503359 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ab914-174b-44e0-b34d-91c9abab8ceb None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:08.503654 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ab914-174b-44e0-b34d-91c9abab8ceb None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:08.503937 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ab914-174b-44e0-b34d-91c9abab8ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:08.522286 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-162ab914-174b-44e0-b34d-91c9abab8ceb None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:08.523583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-162ab914-174b-44e0-b34d-91c9abab8ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:08.531395 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1349/2716] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:08.535379 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584e9bc-b0de-4628-bb37-9df15a445231 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:08.544953 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584e9bc-b0de-4628-bb37-9df15a445231 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:08.550045 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b7c5-9d55-4658-b7bc-44a25b7df05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:08.550703 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b7c5-9d55-4658-b7bc-44a25b7df05d admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:08.551044 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b7c5-9d55-4658-b7bc-44a25b7df05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:08.551329 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b7c5-9d55-4658-b7bc-44a25b7df05d admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:08.552097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3b7c5-9d55-4658-b7bc-44a25b7df05d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:42:08.552410 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3b7c5-9d55-4658-b7bc-44a25b7df05d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:08.553996 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3b7c5-9d55-4658-b7bc-44a25b7df05d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:08.566105 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1368/2717] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:42:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:42:08.570376 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ab914-174b-44e0-b34d-91c9abab8ceb None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:08.579441 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ab914-174b-44e0-b34d-91c9abab8ceb None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:08.584144 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f5e63-bc51-495e-ae75-f24838e8bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:08.584785 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f5e63-bc51-495e-ae75-f24838e8bb11 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:08.585072 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f5e63-bc51-495e-ae75-f24838e8bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:08.585353 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f5e63-bc51-495e-ae75-f24838e8bb11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:08.586063 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f5e63-bc51-495e-ae75-f24838e8bb11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:08.588266 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f5e63-bc51-495e-ae75-f24838e8bb11 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:08.613058 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1350/2718] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:42:08 2021] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:42:08.617014 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b7c5-9d55-4658-b7bc-44a25b7df05d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:08.627159 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b7c5-9d55-4658-b7bc-44a25b7df05d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:08.680988 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64986c-7a86-4015-8440-2e9a04b681e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:08.681583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64986c-7a86-4015-8440-2e9a04b681e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:08.681871 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64986c-7a86-4015-8440-2e9a04b681e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:08.682156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64986c-7a86-4015-8440-2e9a04b681e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:08.683113 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64986c-7a86-4015-8440-2e9a04b681e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:08.685136 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64986c-7a86-4015-8440-2e9a04b681e1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:08.704553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1369/2719] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:42:08 2021] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:42:08.708653 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f5e63-bc51-495e-ae75-f24838e8bb11 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:08.718921 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f5e63-bc51-495e-ae75-f24838e8bb11 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:08.723548 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564419f-05af-49d5-9c7d-533a920a5e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:08.724197 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564419f-05af-49d5-9c7d-533a920a5e3e admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:08.724483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564419f-05af-49d5-9c7d-533a920a5e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:08.724765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564419f-05af-49d5-9c7d-533a920a5e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:08.725507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564419f-05af-49d5-9c7d-533a920a5e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:08.727198 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564419f-05af-49d5-9c7d-533a920a5e3e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:08.737959 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1351/2720] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:08.741838 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64986c-7a86-4015-8440-2e9a04b681e1 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:08.751967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64986c-7a86-4015-8440-2e9a04b681e1 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:08.756610 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbfeed-22ba-48a8-8a34-1fbb0ea2d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:08.757258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbfeed-22ba-48a8-8a34-1fbb0ea2d942 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:08.757548 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbfeed-22ba-48a8-8a34-1fbb0ea2d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:08.757833 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbfeed-22ba-48a8-8a34-1fbb0ea2d942 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:08.758566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbfeed-22ba-48a8-8a34-1fbb0ea2d942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:08.760176 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbfeed-22ba-48a8-8a34-1fbb0ea2d942 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:08.769809 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1370/2721] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:08 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:42:08.773715 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564419f-05af-49d5-9c7d-533a920a5e3e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:08.783688 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564419f-05af-49d5-9c7d-533a920a5e3e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:08.788407 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e0816-d954-4d9b-868d-1ae1a869cdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:08.789299 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e0816-d954-4d9b-868d-1ae1a869cdf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:08.789587 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e0816-d954-4d9b-868d-1ae1a869cdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:08.789869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e0816-d954-4d9b-868d-1ae1a869cdf8 admin admin] PATH_INFO: `/v3/projects/67ee1022b3414b518160effc26a9fe48/users/10b31db4c531436fb05f3580184632fd/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:08.805046 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e0816-d954-4d9b-868d-1ae1a869cdf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ee1022b3414b518160effc26a9fe48, user_id=10b31db4c531436fb05f3580184632fd, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:08.807747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e0816-d954-4d9b-868d-1ae1a869cdf8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:08.820719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1352/2722] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:08 2021] PUT /identity/v3/projects/67ee1022b3414b518160effc26a9fe48/users/10b31db4c531436fb05f3580184632fd/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:08.833367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036023a1-c036-4594-bb11-8491586f21f1 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:08.833664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036023a1-c036-4594-bb11-8491586f21f1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:08.833959 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036023a1-c036-4594-bb11-8491586f21f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:08.860464 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-036023a1-c036-4594-bb11-8491586f21f1 None None] MFA Rules not processed for user `10b31db4c531436fb05f3580184632fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:08.861672 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-036023a1-c036-4594-bb11-8491586f21f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:08.923972 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1371/2723] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:08 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:08.928026 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e0816-d954-4d9b-868d-1ae1a869cdf8 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:08.989204 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e0816-d954-4d9b-868d-1ae1a869cdf8 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:08.993836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd20db-504c-40a9-a207-885412cc58cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:08.994486 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd20db-504c-40a9-a207-885412cc58cd admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:08.994769 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd20db-504c-40a9-a207-885412cc58cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:08.995080 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd20db-504c-40a9-a207-885412cc58cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:08.995817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd20db-504c-40a9-a207-885412cc58cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:08.997720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd20db-504c-40a9-a207-885412cc58cd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:09.021727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1353/2724] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:42:08 2021] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:09.025711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036023a1-c036-4594-bb11-8491586f21f1 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:09.036664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036023a1-c036-4594-bb11-8491586f21f1 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:09.090254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b2c91-f9c8-4f71-853b-0078ffdafd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:09.090962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b2c91-f9c8-4f71-853b-0078ffdafd75 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:09.091256 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b2c91-f9c8-4f71-853b-0078ffdafd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:09.091751 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b2c91-f9c8-4f71-853b-0078ffdafd75 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:09.092546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b2c91-f9c8-4f71-853b-0078ffdafd75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:09.094990 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b2c91-f9c8-4f71-853b-0078ffdafd75 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:09.116223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1372/2725] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:42:09 2021] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:09.120164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd20db-504c-40a9-a207-885412cc58cd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:09.130466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd20db-504c-40a9-a207-885412cc58cd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:09.135514 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97d80d-3b0d-43bf-ba9f-29200cad86f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:09.136171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97d80d-3b0d-43bf-ba9f-29200cad86f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:09.136456 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97d80d-3b0d-43bf-ba9f-29200cad86f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:09.136774 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97d80d-3b0d-43bf-ba9f-29200cad86f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:09.137518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97d80d-3b0d-43bf-ba9f-29200cad86f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:09.139158 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97d80d-3b0d-43bf-ba9f-29200cad86f5 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:09.149703 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1354/2726] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:09.153813 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b2c91-f9c8-4f71-853b-0078ffdafd75 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:09.164340 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b2c91-f9c8-4f71-853b-0078ffdafd75 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:09.169184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591841e6-a084-4ddd-89c0-cd56e53b2851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:09.170043 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591841e6-a084-4ddd-89c0-cd56e53b2851 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:09.170323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591841e6-a084-4ddd-89c0-cd56e53b2851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:09.170598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591841e6-a084-4ddd-89c0-cd56e53b2851 admin admin] PATH_INFO: `/v3/projects/beac85f8aea34a99958e634761c3e0ce/users/b4a16c652ba4429e9bd2d49fa87d89aa/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:09.185866 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591841e6-a084-4ddd-89c0-cd56e53b2851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beac85f8aea34a99958e634761c3e0ce, user_id=b4a16c652ba4429e9bd2d49fa87d89aa, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:09.188523 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591841e6-a084-4ddd-89c0-cd56e53b2851 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:09.200718 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1373/2727] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:09 2021] PUT /identity/v3/projects/beac85f8aea34a99958e634761c3e0ce/users/b4a16c652ba4429e9bd2d49fa87d89aa/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:09.204508 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97d80d-3b0d-43bf-ba9f-29200cad86f5 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:09.214405 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97d80d-3b0d-43bf-ba9f-29200cad86f5 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:09.269037 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed13b9-c499-4c07-bad4-f0ef73ac66e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:09.269821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed13b9-c499-4c07-bad4-f0ef73ac66e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:09.270112 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed13b9-c499-4c07-bad4-f0ef73ac66e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:09.270394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed13b9-c499-4c07-bad4-f0ef73ac66e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:09.271185 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed13b9-c499-4c07-bad4-f0ef73ac66e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:09.272783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed13b9-c499-4c07-bad4-f0ef73ac66e1 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:09.282798 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1355/2728] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:09 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:09.286815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591841e6-a084-4ddd-89c0-cd56e53b2851 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:09.297516 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591841e6-a084-4ddd-89c0-cd56e53b2851 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:09.302071 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31ee3f-ca05-4ca1-bc7e-c60d0e8dcc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:09.302995 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31ee3f-ca05-4ca1-bc7e-c60d0e8dcc14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:09.303279 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31ee3f-ca05-4ca1-bc7e-c60d0e8dcc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:09.303562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31ee3f-ca05-4ca1-bc7e-c60d0e8dcc14 admin admin] PATH_INFO: `/v3/projects/beac85f8aea34a99958e634761c3e0ce/users/b4a16c652ba4429e9bd2d49fa87d89aa/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:09.305536 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31ee3f-ca05-4ca1-bc7e-c60d0e8dcc14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beac85f8aea34a99958e634761c3e0ce, user_id=b4a16c652ba4429e9bd2d49fa87d89aa, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:09.308181 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31ee3f-ca05-4ca1-bc7e-c60d0e8dcc14 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:09.318138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1374/2729] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:09 2021] PUT /identity/v3/projects/beac85f8aea34a99958e634761c3e0ce/users/b4a16c652ba4429e9bd2d49fa87d89aa/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:09.328359 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeeb942-755f-464b-b2e7-da95280e17dc None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:09.328645 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeeb942-755f-464b-b2e7-da95280e17dc None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:09.328927 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeeb942-755f-464b-b2e7-da95280e17dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:09.354985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-cdeeb942-755f-464b-b2e7-da95280e17dc None None] MFA Rules not processed for user `b4a16c652ba4429e9bd2d49fa87d89aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:09.356175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-cdeeb942-755f-464b-b2e7-da95280e17dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:09.421166 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1356/2730] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:09 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:09.431833 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31ee3f-ca05-4ca1-bc7e-c60d0e8dcc14 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:09.433557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-ca31ee3f-ca05-4ca1-bc7e-c60d0e8dcc14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:09.489402 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31ee3f-ca05-4ca1-bc7e-c60d0e8dcc14 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:09.493080 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ad5b1-0b87-4017-aa7a-da633ad4dff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:09.493718 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ad5b1-0b87-4017-aa7a-da633ad4dff2 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:09.494004 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ad5b1-0b87-4017-aa7a-da633ad4dff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:09.494282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ad5b1-0b87-4017-aa7a-da633ad4dff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:09.503084 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ad5b1-0b87-4017-aa7a-da633ad4dff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:09.504512 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ad5b1-0b87-4017-aa7a-da633ad4dff2 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:09.513930 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1375/2731] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:09 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:09.597752 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeeb942-755f-464b-b2e7-da95280e17dc None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:09.607130 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeeb942-755f-464b-b2e7-da95280e17dc None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:09.610708 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5389d-1e27-4df9-9289-bf03687e8958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:09.611435 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5389d-1e27-4df9-9289-bf03687e8958 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:09.611720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5389d-1e27-4df9-9289-bf03687e8958 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:09.611996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5389d-1e27-4df9-9289-bf03687e8958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:09.668205 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5389d-1e27-4df9-9289-bf03687e8958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:09.669747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5389d-1e27-4df9-9289-bf03687e8958 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:09.678726 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1357/2732] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:09 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:09.915396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ad5b1-0b87-4017-aa7a-da633ad4dff2 service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:09.978289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ad5b1-0b87-4017-aa7a-da633ad4dff2 service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:09.983195 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a208600-222b-4104-84e7-729154d92a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:09.983824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a208600-222b-4104-84e7-729154d92a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:09.984106 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a208600-222b-4104-84e7-729154d92a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:09.984376 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a208600-222b-4104-84e7-729154d92a1a admin admin] PATH_INFO: `/v3/users/10b31db4c531436fb05f3580184632fd` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:09.985562 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a208600-222b-4104-84e7-729154d92a1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b31db4c531436fb05f3580184632fd)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:09.987502 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a208600-222b-4104-84e7-729154d92a1a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:10.031093 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-0a208600-222b-4104-84e7-729154d92a1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b31db4c531436fb05f3580184632fd'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.041974 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-0a208600-222b-4104-84e7-729154d92a1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b31db4c531436fb05f3580184632fd'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.049387 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-0a208600-222b-4104-84e7-729154d92a1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b31db4c531436fb05f3580184632fd'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.056179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-0a208600-222b-4104-84e7-729154d92a1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b31db4c531436fb05f3580184632fd'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.056801 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-0a208600-222b-4104-84e7-729154d92a1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b31db4c531436fb05f3580184632fd'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.063097 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1376/2733] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:09 2021] DELETE /identity/v3/users/10b31db4c531436fb05f3580184632fd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:10.067513 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922e8a0-e32a-4e05-ba64-66ef81913a77 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:10.067993 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922e8a0-e32a-4e05-ba64-66ef81913a77 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:10.068166 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922e8a0-e32a-4e05-ba64-66ef81913a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:10.084712 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-7922e8a0-e32a-4e05-ba64-66ef81913a77 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:10.085895 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-7922e8a0-e32a-4e05-ba64-66ef81913a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:10.141484 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1358/2734] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:10.151349 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a208600-222b-4104-84e7-729154d92a1a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:10.152850 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-0a208600-222b-4104-84e7-729154d92a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:10.208374 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a208600-222b-4104-84e7-729154d92a1a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:10.212608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5bab7-d314-45c1-8998-192756133a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:10.213309 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5bab7-d314-45c1-8998-192756133a78 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:10.213594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5bab7-d314-45c1-8998-192756133a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:10.213874 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5bab7-d314-45c1-8998-192756133a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:10.222937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5bab7-d314-45c1-8998-192756133a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:10.224363 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5bab7-d314-45c1-8998-192756133a78 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:10.234278 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1377/2735] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:10.488393 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922e8a0-e32a-4e05-ba64-66ef81913a77 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:10.489811 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-7922e8a0-e32a-4e05-ba64-66ef81913a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:10.503301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922e8a0-e32a-4e05-ba64-66ef81913a77 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:10.508719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:10.509583 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:10.509917 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:10.510139 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] PATH_INFO: `/v3/projects/67ee1022b3414b518160effc26a9fe48` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:10.511401 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ee1022b3414b518160effc26a9fe48)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:10.513335 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:10.558780 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ee1022b3414b518160effc26a9fe48', 'request_id': 'req-e7ab5206-bb88-4887-9206-0037ff59d325'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.566004 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ee1022b3414b518160effc26a9fe48', 'request_id': 'req-e7ab5206-bb88-4887-9206-0037ff59d325'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.571734 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ee1022b3414b518160effc26a9fe48', 'request_id': 'req-e7ab5206-bb88-4887-9206-0037ff59d325'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.583052 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] The token cache is being invalidate because project 67ee1022b3414b518160effc26a9fe48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:10.583346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.584006 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.585546 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1359/2736] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:10 2021] DELETE /identity/v3/projects/67ee1022b3414b518160effc26a9fe48 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:10.589826 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5bab7-d314-45c1-8998-192756133a78 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:10.599692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5bab7-d314-45c1-8998-192756133a78 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:10.654185 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e20fe-c26f-436d-bc27-5d8f5d3be295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:10.655076 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e20fe-c26f-436d-bc27-5d8f5d3be295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:10.655365 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e20fe-c26f-436d-bc27-5d8f5d3be295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:10.655646 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e20fe-c26f-436d-bc27-5d8f5d3be295 admin admin] PATH_INFO: `/v3/users/b4a16c652ba4429e9bd2d49fa87d89aa` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:10.657493 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e20fe-c26f-436d-bc27-5d8f5d3be295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a16c652ba4429e9bd2d49fa87d89aa)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:10.659449 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e20fe-c26f-436d-bc27-5d8f5d3be295 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:10.704557 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-860e20fe-c26f-436d-bc27-5d8f5d3be295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a16c652ba4429e9bd2d49fa87d89aa'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.716024 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-860e20fe-c26f-436d-bc27-5d8f5d3be295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a16c652ba4429e9bd2d49fa87d89aa'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.723397 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-860e20fe-c26f-436d-bc27-5d8f5d3be295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a16c652ba4429e9bd2d49fa87d89aa'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.730001 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-860e20fe-c26f-436d-bc27-5d8f5d3be295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a16c652ba4429e9bd2d49fa87d89aa'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.730634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-860e20fe-c26f-436d-bc27-5d8f5d3be295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a16c652ba4429e9bd2d49fa87d89aa'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:10.737010 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1378/2737] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:10 2021] DELETE /identity/v3/users/b4a16c652ba4429e9bd2d49fa87d89aa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:11.007538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:11.009130 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:11.021756 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab5206-bb88-4887-9206-0037ff59d325 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:11.081740 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d0b8b-64c8-4091-b1f3-df27b582df1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:11.082599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d0b8b-64c8-4091-b1f3-df27b582df1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:11.082901 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d0b8b-64c8-4091-b1f3-df27b582df1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:11.083177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d0b8b-64c8-4091-b1f3-df27b582df1c admin admin] PATH_INFO: `/v3/projects/beac85f8aea34a99958e634761c3e0ce` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:11.084360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d0b8b-64c8-4091-b1f3-df27b582df1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=beac85f8aea34a99958e634761c3e0ce)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:11.086247 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d0b8b-64c8-4091-b1f3-df27b582df1c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:11.133132 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d43d0b8b-64c8-4091-b1f3-df27b582df1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beac85f8aea34a99958e634761c3e0ce', 'request_id': 'req-d43d0b8b-64c8-4091-b1f3-df27b582df1c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:11.140401 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d43d0b8b-64c8-4091-b1f3-df27b582df1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beac85f8aea34a99958e634761c3e0ce', 'request_id': 'req-d43d0b8b-64c8-4091-b1f3-df27b582df1c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:11.147918 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d43d0b8b-64c8-4091-b1f3-df27b582df1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beac85f8aea34a99958e634761c3e0ce', 'request_id': 'req-d43d0b8b-64c8-4091-b1f3-df27b582df1c'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:11.159553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d43d0b8b-64c8-4091-b1f3-df27b582df1c admin admin] The token cache is being invalidate because project beac85f8aea34a99958e634761c3e0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:11.159853 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d43d0b8b-64c8-4091-b1f3-df27b582df1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:11.160500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-d43d0b8b-64c8-4091-b1f3-df27b582df1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:11.162223 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1360/2738] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:11 2021] DELETE /identity/v3/projects/beac85f8aea34a99958e634761c3e0ce => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:11.168115 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd027dd-69b0-46ec-a4ba-ac02cf23b9a1 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:11.168634 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd027dd-69b0-46ec-a4ba-ac02cf23b9a1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:11.168878 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd027dd-69b0-46ec-a4ba-ac02cf23b9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:11.187896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-2bd027dd-69b0-46ec-a4ba-ac02cf23b9a1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:11.189248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2bd027dd-69b0-46ec-a4ba-ac02cf23b9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:11.248054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1379/2739] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:11.256108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f53748-8098-47e4-8dbd-c49572cd8694 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:11.256401 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f53748-8098-47e4-8dbd-c49572cd8694 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:11.256683 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f53748-8098-47e4-8dbd-c49572cd8694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:11.274935 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-25f53748-8098-47e4-8dbd-c49572cd8694 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:11.276128 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-25f53748-8098-47e4-8dbd-c49572cd8694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:11.284490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1361/2740] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:11.288803 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd027dd-69b0-46ec-a4ba-ac02cf23b9a1 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:11.302154 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd027dd-69b0-46ec-a4ba-ac02cf23b9a1 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:11.308228 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769b98d-b317-45cd-ae81-640cf759d1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:11.309258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769b98d-b317-45cd-ae81-640cf759d1df admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:11.309723 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769b98d-b317-45cd-ae81-640cf759d1df admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:11.310175 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769b98d-b317-45cd-ae81-640cf759d1df admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:11.311458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769b98d-b317-45cd-ae81-640cf759d1df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:42:11.312125 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769b98d-b317-45cd-ae81-640cf759d1df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:11.314695 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769b98d-b317-45cd-ae81-640cf759d1df admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:11.337569 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1380/2741] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:42:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:42:11.338713 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f53748-8098-47e4-8dbd-c49572cd8694 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:11.348434 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f53748-8098-47e4-8dbd-c49572cd8694 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:11.353172 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ac2d4-5243-479c-bdf0-066eb4039e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:11.353810 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac2d4-5243-479c-bdf0-066eb4039e2d admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:11.354093 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac2d4-5243-479c-bdf0-066eb4039e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:11.354370 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac2d4-5243-479c-bdf0-066eb4039e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:11.355114 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ac2d4-5243-479c-bdf0-066eb4039e2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:11.357014 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ac2d4-5243-479c-bdf0-066eb4039e2d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:11.382377 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1362/2742] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:42:11 2021] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:42:11.386142 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769b98d-b317-45cd-ae81-640cf759d1df admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:11.395921 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769b98d-b317-45cd-ae81-640cf759d1df admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:11.448857 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f24c1-9071-44db-8993-88da76ba20cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:11.449505 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f24c1-9071-44db-8993-88da76ba20cd admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:11.449784 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f24c1-9071-44db-8993-88da76ba20cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:11.450144 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f24c1-9071-44db-8993-88da76ba20cd admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:11.450863 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f24c1-9071-44db-8993-88da76ba20cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:11.452837 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f24c1-9071-44db-8993-88da76ba20cd admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:11.475102 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1381/2743] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:42:11 2021] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:11.479134 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ac2d4-5243-479c-bdf0-066eb4039e2d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:11.489977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ac2d4-5243-479c-bdf0-066eb4039e2d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:11.494673 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09b562-3168-4191-a244-d2981aec59b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:11.495360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b562-3168-4191-a244-d2981aec59b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:11.495646 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b562-3168-4191-a244-d2981aec59b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:11.495956 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b562-3168-4191-a244-d2981aec59b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:11.496697 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09b562-3168-4191-a244-d2981aec59b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:11.498301 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09b562-3168-4191-a244-d2981aec59b2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:11.508543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1363/2744] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:11.512546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f24c1-9071-44db-8993-88da76ba20cd admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:11.522154 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f24c1-9071-44db-8993-88da76ba20cd admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:11.526727 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8c322-4c17-4620-aaf6-4d32757c330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:11.527407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8c322-4c17-4620-aaf6-4d32757c330e admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:11.527690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8c322-4c17-4620-aaf6-4d32757c330e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:11.527966 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8c322-4c17-4620-aaf6-4d32757c330e admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:11.528696 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8c322-4c17-4620-aaf6-4d32757c330e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:11.530267 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8c322-4c17-4620-aaf6-4d32757c330e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:11.543474 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1382/2745] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:11 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:11.544554 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09b562-3168-4191-a244-d2981aec59b2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:11.555212 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09b562-3168-4191-a244-d2981aec59b2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:11.559947 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7d300-67e4-47c4-900d-2064d8bae04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:11.560815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7d300-67e4-47c4-900d-2064d8bae04a admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:11.561099 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7d300-67e4-47c4-900d-2064d8bae04a admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:11.561380 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7d300-67e4-47c4-900d-2064d8bae04a admin admin] PATH_INFO: `/v3/projects/ff117078def64108b7829db8db9baf7f/users/484a37a0154a4f709815c5935aef8ec2/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:11.575426 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7d300-67e4-47c4-900d-2064d8bae04a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff117078def64108b7829db8db9baf7f, user_id=484a37a0154a4f709815c5935aef8ec2, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:11.578598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7d300-67e4-47c4-900d-2064d8bae04a admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:11.591404 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1364/2746] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:11 2021] PUT /identity/v3/projects/ff117078def64108b7829db8db9baf7f/users/484a37a0154a4f709815c5935aef8ec2/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:11.597144 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66d62d-6789-4493-aff4-87e14459b438 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:11.597508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66d62d-6789-4493-aff4-87e14459b438 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:11.597853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66d62d-6789-4493-aff4-87e14459b438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:11.615474 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-5b66d62d-6789-4493-aff4-87e14459b438 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:11.616668 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5b66d62d-6789-4493-aff4-87e14459b438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:11.679127 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1383/2747] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:42:11.689051 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7d300-67e4-47c4-900d-2064d8bae04a admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:11.691633 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0df7d300-67e4-47c4-900d-2064d8bae04a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:11.751086 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7d300-67e4-47c4-900d-2064d8bae04a admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:11.754840 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9fd4a-ec83-410d-8780-bb9a0e7b2752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:11.755667 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9fd4a-ec83-410d-8780-bb9a0e7b2752 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:11.755954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9fd4a-ec83-410d-8780-bb9a0e7b2752 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:11.756232 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9fd4a-ec83-410d-8780-bb9a0e7b2752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:11.764962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9fd4a-ec83-410d-8780-bb9a0e7b2752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:11.766946 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9fd4a-ec83-410d-8780-bb9a0e7b2752 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:11.776162 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1365/2748] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:14.261815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66d62d-6789-4493-aff4-87e14459b438 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:14.264104 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5b66d62d-6789-4493-aff4-87e14459b438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:14.456459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66d62d-6789-4493-aff4-87e14459b438 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:14.463117 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f753b0-dcb3-4419-b693-8a12fd160a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:14.463964 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f753b0-dcb3-4419-b693-8a12fd160a27 service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:14.464330 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f753b0-dcb3-4419-b693-8a12fd160a27 service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:14.464714 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f753b0-dcb3-4419-b693-8a12fd160a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:14.466678 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-94f753b0-dcb3-4419-b693-8a12fd160a27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:14.482090 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f753b0-dcb3-4419-b693-8a12fd160a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:14.484110 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f753b0-dcb3-4419-b693-8a12fd160a27 service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:14.499540 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1384/2749] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:14 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:16.998625 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0164-d071-4aeb-8e1b-ddf5e770aa10 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:17.001900 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0164-d071-4aeb-8e1b-ddf5e770aa10 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:17.002216 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0164-d071-4aeb-8e1b-ddf5e770aa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:17.040029 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-350c0164-d071-4aeb-8e1b-ddf5e770aa10 None None] MFA Rules not processed for user `484a37a0154a4f709815c5935aef8ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:17.041259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-350c0164-d071-4aeb-8e1b-ddf5e770aa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:17.138026 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1366/2750] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:16 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:42:17.145096 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f753b0-dcb3-4419-b693-8a12fd160a27 service nova] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:17.161736 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f753b0-dcb3-4419-b693-8a12fd160a27 service nova] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:17.167153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e58972-511e-42db-86e7-9c4b4c224379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:17.167935 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e58972-511e-42db-86e7-9c4b4c224379 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:17.168657 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e58972-511e-42db-86e7-9c4b4c224379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:17.169166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e58972-511e-42db-86e7-9c4b4c224379 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:17.170117 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e58972-511e-42db-86e7-9c4b4c224379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:17.172475 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e58972-511e-42db-86e7-9c4b4c224379 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:17.213493 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1385/2751] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:42:17 2021] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:17.217564 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c0164-d071-4aeb-8e1b-ddf5e770aa10 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:17.229720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c0164-d071-4aeb-8e1b-ddf5e770aa10 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:17.289088 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ec31d-4f7e-4276-a6ac-69b62cf5191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:17.289873 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ec31d-4f7e-4276-a6ac-69b62cf5191c admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:17.290159 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ec31d-4f7e-4276-a6ac-69b62cf5191c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:17.290433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ec31d-4f7e-4276-a6ac-69b62cf5191c admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:17.291635 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ec31d-4f7e-4276-a6ac-69b62cf5191c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:17.293171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ec31d-4f7e-4276-a6ac-69b62cf5191c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:17.317816 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1367/2752] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:42:17 2021] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:17.321367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e58972-511e-42db-86e7-9c4b4c224379 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:17.333331 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e58972-511e-42db-86e7-9c4b4c224379 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:17.339730 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19a176-862a-419f-a169-d548ed298734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:17.340692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19a176-862a-419f-a169-d548ed298734 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:17.341133 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19a176-862a-419f-a169-d548ed298734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:17.341415 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19a176-862a-419f-a169-d548ed298734 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:17.342742 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19a176-862a-419f-a169-d548ed298734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:17.346811 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19a176-862a-419f-a169-d548ed298734 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:17.360560 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1386/2753] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:17 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:42:17.365235 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ec31d-4f7e-4276-a6ac-69b62cf5191c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:17.380504 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ec31d-4f7e-4276-a6ac-69b62cf5191c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:17.385882 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b59514-530d-4be6-9de2-ddfc970c5090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:17.386797 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b59514-530d-4be6-9de2-ddfc970c5090 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:17.387108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b59514-530d-4be6-9de2-ddfc970c5090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:17.387385 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b59514-530d-4be6-9de2-ddfc970c5090 admin admin] PATH_INFO: `/v3/projects/218221016f9842ce9b372ba5aa638ff8/users/30bc244e99974ff0aea7826b1ab36cec/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:17.405617 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b59514-530d-4be6-9de2-ddfc970c5090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=218221016f9842ce9b372ba5aa638ff8, user_id=30bc244e99974ff0aea7826b1ab36cec, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:17.409002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b59514-530d-4be6-9de2-ddfc970c5090 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:17.423208 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1368/2754] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:17 2021] PUT /identity/v3/projects/218221016f9842ce9b372ba5aa638ff8/users/30bc244e99974ff0aea7826b1ab36cec/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:17.427252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19a176-862a-419f-a169-d548ed298734 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:17.437481 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19a176-862a-419f-a169-d548ed298734 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:17.497533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60b4e9-522d-4429-8a8b-7ce139744df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:17.498205 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60b4e9-522d-4429-8a8b-7ce139744df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:17.498500 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60b4e9-522d-4429-8a8b-7ce139744df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:17.498764 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60b4e9-522d-4429-8a8b-7ce139744df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:17.499558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60b4e9-522d-4429-8a8b-7ce139744df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:17.501172 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60b4e9-522d-4429-8a8b-7ce139744df0 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:17.512063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1387/2755] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:17 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:17.516242 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b59514-530d-4be6-9de2-ddfc970c5090 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:17.526938 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b59514-530d-4be6-9de2-ddfc970c5090 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:17.532375 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c81ee-889a-47bf-b35d-bfc984719a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:17.533276 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c81ee-889a-47bf-b35d-bfc984719a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:17.533565 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c81ee-889a-47bf-b35d-bfc984719a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:17.533846 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c81ee-889a-47bf-b35d-bfc984719a19 admin admin] PATH_INFO: `/v3/projects/218221016f9842ce9b372ba5aa638ff8/users/30bc244e99974ff0aea7826b1ab36cec/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:17.535907 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c81ee-889a-47bf-b35d-bfc984719a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=218221016f9842ce9b372ba5aa638ff8, user_id=30bc244e99974ff0aea7826b1ab36cec, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:17.538608 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c81ee-889a-47bf-b35d-bfc984719a19 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:17.549763 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1369/2756] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:17 2021] PUT /identity/v3/projects/218221016f9842ce9b372ba5aa638ff8/users/30bc244e99974ff0aea7826b1ab36cec/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:17.622124 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60b4e9-522d-4429-8a8b-7ce139744df0 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:17.625086 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-ff60b4e9-522d-4429-8a8b-7ce139744df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:17.699117 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60b4e9-522d-4429-8a8b-7ce139744df0 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:17.753182 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b91e4-e264-4339-8538-84b8b879d5cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:17.753837 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b91e4-e264-4339-8538-84b8b879d5cf service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:17.754118 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b91e4-e264-4339-8538-84b8b879d5cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:17.754391 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b91e4-e264-4339-8538-84b8b879d5cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:17.756179 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5c1b91e4-e264-4339-8538-84b8b879d5cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:17.765407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b91e4-e264-4339-8538-84b8b879d5cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:17.766767 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b91e4-e264-4339-8538-84b8b879d5cf service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:17.774826 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1388/2757] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:17 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:18.357338 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c81ee-889a-47bf-b35d-bfc984719a19 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:18.369836 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c81ee-889a-47bf-b35d-bfc984719a19 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:18.375996 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57354136-afe4-4aff-9864-c81f908708e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:18.377062 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57354136-afe4-4aff-9864-c81f908708e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:18.377538 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57354136-afe4-4aff-9864-c81f908708e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:18.377882 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57354136-afe4-4aff-9864-c81f908708e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:18.380028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-57354136-afe4-4aff-9864-c81f908708e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:18.493249 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57354136-afe4-4aff-9864-c81f908708e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:18.494733 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57354136-afe4-4aff-9864-c81f908708e5 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:18.514729 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1370/2758] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:23.161906 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793439e-ec68-4d5b-9583-b28d4367b143 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:23.163347 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793439e-ec68-4d5b-9583-b28d4367b143 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:23.163347 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793439e-ec68-4d5b-9583-b28d4367b143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:23.175981 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57354136-afe4-4aff-9864-c81f908708e5 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:23.178092 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-57354136-afe4-4aff-9864-c81f908708e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:23.194177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57354136-afe4-4aff-9864-c81f908708e5 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:23.200902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32b1e1-3977-426c-969f-48b2c67a22cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:23.202423 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32b1e1-3977-426c-969f-48b2c67a22cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:23.203870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32b1e1-3977-426c-969f-48b2c67a22cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:23.204485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32b1e1-3977-426c-969f-48b2c67a22cd admin admin] PATH_INFO: `/v3/users/58ad05b9c93c48a4bf4d1f086b6d5ad1` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:23.205511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-2793439e-ec68-4d5b-9583-b28d4367b143 None None] MFA Rules not processed for user `30bc244e99974ff0aea7826b1ab36cec`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:23.206322 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32b1e1-3977-426c-969f-48b2c67a22cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ad05b9c93c48a4bf4d1f086b6d5ad1)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:23.206823 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2793439e-ec68-4d5b-9583-b28d4367b143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:23.208821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32b1e1-3977-426c-969f-48b2c67a22cd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:23.310029 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1e32b1e1-3977-426c-969f-48b2c67a22cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ad05b9c93c48a4bf4d1f086b6d5ad1'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:23.336454 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1389/2759] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:23 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:23.341171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1e32b1e1-3977-426c-969f-48b2c67a22cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ad05b9c93c48a4bf4d1f086b6d5ad1'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:23.353582 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793439e-ec68-4d5b-9583-b28d4367b143 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:23.355467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2793439e-ec68-4d5b-9583-b28d4367b143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:23.356244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1e32b1e1-3977-426c-969f-48b2c67a22cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ad05b9c93c48a4bf4d1f086b6d5ad1'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:23.374452 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1e32b1e1-3977-426c-969f-48b2c67a22cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ad05b9c93c48a4bf4d1f086b6d5ad1'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:23.375894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-1e32b1e1-3977-426c-969f-48b2c67a22cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ad05b9c93c48a4bf4d1f086b6d5ad1'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:23.394153 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1371/2760] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:23 2021] DELETE /identity/v3/users/58ad05b9c93c48a4bf4d1f086b6d5ad1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:23.492318 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793439e-ec68-4d5b-9583-b28d4367b143 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:23.591073 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0abaf3-2f02-4743-98a7-3972e18b8f9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:23.591742 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0abaf3-2f02-4743-98a7-3972e18b8f9d service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:23.592030 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0abaf3-2f02-4743-98a7-3972e18b8f9d service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:23.592318 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0abaf3-2f02-4743-98a7-3972e18b8f9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:23.594333 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-4e0abaf3-2f02-4743-98a7-3972e18b8f9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:23.637188 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32b1e1-3977-426c-969f-48b2c67a22cd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:23.641071 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-1e32b1e1-3977-426c-969f-48b2c67a22cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:23.676534 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0abaf3-2f02-4743-98a7-3972e18b8f9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:23.679351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0abaf3-2f02-4743-98a7-3972e18b8f9d service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:23.689723 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1390/2761] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:23 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:23.717978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32b1e1-3977-426c-969f-48b2c67a22cd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:23.724368 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ebb0e-9885-4d2b-b408-140e75424b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:23.725308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebb0e-9885-4d2b-b408-140e75424b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:23.725662 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebb0e-9885-4d2b-b408-140e75424b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:23.725997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebb0e-9885-4d2b-b408-140e75424b5d admin admin] PATH_INFO: `/v3/projects/849d4c797afe475aa474e4415f6190c0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:23.727493 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ebb0e-9885-4d2b-b408-140e75424b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=849d4c797afe475aa474e4415f6190c0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:23.729475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ebb0e-9885-4d2b-b408-140e75424b5d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:23.782238 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-553ebb0e-9885-4d2b-b408-140e75424b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849d4c797afe475aa474e4415f6190c0', 'request_id': 'req-553ebb0e-9885-4d2b-b408-140e75424b5d'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:23.797557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-553ebb0e-9885-4d2b-b408-140e75424b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849d4c797afe475aa474e4415f6190c0', 'request_id': 'req-553ebb0e-9885-4d2b-b408-140e75424b5d'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:23.804254 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-553ebb0e-9885-4d2b-b408-140e75424b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849d4c797afe475aa474e4415f6190c0', 'request_id': 'req-553ebb0e-9885-4d2b-b408-140e75424b5d'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:23.818426 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-553ebb0e-9885-4d2b-b408-140e75424b5d admin admin] The token cache is being invalidate because project 849d4c797afe475aa474e4415f6190c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:23.819241 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-553ebb0e-9885-4d2b-b408-140e75424b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:23.820166 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-553ebb0e-9885-4d2b-b408-140e75424b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:23.822352 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1372/2762] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:23 2021] DELETE /identity/v3/projects/849d4c797afe475aa474e4415f6190c0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:42:23.833543 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38ea4e-839f-40bb-8b20-96a8fb16c79a None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:23.833830 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38ea4e-839f-40bb-8b20-96a8fb16c79a None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:23.834112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38ea4e-839f-40bb-8b20-96a8fb16c79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:23.857658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-5c38ea4e-839f-40bb-8b20-96a8fb16c79a None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:23.859193 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5c38ea4e-839f-40bb-8b20-96a8fb16c79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:23.946166 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1391/2763] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:23.954466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d256b-b2cb-4a87-8222-6174d9499dd3 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:23.954817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d256b-b2cb-4a87-8222-6174d9499dd3 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:23.955132 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d256b-b2cb-4a87-8222-6174d9499dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:23.976423 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-d83d256b-b2cb-4a87-8222-6174d9499dd3 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:23.977315 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-d83d256b-b2cb-4a87-8222-6174d9499dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:23.987711 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1373/2764] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:23.993318 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38ea4e-839f-40bb-8b20-96a8fb16c79a None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:24.010670 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38ea4e-839f-40bb-8b20-96a8fb16c79a None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:24.018412 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb4394-a43c-4422-b6b1-67c25e5fb599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:24.019145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb4394-a43c-4422-b6b1-67c25e5fb599 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:24.019428 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb4394-a43c-4422-b6b1-67c25e5fb599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:24.019738 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb4394-a43c-4422-b6b1-67c25e5fb599 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:24.020459 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb4394-a43c-4422-b6b1-67c25e5fb599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:42:24.020777 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb4394-a43c-4422-b6b1-67c25e5fb599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:24.022376 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb4394-a43c-4422-b6b1-67c25e5fb599 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:24.041211 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1392/2765] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:42:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:42:24.043629 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d256b-b2cb-4a87-8222-6174d9499dd3 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:24.056536 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d256b-b2cb-4a87-8222-6174d9499dd3 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:24.061916 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6c150-cd5b-41cf-bd1d-70a1cee05e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:24.063014 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6c150-cd5b-41cf-bd1d-70a1cee05e44 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:24.063465 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6c150-cd5b-41cf-bd1d-70a1cee05e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:24.063922 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6c150-cd5b-41cf-bd1d-70a1cee05e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:24.068382 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6c150-cd5b-41cf-bd1d-70a1cee05e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:24.074262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6c150-cd5b-41cf-bd1d-70a1cee05e44 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:24.154087 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1374/2766] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:42:24 2021] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:24.154566 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb4394-a43c-4422-b6b1-67c25e5fb599 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:24.166173 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb4394-a43c-4422-b6b1-67c25e5fb599 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:24.243999 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be37b-c039-4e9e-92cf-5597fc4ba526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:24.244698 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be37b-c039-4e9e-92cf-5597fc4ba526 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:24.244985 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be37b-c039-4e9e-92cf-5597fc4ba526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:24.245263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be37b-c039-4e9e-92cf-5597fc4ba526 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:24.246217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8be37b-c039-4e9e-92cf-5597fc4ba526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:24.247959 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8be37b-c039-4e9e-92cf-5597fc4ba526 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:24.271257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1393/2767] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:42:24 2021] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:24.275504 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6c150-cd5b-41cf-bd1d-70a1cee05e44 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:24.287294 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6c150-cd5b-41cf-bd1d-70a1cee05e44 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:24.293433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abce7f6-3540-4827-8c90-a726377088d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:24.294334 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abce7f6-3540-4827-8c90-a726377088d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:24.294787 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abce7f6-3540-4827-8c90-a726377088d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:24.295385 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abce7f6-3540-4827-8c90-a726377088d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:24.296340 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abce7f6-3540-4827-8c90-a726377088d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:24.298587 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abce7f6-3540-4827-8c90-a726377088d7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:24.310582 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1375/2768] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:24 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:24.314875 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be37b-c039-4e9e-92cf-5597fc4ba526 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:24.325608 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be37b-c039-4e9e-92cf-5597fc4ba526 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:24.331321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954906b-0b95-40e5-b3d6-ec554bf4cadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:24.332152 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954906b-0b95-40e5-b3d6-ec554bf4cadf admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:24.332537 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954906b-0b95-40e5-b3d6-ec554bf4cadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:24.332884 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954906b-0b95-40e5-b3d6-ec554bf4cadf admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:24.333717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954906b-0b95-40e5-b3d6-ec554bf4cadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:24.335446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954906b-0b95-40e5-b3d6-ec554bf4cadf admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:24.347145 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1394/2769] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:24 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:24.351097 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abce7f6-3540-4827-8c90-a726377088d7 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:24.361323 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abce7f6-3540-4827-8c90-a726377088d7 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:24.367040 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22229657-0b81-4f54-878f-e0bca1c6242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:24.367984 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22229657-0b81-4f54-878f-e0bca1c6242f admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:24.368262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22229657-0b81-4f54-878f-e0bca1c6242f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:24.368537 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22229657-0b81-4f54-878f-e0bca1c6242f admin admin] PATH_INFO: `/v3/projects/605f407009e74241b3d1c7f8d6275cf2/users/e5c1ae21c9a8463aa9beb0ed032a16fb/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:24.383398 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22229657-0b81-4f54-878f-e0bca1c6242f admin admin] RBAC: Authorizing `identity:create_grant(project_id=605f407009e74241b3d1c7f8d6275cf2, user_id=e5c1ae21c9a8463aa9beb0ed032a16fb, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:24.386133 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22229657-0b81-4f54-878f-e0bca1c6242f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:24.402899 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1376/2770] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:24 2021] PUT /identity/v3/projects/605f407009e74241b3d1c7f8d6275cf2/users/e5c1ae21c9a8463aa9beb0ed032a16fb/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:24.408631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b45ca-34d1-422f-be39-91844a2158d2 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:24.409126 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b45ca-34d1-422f-be39-91844a2158d2 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:24.409899 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b45ca-34d1-422f-be39-91844a2158d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:24.432387 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-901b45ca-34d1-422f-be39-91844a2158d2 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:24.433600 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-901b45ca-34d1-422f-be39-91844a2158d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:24.505900 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1395/2771] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:24.516322 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22229657-0b81-4f54-878f-e0bca1c6242f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:24.518492 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-22229657-0b81-4f54-878f-e0bca1c6242f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:24.533395 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b45ca-34d1-422f-be39-91844a2158d2 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:24.534829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-901b45ca-34d1-422f-be39-91844a2158d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:24.603578 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22229657-0b81-4f54-878f-e0bca1c6242f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:24.606553 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b45ca-34d1-422f-be39-91844a2158d2 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:24.608150 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef33a82-04ba-4b1d-8935-14a67fa19d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:24.608866 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef33a82-04ba-4b1d-8935-14a67fa19d36 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:24.609425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef33a82-04ba-4b1d-8935-14a67fa19d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:24.609718 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef33a82-04ba-4b1d-8935-14a67fa19d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:24.610512 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ae2e0-cd3f-4ba6-8047-c1b3d88a4b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:24.612204 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ae2e0-cd3f-4ba6-8047-c1b3d88a4b66 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:24.612521 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ae2e0-cd3f-4ba6-8047-c1b3d88a4b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:24.612808 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ae2e0-cd3f-4ba6-8047-c1b3d88a4b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:24.614813 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-899ae2e0-cd3f-4ba6-8047-c1b3d88a4b66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:24.621741 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef33a82-04ba-4b1d-8935-14a67fa19d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:24.623462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef33a82-04ba-4b1d-8935-14a67fa19d36 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:24.636595 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1377/2772] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:24.691210 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ae2e0-cd3f-4ba6-8047-c1b3d88a4b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:24.691210 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ae2e0-cd3f-4ba6-8047-c1b3d88a4b66 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:24.700710 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1396/2773] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:24 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:25.814675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49029d05-fa6a-4b40-a5db-0aeea4d9ccbf None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:25.815216 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49029d05-fa6a-4b40-a5db-0aeea4d9ccbf None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:25.815339 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49029d05-fa6a-4b40-a5db-0aeea4d9ccbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:25.857768 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-49029d05-fa6a-4b40-a5db-0aeea4d9ccbf None None] MFA Rules not processed for user `e5c1ae21c9a8463aa9beb0ed032a16fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:25.859954 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-49029d05-fa6a-4b40-a5db-0aeea4d9ccbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:25.973447 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1378/2774] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:25 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:25.977913 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ae2e0-cd3f-4ba6-8047-c1b3d88a4b66 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:25.998056 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ae2e0-cd3f-4ba6-8047-c1b3d88a4b66 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:26.017866 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb131-1cd4-42bb-8c5b-f1f6682e325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:26.018955 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb131-1cd4-42bb-8c5b-f1f6682e325f admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:26.019573 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb131-1cd4-42bb-8c5b-f1f6682e325f admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:26.020058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb131-1cd4-42bb-8c5b-f1f6682e325f admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:26.021034 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fb131-1cd4-42bb-8c5b-f1f6682e325f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:26.029584 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fb131-1cd4-42bb-8c5b-f1f6682e325f admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:26.072944 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1397/2775] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:42:25 2021] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:26.074430 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49029d05-fa6a-4b40-a5db-0aeea4d9ccbf None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:26.092285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49029d05-fa6a-4b40-a5db-0aeea4d9ccbf None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:26.228943 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f234180-3d52-44ef-9c56-4cb0c198276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:26.229579 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f234180-3d52-44ef-9c56-4cb0c198276e admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:26.229861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f234180-3d52-44ef-9c56-4cb0c198276e admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:26.230211 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f234180-3d52-44ef-9c56-4cb0c198276e admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:26.230886 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f234180-3d52-44ef-9c56-4cb0c198276e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:26.232940 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f234180-3d52-44ef-9c56-4cb0c198276e admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:26.274997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1379/2776] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:42:26 2021] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:26.276223 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb131-1cd4-42bb-8c5b-f1f6682e325f admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:26.295864 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb131-1cd4-42bb-8c5b-f1f6682e325f admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:26.306150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d2266-a8f5-4f6b-81a0-c10991381376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:26.308458 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d2266-a8f5-4f6b-81a0-c10991381376 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:26.309007 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d2266-a8f5-4f6b-81a0-c10991381376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:26.309462 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d2266-a8f5-4f6b-81a0-c10991381376 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:26.310445 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d2266-a8f5-4f6b-81a0-c10991381376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:26.312752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d2266-a8f5-4f6b-81a0-c10991381376 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:26.330425 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1398/2777] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:26 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:26.331255 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f234180-3d52-44ef-9c56-4cb0c198276e admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:26.347372 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f234180-3d52-44ef-9c56-4cb0c198276e admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:26.358777 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f11ef9-9d9c-4a2d-9d62-30b80946b264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:26.360574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11ef9-9d9c-4a2d-9d62-30b80946b264 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:26.361028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11ef9-9d9c-4a2d-9d62-30b80946b264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:26.361391 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11ef9-9d9c-4a2d-9d62-30b80946b264 admin admin] PATH_INFO: `/v3/projects/3147c246e01147b9bc6923f63f76100a/users/91bc2299014946b69a6176465dd05aee/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:26.383487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f11ef9-9d9c-4a2d-9d62-30b80946b264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3147c246e01147b9bc6923f63f76100a, user_id=91bc2299014946b69a6176465dd05aee, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:26.387084 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f11ef9-9d9c-4a2d-9d62-30b80946b264 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:26.404344 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1380/2778] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:26 2021] PUT /identity/v3/projects/3147c246e01147b9bc6923f63f76100a/users/91bc2299014946b69a6176465dd05aee/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:42:26.408609 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d2266-a8f5-4f6b-81a0-c10991381376 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:26.423234 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d2266-a8f5-4f6b-81a0-c10991381376 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:26.504720 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f732d-a413-41d0-9e8a-e59352382805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:26.505313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f732d-a413-41d0-9e8a-e59352382805 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:26.505593 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f732d-a413-41d0-9e8a-e59352382805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:26.505869 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f732d-a413-41d0-9e8a-e59352382805 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:26.506614 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f732d-a413-41d0-9e8a-e59352382805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:26.508303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f732d-a413-41d0-9e8a-e59352382805 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:26.523550 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1399/2779] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:26 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:26.525130 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f11ef9-9d9c-4a2d-9d62-30b80946b264 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:26.539307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f11ef9-9d9c-4a2d-9d62-30b80946b264 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:26.544120 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7584f0-9aaa-44cd-8912-7a3f811fe697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:26.545008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7584f0-9aaa-44cd-8912-7a3f811fe697 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:26.545307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7584f0-9aaa-44cd-8912-7a3f811fe697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:26.545562 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7584f0-9aaa-44cd-8912-7a3f811fe697 admin admin] PATH_INFO: `/v3/projects/3147c246e01147b9bc6923f63f76100a/users/91bc2299014946b69a6176465dd05aee/roles/d832ab37ec7645cb853ef26c969765a0` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:26.548282 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7584f0-9aaa-44cd-8912-7a3f811fe697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3147c246e01147b9bc6923f63f76100a, user_id=91bc2299014946b69a6176465dd05aee, role_id=d832ab37ec7645cb853ef26c969765a0)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:26.550961 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7584f0-9aaa-44cd-8912-7a3f811fe697 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:26.576794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1381/2780] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:26 2021] PUT /identity/v3/projects/3147c246e01147b9bc6923f63f76100a/users/91bc2299014946b69a6176465dd05aee/roles/d832ab37ec7645cb853ef26c969765a0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:27.635046 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab543b-01e9-4d22-9194-01dbb330a6bd None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:27.635637 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab543b-01e9-4d22-9194-01dbb330a6bd None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:27.635637 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab543b-01e9-4d22-9194-01dbb330a6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:27.684625 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-c8ab543b-01e9-4d22-9194-01dbb330a6bd None None] MFA Rules not processed for user `91bc2299014946b69a6176465dd05aee`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:27.690818 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c8ab543b-01e9-4d22-9194-01dbb330a6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:27.771908 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1400/2781] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:27 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:27.783921 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7584f0-9aaa-44cd-8912-7a3f811fe697 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:27.785593 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-cd7584f0-9aaa-44cd-8912-7a3f811fe697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:27.849159 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7584f0-9aaa-44cd-8912-7a3f811fe697 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:27.852815 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d69410-99c5-48e5-96d1-a35ef8ac21b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:27.853465 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d69410-99c5-48e5-96d1-a35ef8ac21b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:27.853751 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d69410-99c5-48e5-96d1-a35ef8ac21b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:27.854037 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d69410-99c5-48e5-96d1-a35ef8ac21b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:27.922477 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d69410-99c5-48e5-96d1-a35ef8ac21b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:27.924167 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d69410-99c5-48e5-96d1-a35ef8ac21b5 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:27.938434 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1382/2782] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:27 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:29.379406 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab543b-01e9-4d22-9194-01dbb330a6bd None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:29.388958 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab543b-01e9-4d22-9194-01dbb330a6bd None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:29.393199 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ee16-c4f4-40ed-ac00-58cf58b01bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:29.393835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ee16-c4f4-40ed-ac00-58cf58b01bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:29.394117 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ee16-c4f4-40ed-ac00-58cf58b01bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:29.394392 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ee16-c4f4-40ed-ac00-58cf58b01bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:29.405594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8ee16-c4f4-40ed-ac00-58cf58b01bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:29.407737 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8ee16-c4f4-40ed-ac00-58cf58b01bc7 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:29.423121 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1401/2783] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:29 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:30.968209 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d69410-99c5-48e5-96d1-a35ef8ac21b5 service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:30.969773 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c2d69410-99c5-48e5-96d1-a35ef8ac21b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:31.034389 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d69410-99c5-48e5-96d1-a35ef8ac21b5 service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:31.038164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9b254-0d6d-4a50-8ae5-110b42c6e20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:31.038817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9b254-0d6d-4a50-8ae5-110b42c6e20b service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:31.039141 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9b254-0d6d-4a50-8ae5-110b42c6e20b service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:31.039415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9b254-0d6d-4a50-8ae5-110b42c6e20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:31.041290 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a8e9b254-0d6d-4a50-8ae5-110b42c6e20b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:31.105833 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9b254-0d6d-4a50-8ae5-110b42c6e20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:31.107345 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9b254-0d6d-4a50-8ae5-110b42c6e20b service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:31.118481 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1383/2784] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:37.568290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ee16-c4f4-40ed-ac00-58cf58b01bc7 service cinder] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:37.569981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-dbc8ee16-c4f4-40ed-ac00-58cf58b01bc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:37.585072 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ee16-c4f4-40ed-ac00-58cf58b01bc7 service cinder] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:37.590934 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdc953-0888-415f-be1f-58ca1e5e68dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:37.592025 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdc953-0888-415f-be1f-58ca1e5e68dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:37.593723 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdc953-0888-415f-be1f-58ca1e5e68dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:37.594027 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdc953-0888-415f-be1f-58ca1e5e68dc admin admin] PATH_INFO: `/v3/users/7774ea10bce345cabd96a0c94eda98b3` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:37.602200 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdc953-0888-415f-be1f-58ca1e5e68dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7774ea10bce345cabd96a0c94eda98b3)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:37.605009 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdc953-0888-415f-be1f-58ca1e5e68dc admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:37.658235 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-cafdc953-0888-415f-be1f-58ca1e5e68dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7774ea10bce345cabd96a0c94eda98b3'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:37.669896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-cafdc953-0888-415f-be1f-58ca1e5e68dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7774ea10bce345cabd96a0c94eda98b3'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:37.677311 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-cafdc953-0888-415f-be1f-58ca1e5e68dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7774ea10bce345cabd96a0c94eda98b3'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:37.686102 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-cafdc953-0888-415f-be1f-58ca1e5e68dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7774ea10bce345cabd96a0c94eda98b3'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:37.687069 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-cafdc953-0888-415f-be1f-58ca1e5e68dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7774ea10bce345cabd96a0c94eda98b3'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:37.693605 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1402/2785] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:37 2021] DELETE /identity/v3/users/7774ea10bce345cabd96a0c94eda98b3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:37.866137 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9b254-0d6d-4a50-8ae5-110b42c6e20b service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:37.881704 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9b254-0d6d-4a50-8ae5-110b42c6e20b service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:37.939821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:37.940865 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:37.941171 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:37.941607 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] PATH_INFO: `/v3/projects/bb0ac6d4548e486492887beb2e915bdb` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:37.943061 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0ac6d4548e486492887beb2e915bdb)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:37.945217 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:37.991707 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0ac6d4548e486492887beb2e915bdb', 'request_id': 'req-3552d985-7874-421b-bdd5-0d2e4aeeb606'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:37.999367 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0ac6d4548e486492887beb2e915bdb', 'request_id': 'req-3552d985-7874-421b-bdd5-0d2e4aeeb606'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:38.009314 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0ac6d4548e486492887beb2e915bdb', 'request_id': 'req-3552d985-7874-421b-bdd5-0d2e4aeeb606'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:38.021429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] The token cache is being invalidate because project bb0ac6d4548e486492887beb2e915bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:38.021719 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:38.022368 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:38.024062 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1384/2786] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:37 2021] DELETE /identity/v3/projects/bb0ac6d4548e486492887beb2e915bdb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:38.028034 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdc953-0888-415f-be1f-58ca1e5e68dc admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:38.029421 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-cafdc953-0888-415f-be1f-58ca1e5e68dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:38.042181 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdc953-0888-415f-be1f-58ca1e5e68dc admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:38.099359 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1f19d-a9d5-486b-b339-288a5f597e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:38.100225 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f19d-a9d5-486b-b339-288a5f597e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:38.100511 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f19d-a9d5-486b-b339-288a5f597e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:38.100790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f19d-a9d5-486b-b339-288a5f597e2d admin admin] PATH_INFO: `/v3/users/61003898c1ed47b181ef387133342017` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:38.101982 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1f19d-a9d5-486b-b339-288a5f597e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=61003898c1ed47b181ef387133342017)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:38.103924 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1f19d-a9d5-486b-b339-288a5f597e2d admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:38.148642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bfa1f19d-a9d5-486b-b339-288a5f597e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61003898c1ed47b181ef387133342017'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:38.160607 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bfa1f19d-a9d5-486b-b339-288a5f597e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61003898c1ed47b181ef387133342017'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:38.167379 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bfa1f19d-a9d5-486b-b339-288a5f597e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61003898c1ed47b181ef387133342017'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:38.176904 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bfa1f19d-a9d5-486b-b339-288a5f597e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61003898c1ed47b181ef387133342017'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:38.177664 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-bfa1f19d-a9d5-486b-b339-288a5f597e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61003898c1ed47b181ef387133342017'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:38.185396 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1403/2787] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:38 2021] DELETE /identity/v3/users/61003898c1ed47b181ef387133342017 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:38.354629 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:38.356092 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:38.372798 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552d985-7874-421b-bdd5-0d2e4aeeb606 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:38.431203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:38.432063 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:38.432346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:38.432625 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] PATH_INFO: `/v3/projects/c7eab11f9bb1411c9559a3ec8184b9c5` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:38.433816 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7eab11f9bb1411c9559a3ec8184b9c5)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:38.435770 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:38.481614 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7eab11f9bb1411c9559a3ec8184b9c5', 'request_id': 'req-b5c72604-4c74-4007-a1ff-9255e012daf0'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:38.489485 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7eab11f9bb1411c9559a3ec8184b9c5', 'request_id': 'req-b5c72604-4c74-4007-a1ff-9255e012daf0'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:38.495113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7eab11f9bb1411c9559a3ec8184b9c5', 'request_id': 'req-b5c72604-4c74-4007-a1ff-9255e012daf0'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:38.506081 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] The token cache is being invalidate because project c7eab11f9bb1411c9559a3ec8184b9c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:38.506370 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:38.507068 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:38.508590 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1385/2788] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:38 2021] DELETE /identity/v3/projects/c7eab11f9bb1411c9559a3ec8184b9c5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:42.425290 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1f19d-a9d5-486b-b339-288a5f597e2d admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:42.426889 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-bfa1f19d-a9d5-486b-b339-288a5f597e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:42.441002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1f19d-a9d5-486b-b339-288a5f597e2d admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:42.497217 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0859490-f2c7-4372-8bf7-5e70bb255c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:42.497987 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0859490-f2c7-4372-8bf7-5e70bb255c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:42.498266 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0859490-f2c7-4372-8bf7-5e70bb255c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:42.498545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0859490-f2c7-4372-8bf7-5e70bb255c56 admin admin] PATH_INFO: `/v3/users/e5c1ae21c9a8463aa9beb0ed032a16fb` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:42.499770 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0859490-f2c7-4372-8bf7-5e70bb255c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5c1ae21c9a8463aa9beb0ed032a16fb)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:42.501673 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0859490-f2c7-4372-8bf7-5e70bb255c56 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:42.545859 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c0859490-f2c7-4372-8bf7-5e70bb255c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5c1ae21c9a8463aa9beb0ed032a16fb'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.557253 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c0859490-f2c7-4372-8bf7-5e70bb255c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5c1ae21c9a8463aa9beb0ed032a16fb'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.564456 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c0859490-f2c7-4372-8bf7-5e70bb255c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5c1ae21c9a8463aa9beb0ed032a16fb'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.571334 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c0859490-f2c7-4372-8bf7-5e70bb255c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5c1ae21c9a8463aa9beb0ed032a16fb'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.571963 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-c0859490-f2c7-4372-8bf7-5e70bb255c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5c1ae21c9a8463aa9beb0ed032a16fb'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.577642 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1404/2789] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:42 2021] DELETE /identity/v3/users/e5c1ae21c9a8463aa9beb0ed032a16fb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:42.746687 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:42.748230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:42.761342 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c72604-4c74-4007-a1ff-9255e012daf0 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:42.816222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:42.817072 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:42.817355 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:42.817633 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] PATH_INFO: `/v3/projects/605f407009e74241b3d1c7f8d6275cf2` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:42.818857 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] RBAC: Authorizing `identity:delete_project(project_id=605f407009e74241b3d1c7f8d6275cf2)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:42.820762 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:42.866163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605f407009e74241b3d1c7f8d6275cf2', 'request_id': 'req-8bed7899-2cac-4173-b211-53094f29787d'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.874710 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605f407009e74241b3d1c7f8d6275cf2', 'request_id': 'req-8bed7899-2cac-4173-b211-53094f29787d'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.880794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605f407009e74241b3d1c7f8d6275cf2', 'request_id': 'req-8bed7899-2cac-4173-b211-53094f29787d'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.891443 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] The token cache is being invalidate because project 605f407009e74241b3d1c7f8d6275cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:42.892322 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.893039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.894677 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1386/2790] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:42 2021] DELETE /identity/v3/projects/605f407009e74241b3d1c7f8d6275cf2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:42.898595 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0859490-f2c7-4372-8bf7-5e70bb255c56 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:42.900061 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c0859490-f2c7-4372-8bf7-5e70bb255c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:42.912313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0859490-f2c7-4372-8bf7-5e70bb255c56 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:42.968070 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bcdf7-4613-4f0c-bd82-da490599802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:42.968962 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bcdf7-4613-4f0c-bd82-da490599802a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:42.969243 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bcdf7-4613-4f0c-bd82-da490599802a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:42.969598 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bcdf7-4613-4f0c-bd82-da490599802a admin admin] PATH_INFO: `/v3/users/91bc2299014946b69a6176465dd05aee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:42.971011 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bcdf7-4613-4f0c-bd82-da490599802a admin admin] RBAC: Authorizing `identity:delete_user(user_id=91bc2299014946b69a6176465dd05aee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:42.972925 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bcdf7-4613-4f0c-bd82-da490599802a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:43.017527 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-dd1bcdf7-4613-4f0c-bd82-da490599802a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91bc2299014946b69a6176465dd05aee'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:43.028744 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-dd1bcdf7-4613-4f0c-bd82-da490599802a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91bc2299014946b69a6176465dd05aee'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:43.035385 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-dd1bcdf7-4613-4f0c-bd82-da490599802a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91bc2299014946b69a6176465dd05aee'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:43.041815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-dd1bcdf7-4613-4f0c-bd82-da490599802a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91bc2299014946b69a6176465dd05aee'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:43.042430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-dd1bcdf7-4613-4f0c-bd82-da490599802a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91bc2299014946b69a6176465dd05aee'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:43.048599 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1405/2791] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:42 2021] DELETE /identity/v3/users/91bc2299014946b69a6176465dd05aee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:43.211293 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:43.212720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:43.225634 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed7899-2cac-4173-b211-53094f29787d admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:43.283365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042693-8824-4bb8-a453-dd90242dd099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:43.284146 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042693-8824-4bb8-a453-dd90242dd099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:43.284425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042693-8824-4bb8-a453-dd90242dd099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:43.284699 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042693-8824-4bb8-a453-dd90242dd099 admin admin] PATH_INFO: `/v3/projects/3147c246e01147b9bc6923f63f76100a` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:43.285869 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd042693-8824-4bb8-a453-dd90242dd099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3147c246e01147b9bc6923f63f76100a)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:43.287844 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd042693-8824-4bb8-a453-dd90242dd099 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:43.333007 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-cd042693-8824-4bb8-a453-dd90242dd099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3147c246e01147b9bc6923f63f76100a', 'request_id': 'req-cd042693-8824-4bb8-a453-dd90242dd099'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:43.340374 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-cd042693-8824-4bb8-a453-dd90242dd099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3147c246e01147b9bc6923f63f76100a', 'request_id': 'req-cd042693-8824-4bb8-a453-dd90242dd099'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:43.345770 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-cd042693-8824-4bb8-a453-dd90242dd099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3147c246e01147b9bc6923f63f76100a', 'request_id': 'req-cd042693-8824-4bb8-a453-dd90242dd099'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:43.356381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-cd042693-8824-4bb8-a453-dd90242dd099 admin admin] The token cache is being invalidate because project 3147c246e01147b9bc6923f63f76100a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:43.356665 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-cd042693-8824-4bb8-a453-dd90242dd099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:43.357283 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-cd042693-8824-4bb8-a453-dd90242dd099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:43.358962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1387/2792] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:43 2021] DELETE /identity/v3/projects/3147c246e01147b9bc6923f63f76100a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:42:43.365571 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10435c87-9046-4038-bead-30db5a767b4c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:43.365862 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10435c87-9046-4038-bead-30db5a767b4c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:43.366149 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10435c87-9046-4038-bead-30db5a767b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:43.384369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-10435c87-9046-4038-bead-30db5a767b4c None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:43.385547 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-10435c87-9046-4038-bead-30db5a767b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:43.442607 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1406/2793] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:43.451346 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2014f8-be52-49c6-80f9-667185a25deb None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:43.451634 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2014f8-be52-49c6-80f9-667185a25deb None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:43.451913 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2014f8-be52-49c6-80f9-667185a25deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:43.472306 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-fd2014f8-be52-49c6-80f9-667185a25deb None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:43.473511 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-fd2014f8-be52-49c6-80f9-667185a25deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:43.481472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1388/2794] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:43.486407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10435c87-9046-4038-bead-30db5a767b4c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:43.495729 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10435c87-9046-4038-bead-30db5a767b4c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:43.500378 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da816ce2-6e61-492f-bdcf-91f3f8b69902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:43.501055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da816ce2-6e61-492f-bdcf-91f3f8b69902 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:43.501335 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da816ce2-6e61-492f-bdcf-91f3f8b69902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:43.501610 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da816ce2-6e61-492f-bdcf-91f3f8b69902 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:43.502337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da816ce2-6e61-492f-bdcf-91f3f8b69902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:42:43.502643 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da816ce2-6e61-492f-bdcf-91f3f8b69902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:43.504269 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da816ce2-6e61-492f-bdcf-91f3f8b69902 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:43.515403 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1407/2795] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:42:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:42:43.519557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2014f8-be52-49c6-80f9-667185a25deb None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:43.528778 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2014f8-be52-49c6-80f9-667185a25deb None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:43.534022 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f7c68-652f-4690-96f7-6879ecc24b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:43.534596 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f7c68-652f-4690-96f7-6879ecc24b22 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:43.534905 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f7c68-652f-4690-96f7-6879ecc24b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:43.535186 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f7c68-652f-4690-96f7-6879ecc24b22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:43.535893 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f7c68-652f-4690-96f7-6879ecc24b22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:43.537782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f7c68-652f-4690-96f7-6879ecc24b22 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:43.565431 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1389/2796] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:42:43 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:43.566660 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da816ce2-6e61-492f-bdcf-91f3f8b69902 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:43.576287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da816ce2-6e61-492f-bdcf-91f3f8b69902 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:43.630558 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfdaf5-e105-4b16-aee1-6fce9acb7962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:43.631293 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfdaf5-e105-4b16-aee1-6fce9acb7962 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:43.631692 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfdaf5-e105-4b16-aee1-6fce9acb7962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:43.631976 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfdaf5-e105-4b16-aee1-6fce9acb7962 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:43.632722 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfdaf5-e105-4b16-aee1-6fce9acb7962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:43.634631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfdaf5-e105-4b16-aee1-6fce9acb7962 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:43.653446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1408/2797] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:42:43 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:43.658037 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f7c68-652f-4690-96f7-6879ecc24b22 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:43.668253 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f7c68-652f-4690-96f7-6879ecc24b22 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:43.673502 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327f371-4b14-4f37-aca6-4ec579646696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:43.674147 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327f371-4b14-4f37-aca6-4ec579646696 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:43.674426 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327f371-4b14-4f37-aca6-4ec579646696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:43.674701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327f371-4b14-4f37-aca6-4ec579646696 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:43.675472 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327f371-4b14-4f37-aca6-4ec579646696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:43.677063 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327f371-4b14-4f37-aca6-4ec579646696 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:43.687177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1390/2798] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:43.691100 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfdaf5-e105-4b16-aee1-6fce9acb7962 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:43.701156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfdaf5-e105-4b16-aee1-6fce9acb7962 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:43.705700 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621db276-71d9-4ca8-bd23-ba286f459460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:43.706343 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621db276-71d9-4ca8-bd23-ba286f459460 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:43.706627 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621db276-71d9-4ca8-bd23-ba286f459460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:43.706925 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621db276-71d9-4ca8-bd23-ba286f459460 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:43.707658 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621db276-71d9-4ca8-bd23-ba286f459460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:43.709224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621db276-71d9-4ca8-bd23-ba286f459460 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:43.719109 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1409/2799] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:43.723550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327f371-4b14-4f37-aca6-4ec579646696 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:43.733219 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327f371-4b14-4f37-aca6-4ec579646696 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:43.738373 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f94e25-c551-4760-ac9a-7ff7a0ca8f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:43.739260 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f94e25-c551-4760-ac9a-7ff7a0ca8f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:43.739550 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f94e25-c551-4760-ac9a-7ff7a0ca8f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:43.739998 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f94e25-c551-4760-ac9a-7ff7a0ca8f10 admin admin] PATH_INFO: `/v3/projects/46bd97f8fefb44adbd817b8198c42223/users/d2de6fd25edc4ac68d6facc5bbd4c517/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:43.754334 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f94e25-c551-4760-ac9a-7ff7a0ca8f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bd97f8fefb44adbd817b8198c42223, user_id=d2de6fd25edc4ac68d6facc5bbd4c517, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:43.757235 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f94e25-c551-4760-ac9a-7ff7a0ca8f10 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:43.769950 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1391/2800] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:43 2021] PUT /identity/v3/projects/46bd97f8fefb44adbd817b8198c42223/users/d2de6fd25edc4ac68d6facc5bbd4c517/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:43.780860 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5581-4bf8-4d6e-8dda-ed82d08d361c None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:43.781147 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5581-4bf8-4d6e-8dda-ed82d08d361c None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:43.781423 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5581-4bf8-4d6e-8dda-ed82d08d361c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:43.808263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-ea2a5581-4bf8-4d6e-8dda-ed82d08d361c None None] MFA Rules not processed for user `d2de6fd25edc4ac68d6facc5bbd4c517`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:43.809427 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-ea2a5581-4bf8-4d6e-8dda-ed82d08d361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:43.870081 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1410/2801] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:43 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:43.880206 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f94e25-c551-4760-ac9a-7ff7a0ca8f10 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:43.882039 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-36f94e25-c551-4760-ac9a-7ff7a0ca8f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:43.938905 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f94e25-c551-4760-ac9a-7ff7a0ca8f10 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:43.942564 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83366b-1472-4475-8c7e-3eec3f8f4592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:43.943233 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83366b-1472-4475-8c7e-3eec3f8f4592 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:43.943518 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83366b-1472-4475-8c7e-3eec3f8f4592 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:43.943797 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83366b-1472-4475-8c7e-3eec3f8f4592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:43.951952 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83366b-1472-4475-8c7e-3eec3f8f4592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:43.953390 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83366b-1472-4475-8c7e-3eec3f8f4592 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:43.962505 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1392/2802] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:43 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:43.981691 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a5581-4bf8-4d6e-8dda-ed82d08d361c None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:44.040893 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a5581-4bf8-4d6e-8dda-ed82d08d361c None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:44.045457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d44b0c-965d-43fa-b4bd-3e72dab90c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:44.046302 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44b0c-965d-43fa-b4bd-3e72dab90c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:44.046583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44b0c-965d-43fa-b4bd-3e72dab90c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:44.046867 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44b0c-965d-43fa-b4bd-3e72dab90c04 admin admin] PATH_INFO: `/v3/users/d2de6fd25edc4ac68d6facc5bbd4c517` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:44.048102 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d44b0c-965d-43fa-b4bd-3e72dab90c04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2de6fd25edc4ac68d6facc5bbd4c517)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:44.050042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d44b0c-965d-43fa-b4bd-3e72dab90c04 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:44.101570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-39d44b0c-965d-43fa-b4bd-3e72dab90c04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2de6fd25edc4ac68d6facc5bbd4c517'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:44.112694 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-39d44b0c-965d-43fa-b4bd-3e72dab90c04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2de6fd25edc4ac68d6facc5bbd4c517'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:44.119096 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-39d44b0c-965d-43fa-b4bd-3e72dab90c04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2de6fd25edc4ac68d6facc5bbd4c517'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:44.125900 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-39d44b0c-965d-43fa-b4bd-3e72dab90c04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2de6fd25edc4ac68d6facc5bbd4c517'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:44.126559 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-39d44b0c-965d-43fa-b4bd-3e72dab90c04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2de6fd25edc4ac68d6facc5bbd4c517'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:44.132551 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1411/2803] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:43 2021] DELETE /identity/v3/users/d2de6fd25edc4ac68d6facc5bbd4c517 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:44.136990 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c8c0f-86d3-47a4-99cc-24b74f7f8ac4 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:44.137278 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c8c0f-86d3-47a4-99cc-24b74f7f8ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:44.137556 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c8c0f-86d3-47a4-99cc-24b74f7f8ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:44.156405 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-5c8c8c0f-86d3-47a4-99cc-24b74f7f8ac4 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:44.158174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5c8c8c0f-86d3-47a4-99cc-24b74f7f8ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:44.213159 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1393/2804] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:44.224630 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d44b0c-965d-43fa-b4bd-3e72dab90c04 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:44.226068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-39d44b0c-965d-43fa-b4bd-3e72dab90c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:44.288151 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d44b0c-965d-43fa-b4bd-3e72dab90c04 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:44.291766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779d8df-21dc-4aa0-b473-2daee8b4ff62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:44.292407 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779d8df-21dc-4aa0-b473-2daee8b4ff62 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:44.292690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779d8df-21dc-4aa0-b473-2daee8b4ff62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:44.292964 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779d8df-21dc-4aa0-b473-2daee8b4ff62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:44.302165 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779d8df-21dc-4aa0-b473-2daee8b4ff62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:44.303651 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779d8df-21dc-4aa0-b473-2daee8b4ff62 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:44.312740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1412/2805] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:44.580599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c8c0f-86d3-47a4-99cc-24b74f7f8ac4 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:44.581997 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-5c8c8c0f-86d3-47a4-99cc-24b74f7f8ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:44.594381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c8c0f-86d3-47a4-99cc-24b74f7f8ac4 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:44.599230 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293581c1-9e13-4d10-a557-bea1dfc18951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:44.600206 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293581c1-9e13-4d10-a557-bea1dfc18951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:44.600488 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293581c1-9e13-4d10-a557-bea1dfc18951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:44.600764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293581c1-9e13-4d10-a557-bea1dfc18951 admin admin] PATH_INFO: `/v3/projects/46bd97f8fefb44adbd817b8198c42223` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:44.601971 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293581c1-9e13-4d10-a557-bea1dfc18951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46bd97f8fefb44adbd817b8198c42223)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:44.603894 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293581c1-9e13-4d10-a557-bea1dfc18951 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:44.649782 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-293581c1-9e13-4d10-a557-bea1dfc18951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46bd97f8fefb44adbd817b8198c42223', 'request_id': 'req-293581c1-9e13-4d10-a557-bea1dfc18951'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:44.657308 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-293581c1-9e13-4d10-a557-bea1dfc18951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46bd97f8fefb44adbd817b8198c42223', 'request_id': 'req-293581c1-9e13-4d10-a557-bea1dfc18951'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:44.662683 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-293581c1-9e13-4d10-a557-bea1dfc18951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46bd97f8fefb44adbd817b8198c42223', 'request_id': 'req-293581c1-9e13-4d10-a557-bea1dfc18951'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:44.673986 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-293581c1-9e13-4d10-a557-bea1dfc18951 admin admin] The token cache is being invalidate because project 46bd97f8fefb44adbd817b8198c42223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:44.674274 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-293581c1-9e13-4d10-a557-bea1dfc18951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:44.674922 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-293581c1-9e13-4d10-a557-bea1dfc18951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:44.676433 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1394/2806] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:44 2021] DELETE /identity/v3/projects/46bd97f8fefb44adbd817b8198c42223 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:44.683541 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f7785-78bd-47fd-8938-d279283bbcde None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:44.684023 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f7785-78bd-47fd-8938-d279283bbcde None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:44.684149 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f7785-78bd-47fd-8938-d279283bbcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:44.702551 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-dc8f7785-78bd-47fd-8938-d279283bbcde None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:44.703767 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-dc8f7785-78bd-47fd-8938-d279283bbcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:44.759675 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1413/2807] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:44.767305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0f5ad-f864-43a2-be63-443d711ed5b8 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:44.767770 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0f5ad-f864-43a2-be63-443d711ed5b8 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:44.767868 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0f5ad-f864-43a2-be63-443d711ed5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:44.785634 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-d9e0f5ad-f864-43a2-be63-443d711ed5b8 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:44.786797 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-d9e0f5ad-f864-43a2-be63-443d711ed5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:44.794557 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1395/2808] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:44.799073 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f7785-78bd-47fd-8938-d279283bbcde None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:44.808359 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f7785-78bd-47fd-8938-d279283bbcde None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:44.812896 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b630228-43ff-4315-bf79-b230658d227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:44.813535 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b630228-43ff-4315-bf79-b230658d227a admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:44.814493 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b630228-43ff-4315-bf79-b230658d227a admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:44.814773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b630228-43ff-4315-bf79-b230658d227a admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:44.815542 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b630228-43ff-4315-bf79-b230658d227a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:42:44.815852 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b630228-43ff-4315-bf79-b230658d227a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:44.817430 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b630228-43ff-4315-bf79-b230658d227a admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:44.828578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1414/2809] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:42:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:42:44.832491 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0f5ad-f864-43a2-be63-443d711ed5b8 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:44.841444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0f5ad-f864-43a2-be63-443d711ed5b8 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:44.845976 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa4aa0-cbcd-4cd1-8c61-c774ea430be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:44.846601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa4aa0-cbcd-4cd1-8c61-c774ea430be2 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:44.846909 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa4aa0-cbcd-4cd1-8c61-c774ea430be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:44.847189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa4aa0-cbcd-4cd1-8c61-c774ea430be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:44.847889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa4aa0-cbcd-4cd1-8c61-c774ea430be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:44.849765 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa4aa0-cbcd-4cd1-8c61-c774ea430be2 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:44.874226 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1396/2810] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:42:44 2021] POST /identity/v3/projects => generated 365 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:44.878768 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b630228-43ff-4315-bf79-b230658d227a admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:44.888473 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b630228-43ff-4315-bf79-b230658d227a admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:44.943101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b799f3-4672-4d2a-bd4a-5b3affd674ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:44.943771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b799f3-4672-4d2a-bd4a-5b3affd674ee admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:44.944058 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b799f3-4672-4d2a-bd4a-5b3affd674ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:44.944337 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b799f3-4672-4d2a-bd4a-5b3affd674ee admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:44.945054 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b799f3-4672-4d2a-bd4a-5b3affd674ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:44.946957 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b799f3-4672-4d2a-bd4a-5b3affd674ee admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:44.973622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1415/2811] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:42:44 2021] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:42:44.977619 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa4aa0-cbcd-4cd1-8c61-c774ea430be2 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:44.989262 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa4aa0-cbcd-4cd1-8c61-c774ea430be2 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:44.994043 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4be70-3fa1-4619-8bd1-921651fdac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:44.994706 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4be70-3fa1-4619-8bd1-921651fdac7c admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:44.995020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4be70-3fa1-4619-8bd1-921651fdac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:44.995295 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4be70-3fa1-4619-8bd1-921651fdac7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:44.996037 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4be70-3fa1-4619-8bd1-921651fdac7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:44.997654 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4be70-3fa1-4619-8bd1-921651fdac7c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:45.009525 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1397/2812] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:44 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:45.013603 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b799f3-4672-4d2a-bd4a-5b3affd674ee admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:45.023509 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b799f3-4672-4d2a-bd4a-5b3affd674ee admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:45.028042 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93050c2-736b-48b9-a30a-978d3973bae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:45.028689 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93050c2-736b-48b9-a30a-978d3973bae1 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:45.028997 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93050c2-736b-48b9-a30a-978d3973bae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:45.029284 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93050c2-736b-48b9-a30a-978d3973bae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:45.030015 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93050c2-736b-48b9-a30a-978d3973bae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:45.031631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93050c2-736b-48b9-a30a-978d3973bae1 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:45.041776 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1416/2813] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:42:45 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:42:45.045700 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4be70-3fa1-4619-8bd1-921651fdac7c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:45.055892 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4be70-3fa1-4619-8bd1-921651fdac7c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:45.060406 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea32de-e843-4531-8442-740bf14ffc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:45.061255 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea32de-e843-4531-8442-740bf14ffc2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:45.061537 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea32de-e843-4531-8442-740bf14ffc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:45.061812 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea32de-e843-4531-8442-740bf14ffc2f admin admin] PATH_INFO: `/v3/projects/de048cf0cd69475fabb754f457954d94/users/507f78cc63884317b3e3950f217bb304/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:45.075619 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea32de-e843-4531-8442-740bf14ffc2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de048cf0cd69475fabb754f457954d94, user_id=507f78cc63884317b3e3950f217bb304, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:45.078237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea32de-e843-4531-8442-740bf14ffc2f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:45.090928 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1398/2814] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:42:45 2021] PUT /identity/v3/projects/de048cf0cd69475fabb754f457954d94/users/507f78cc63884317b3e3950f217bb304/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:45.101313 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe080ff-543d-40ad-8127-1cb090598f77 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:45.101607 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe080ff-543d-40ad-8127-1cb090598f77 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:45.101894 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe080ff-543d-40ad-8127-1cb090598f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:45.128156 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-2fe080ff-543d-40ad-8127-1cb090598f77 None None] MFA Rules not processed for user `507f78cc63884317b3e3950f217bb304`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:45.129375 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-2fe080ff-543d-40ad-8127-1cb090598f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:45.189786 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1417/2815] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:45 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:45.199943 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea32de-e843-4531-8442-740bf14ffc2f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:45.201623 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b4ea32de-e843-4531-8442-740bf14ffc2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:45.256507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea32de-e843-4531-8442-740bf14ffc2f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:45.260310 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb9dca-809b-4a96-b6dc-e6db77f1207a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:45.260939 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9dca-809b-4a96-b6dc-e6db77f1207a service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:45.261222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9dca-809b-4a96-b6dc-e6db77f1207a service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:45.261500 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9dca-809b-4a96-b6dc-e6db77f1207a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:45.269600 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb9dca-809b-4a96-b6dc-e6db77f1207a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:45.271055 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb9dca-809b-4a96-b6dc-e6db77f1207a service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:45.279699 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1399/2816] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:45 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:50.262002 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0c121-f57c-4352-9fd3-b027edb88925 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:50.262533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0c121-f57c-4352-9fd3-b027edb88925 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:50.262533 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0c121-f57c-4352-9fd3-b027edb88925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:50.281872 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-a4b0c121-f57c-4352-9fd3-b027edb88925 None None] MFA Rules not processed for user `484a37a0154a4f709815c5935aef8ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:50.283139 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a4b0c121-f57c-4352-9fd3-b027edb88925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:50.339112 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1418/2817] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:42:50 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:51.306870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb9dca-809b-4a96-b6dc-e6db77f1207a service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:51.308384 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-caeb9dca-809b-4a96-b6dc-e6db77f1207a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:51.378552 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb9dca-809b-4a96-b6dc-e6db77f1207a service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:51.383977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82793217-b105-4e37-bf57-e645d02a4939 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e05695f0d91463bae1f2a67a58cb54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:51.384617 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793217-b105-4e37-bf57-e645d02a4939 service placement] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:51.384897 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793217-b105-4e37-bf57-e645d02a4939 service placement] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:51.385175 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793217-b105-4e37-bf57-e645d02a4939 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:51.386962 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-82793217-b105-4e37-bf57-e645d02a4939 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:51.398825 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82793217-b105-4e37-bf57-e645d02a4939 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:51.400434 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82793217-b105-4e37-bf57-e645d02a4939 service placement] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:51.410374 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1400/2818] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:51 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:43:08.030827 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0c121-f57c-4352-9fd3-b027edb88925 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:08.032358 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a4b0c121-f57c-4352-9fd3-b027edb88925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:08.107806 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0c121-f57c-4352-9fd3-b027edb88925 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:08.113289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ace35f-fcb5-4e46-b4dd-aaa98be9ee18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:08.114361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ace35f-fcb5-4e46-b4dd-aaa98be9ee18 service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:08.114639 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ace35f-fcb5-4e46-b4dd-aaa98be9ee18 service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:08.114936 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ace35f-fcb5-4e46-b4dd-aaa98be9ee18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:08.116697 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-97ace35f-fcb5-4e46-b4dd-aaa98be9ee18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:08.128369 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ace35f-fcb5-4e46-b4dd-aaa98be9ee18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:08.130685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ace35f-fcb5-4e46-b4dd-aaa98be9ee18 service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:08.141711 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1419/2819] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:43:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:43:10.222466 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82793217-b105-4e37-bf57-e645d02a4939 service placement] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:10.224002 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-82793217-b105-4e37-bf57-e645d02a4939 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:10.279517 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82793217-b105-4e37-bf57-e645d02a4939 service placement] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:10.283185 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3ac84-2461-40e4-b024-808327aa0c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:10.283823 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3ac84-2461-40e4-b024-808327aa0c8c service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:10.284107 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3ac84-2461-40e4-b024-808327aa0c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:10.284384 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3ac84-2461-40e4-b024-808327aa0c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:10.286161 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-56c3ac84-2461-40e4-b024-808327aa0c8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:10.348817 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3ac84-2461-40e4-b024-808327aa0c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:10.350028 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3ac84-2461-40e4-b024-808327aa0c8c service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:10.359381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1401/2820] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:43:10 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:43:28.188146 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ace35f-fcb5-4e46-b4dd-aaa98be9ee18 service nova] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:28.250055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ace35f-fcb5-4e46-b4dd-aaa98be9ee18 service nova] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:28.255327 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922c509-c51b-4d71-ad74-dc8f1b42cd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:28.256766 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922c509-c51b-4d71-ad74-dc8f1b42cd6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:28.257048 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922c509-c51b-4d71-ad74-dc8f1b42cd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:28.257327 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922c509-c51b-4d71-ad74-dc8f1b42cd6c admin admin] PATH_INFO: `/v3/users/507f78cc63884317b3e3950f217bb304` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:28.258537 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922c509-c51b-4d71-ad74-dc8f1b42cd6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=507f78cc63884317b3e3950f217bb304)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:28.260492 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922c509-c51b-4d71-ad74-dc8f1b42cd6c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:28.307651 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b922c509-c51b-4d71-ad74-dc8f1b42cd6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507f78cc63884317b3e3950f217bb304'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:28.319367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b922c509-c51b-4d71-ad74-dc8f1b42cd6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507f78cc63884317b3e3950f217bb304'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:28.326150 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b922c509-c51b-4d71-ad74-dc8f1b42cd6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507f78cc63884317b3e3950f217bb304'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:28.332596 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b922c509-c51b-4d71-ad74-dc8f1b42cd6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507f78cc63884317b3e3950f217bb304'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:28.333210 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-b922c509-c51b-4d71-ad74-dc8f1b42cd6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507f78cc63884317b3e3950f217bb304'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:28.338835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1420/2821] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:43:28 2021] DELETE /identity/v3/users/507f78cc63884317b3e3950f217bb304 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:43:28.343678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146a7f-ff38-4519-b0a2-4e6eeda1cccd None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:28.344187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146a7f-ff38-4519-b0a2-4e6eeda1cccd None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:28.344302 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146a7f-ff38-4519-b0a2-4e6eeda1cccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:28.360686 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-f3146a7f-ff38-4519-b0a2-4e6eeda1cccd None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:28.361857 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f3146a7f-ff38-4519-b0a2-4e6eeda1cccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:28.424336 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1402/2822] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:43:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:28.434681 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922c509-c51b-4d71-ad74-dc8f1b42cd6c admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:28.436101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b922c509-c51b-4d71-ad74-dc8f1b42cd6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:28.503597 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922c509-c51b-4d71-ad74-dc8f1b42cd6c admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:28.507304 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b61e2-b669-403e-944c-87fd35b87335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:28.507974 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b61e2-b669-403e-944c-87fd35b87335 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:28.508258 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b61e2-b669-403e-944c-87fd35b87335 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:28.508537 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b61e2-b669-403e-944c-87fd35b87335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:28.517473 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b61e2-b669-403e-944c-87fd35b87335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:28.518919 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b61e2-b669-403e-944c-87fd35b87335 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:28.528242 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1421/2823] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:43:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:43:28.787955 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146a7f-ff38-4519-b0a2-4e6eeda1cccd None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:28.790413 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-f3146a7f-ff38-4519-b0a2-4e6eeda1cccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:28.801559 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146a7f-ff38-4519-b0a2-4e6eeda1cccd None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:28.806589 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:28.807498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:28.807776 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:28.808051 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3 admin admin] PATH_INFO: `/v3/projects/de048cf0cd69475fabb754f457954d94` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:28.809330 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de048cf0cd69475fabb754f457954d94)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:28.811312 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:28.857628 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de048cf0cd69475fabb754f457954d94', 'request_id': 'req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:28.864727 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de048cf0cd69475fabb754f457954d94', 'request_id': 'req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:28.870066 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de048cf0cd69475fabb754f457954d94', 'request_id': 'req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:28.880553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3 admin admin] The token cache is being invalidate because project de048cf0cd69475fabb754f457954d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:43:28.880838 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:28.881454 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-16e26b8a-85d2-485d-9306-6d2c7bba7bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:28.882976 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1403/2824] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:43:28 2021] DELETE /identity/v3/projects/de048cf0cd69475fabb754f457954d94 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:43:28.889224 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782f08c-a70b-4a2d-8e89-59963378c5b7 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:28.889515 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782f08c-a70b-4a2d-8e89-59963378c5b7 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:28.889822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782f08c-a70b-4a2d-8e89-59963378c5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:28.907925 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-f782f08c-a70b-4a2d-8e89-59963378c5b7 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:28.909106 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-f782f08c-a70b-4a2d-8e89-59963378c5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:28.964719 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1422/2825] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:43:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:28.972415 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e89e5a-96c0-4eae-964c-000bd2f0f380 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:28.972705 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e89e5a-96c0-4eae-964c-000bd2f0f380 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:28.972985 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e89e5a-96c0-4eae-964c-000bd2f0f380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:28.991436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-61e89e5a-96c0-4eae-964c-000bd2f0f380 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:28.992610 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-61e89e5a-96c0-4eae-964c-000bd2f0f380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:29.000365 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1404/2826] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:43:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:29.004457 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782f08c-a70b-4a2d-8e89-59963378c5b7 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:29.013807 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782f08c-a70b-4a2d-8e89-59963378c5b7 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:29.018288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ce01e-eba6-44ff-90e7-8881cdb584f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:29.018958 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ce01e-eba6-44ff-90e7-8881cdb584f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:29.019240 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ce01e-eba6-44ff-90e7-8881cdb584f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:29.019515 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ce01e-eba6-44ff-90e7-8881cdb584f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:29.020263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ce01e-eba6-44ff-90e7-8881cdb584f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:43:29.020591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ce01e-eba6-44ff-90e7-8881cdb584f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:29.022683 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ce01e-eba6-44ff-90e7-8881cdb584f6 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:29.033959 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1423/2827] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:43:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:43:29.038605 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e89e5a-96c0-4eae-964c-000bd2f0f380 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:29.047800 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e89e5a-96c0-4eae-964c-000bd2f0f380 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:29.052386 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94ceff-029b-4e86-a33b-e51bda65d164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:29.053020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94ceff-029b-4e86-a33b-e51bda65d164 admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:29.053303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94ceff-029b-4e86-a33b-e51bda65d164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:29.053578 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94ceff-029b-4e86-a33b-e51bda65d164 admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:29.054285 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94ceff-029b-4e86-a33b-e51bda65d164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:29.056203 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94ceff-029b-4e86-a33b-e51bda65d164 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:29.082177 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1405/2828] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:43:29 2021] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:43:29.086948 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ce01e-eba6-44ff-90e7-8881cdb584f6 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:29.097060 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ce01e-eba6-44ff-90e7-8881cdb584f6 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:29.152717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62879dec-44e3-4a3c-99fb-77dc707ee02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:29.153381 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62879dec-44e3-4a3c-99fb-77dc707ee02e admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:29.153669 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62879dec-44e3-4a3c-99fb-77dc707ee02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:29.153948 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62879dec-44e3-4a3c-99fb-77dc707ee02e admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:29.154648 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62879dec-44e3-4a3c-99fb-77dc707ee02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:29.156587 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62879dec-44e3-4a3c-99fb-77dc707ee02e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:29.174438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1424/2829] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:43:29 2021] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:43:29.178723 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94ceff-029b-4e86-a33b-e51bda65d164 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:29.188707 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94ceff-029b-4e86-a33b-e51bda65d164 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:29.194048 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48df13-9c46-4fb5-9c85-6b83517ea615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:29.194700 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48df13-9c46-4fb5-9c85-6b83517ea615 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:29.195024 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48df13-9c46-4fb5-9c85-6b83517ea615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:29.195307 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48df13-9c46-4fb5-9c85-6b83517ea615 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:29.196051 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48df13-9c46-4fb5-9c85-6b83517ea615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:29.197696 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48df13-9c46-4fb5-9c85-6b83517ea615 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:29.208449 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1406/2830] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:43:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:43:29.212756 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62879dec-44e3-4a3c-99fb-77dc707ee02e admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:29.222717 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62879dec-44e3-4a3c-99fb-77dc707ee02e admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:29.227320 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b352a-0137-4ec5-be76-a4f5a655baf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:29.227969 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b352a-0137-4ec5-be76-a4f5a655baf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:29.228254 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b352a-0137-4ec5-be76-a4f5a655baf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:29.228537 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b352a-0137-4ec5-be76-a4f5a655baf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:29.229272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b352a-0137-4ec5-be76-a4f5a655baf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:29.230867 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b352a-0137-4ec5-be76-a4f5a655baf9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:29.240494 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1425/2831] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:43:29 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:43:29.244288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48df13-9c46-4fb5-9c85-6b83517ea615 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:29.254249 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48df13-9c46-4fb5-9c85-6b83517ea615 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:29.259360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77575b-3a30-4598-8a35-e7b36acd88b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:29.260225 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77575b-3a30-4598-8a35-e7b36acd88b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:29.260507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77575b-3a30-4598-8a35-e7b36acd88b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:29.260784 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77575b-3a30-4598-8a35-e7b36acd88b6 admin admin] PATH_INFO: `/v3/projects/485128a342e049f7b26cff38c13adb0d/users/62fd429134014e91997e6395720a6d4b/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:29.275496 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77575b-3a30-4598-8a35-e7b36acd88b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=485128a342e049f7b26cff38c13adb0d, user_id=62fd429134014e91997e6395720a6d4b, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:29.278126 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77575b-3a30-4598-8a35-e7b36acd88b6 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:29.290730 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1407/2832] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:43:29 2021] PUT /identity/v3/projects/485128a342e049f7b26cff38c13adb0d/users/62fd429134014e91997e6395720a6d4b/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:43:29.300432 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecbb5e-ce9c-4725-9f75-ad4f32ca86a1 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:29.300718 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecbb5e-ce9c-4725-9f75-ad4f32ca86a1 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:29.300994 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecbb5e-ce9c-4725-9f75-ad4f32ca86a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:29.326695 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-77ecbb5e-ce9c-4725-9f75-ad4f32ca86a1 None None] MFA Rules not processed for user `62fd429134014e91997e6395720a6d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:29.327910 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-77ecbb5e-ce9c-4725-9f75-ad4f32ca86a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:29.388422 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1426/2833] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:43:29 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:29.399193 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77575b-3a30-4598-8a35-e7b36acd88b6 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:29.400912 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-fd77575b-3a30-4598-8a35-e7b36acd88b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:29.455153 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77575b-3a30-4598-8a35-e7b36acd88b6 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:29.458784 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e9311-2fa9-4197-a508-d6fca0bd4200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:29.460036 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e9311-2fa9-4197-a508-d6fca0bd4200 service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:29.460321 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e9311-2fa9-4197-a508-d6fca0bd4200 service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:29.460598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e9311-2fa9-4197-a508-d6fca0bd4200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:29.468923 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e9311-2fa9-4197-a508-d6fca0bd4200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:29.470381 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e9311-2fa9-4197-a508-d6fca0bd4200 service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:29.479106 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1408/2834] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:43:29 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:43:29.505299 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecbb5e-ce9c-4725-9f75-ad4f32ca86a1 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:29.563829 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecbb5e-ce9c-4725-9f75-ad4f32ca86a1 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:29.569200 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd375ec6-c1d6-4a38-b90f-ef8f431328ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:29.570067 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd375ec6-c1d6-4a38-b90f-ef8f431328ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:29.570353 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd375ec6-c1d6-4a38-b90f-ef8f431328ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:29.570631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd375ec6-c1d6-4a38-b90f-ef8f431328ff admin admin] PATH_INFO: `/v3/users/62fd429134014e91997e6395720a6d4b` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:29.571879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd375ec6-c1d6-4a38-b90f-ef8f431328ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=62fd429134014e91997e6395720a6d4b)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:29.573866 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd375ec6-c1d6-4a38-b90f-ef8f431328ff admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:29.617629 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-cd375ec6-c1d6-4a38-b90f-ef8f431328ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62fd429134014e91997e6395720a6d4b'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:29.628690 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-cd375ec6-c1d6-4a38-b90f-ef8f431328ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62fd429134014e91997e6395720a6d4b'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:29.636647 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-cd375ec6-c1d6-4a38-b90f-ef8f431328ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62fd429134014e91997e6395720a6d4b'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:29.643449 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-cd375ec6-c1d6-4a38-b90f-ef8f431328ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62fd429134014e91997e6395720a6d4b'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:29.644101 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-cd375ec6-c1d6-4a38-b90f-ef8f431328ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62fd429134014e91997e6395720a6d4b'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:29.649895 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1427/2835] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:43:29 2021] DELETE /identity/v3/users/62fd429134014e91997e6395720a6d4b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:43:29.654316 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf434d6-cb7b-4f39-b17a-b537afdac99f None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:29.654672 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf434d6-cb7b-4f39-b17a-b537afdac99f None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:29.655077 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf434d6-cb7b-4f39-b17a-b537afdac99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:29.671804 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-9cf434d6-cb7b-4f39-b17a-b537afdac99f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:29.672974 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9cf434d6-cb7b-4f39-b17a-b537afdac99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:29.732331 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1409/2836] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:43:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:29.742578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd375ec6-c1d6-4a38-b90f-ef8f431328ff admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:29.744063 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-cd375ec6-c1d6-4a38-b90f-ef8f431328ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:29.797958 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd375ec6-c1d6-4a38-b90f-ef8f431328ff admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:29.801524 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448eff2d-6380-4557-b598-d096d9d965b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:29.802162 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eff2d-6380-4557-b598-d096d9d965b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:29.802439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eff2d-6380-4557-b598-d096d9d965b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:29.802713 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eff2d-6380-4557-b598-d096d9d965b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:29.811928 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448eff2d-6380-4557-b598-d096d9d965b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:29.813323 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448eff2d-6380-4557-b598-d096d9d965b4 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:29.822984 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1428/2837] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:43:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:43:30.076820 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf434d6-cb7b-4f39-b17a-b537afdac99f None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:30.078259 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-9cf434d6-cb7b-4f39-b17a-b537afdac99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:30.096298 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf434d6-cb7b-4f39-b17a-b537afdac99f None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:30.101805 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b7266-57cc-4894-a35a-1bfae9a58d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:30.102649 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b7266-57cc-4894-a35a-1bfae9a58d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:30.103045 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b7266-57cc-4894-a35a-1bfae9a58d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:30.103218 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b7266-57cc-4894-a35a-1bfae9a58d19 admin admin] PATH_INFO: `/v3/projects/485128a342e049f7b26cff38c13adb0d` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:30.104561 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b7266-57cc-4894-a35a-1bfae9a58d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=485128a342e049f7b26cff38c13adb0d)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:30.106469 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b7266-57cc-4894-a35a-1bfae9a58d19 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:30.152166 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-045b7266-57cc-4894-a35a-1bfae9a58d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485128a342e049f7b26cff38c13adb0d', 'request_id': 'req-045b7266-57cc-4894-a35a-1bfae9a58d19'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:30.158880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-045b7266-57cc-4894-a35a-1bfae9a58d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485128a342e049f7b26cff38c13adb0d', 'request_id': 'req-045b7266-57cc-4894-a35a-1bfae9a58d19'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:30.164126 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-045b7266-57cc-4894-a35a-1bfae9a58d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485128a342e049f7b26cff38c13adb0d', 'request_id': 'req-045b7266-57cc-4894-a35a-1bfae9a58d19'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:30.174650 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-045b7266-57cc-4894-a35a-1bfae9a58d19 admin admin] The token cache is being invalidate because project 485128a342e049f7b26cff38c13adb0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:43:30.174982 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-045b7266-57cc-4894-a35a-1bfae9a58d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:30.175606 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-045b7266-57cc-4894-a35a-1bfae9a58d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:30.177112 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1410/2838] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:43:30 2021] DELETE /identity/v3/projects/485128a342e049f7b26cff38c13adb0d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:43:30.182822 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d89fe-466a-4457-9d50-22f78ef0ef2f None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:30.183141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d89fe-466a-4457-9d50-22f78ef0ef2f None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:30.183421 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d89fe-466a-4457-9d50-22f78ef0ef2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:30.201404 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-226d89fe-466a-4457-9d50-22f78ef0ef2f None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:30.202603 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-226d89fe-466a-4457-9d50-22f78ef0ef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:30.259364 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1429/2839] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:43:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:30.267809 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928bf9-d7d9-4496-a498-949c8f19c6d1 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:30.268106 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928bf9-d7d9-4496-a498-949c8f19c6d1 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:30.268394 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928bf9-d7d9-4496-a498-949c8f19c6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:30.286261 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-0b928bf9-d7d9-4496-a498-949c8f19c6d1 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:30.287517 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0b928bf9-d7d9-4496-a498-949c8f19c6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:30.295368 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1411/2840] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:43:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:30.299306 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d89fe-466a-4457-9d50-22f78ef0ef2f None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:30.309036 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d89fe-466a-4457-9d50-22f78ef0ef2f None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:30.313546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df571f1d-5839-4fa7-a432-39df75c2fca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:30.314188 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df571f1d-5839-4fa7-a432-39df75c2fca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:30.314470 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df571f1d-5839-4fa7-a432-39df75c2fca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:30.314748 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df571f1d-5839-4fa7-a432-39df75c2fca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:30.315585 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df571f1d-5839-4fa7-a432-39df75c2fca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:43:30.315893 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df571f1d-5839-4fa7-a432-39df75c2fca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:30.317472 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df571f1d-5839-4fa7-a432-39df75c2fca3 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:30.332789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1430/2841] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:43:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:43:30.337278 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b928bf9-d7d9-4496-a498-949c8f19c6d1 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:30.346821 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b928bf9-d7d9-4496-a498-949c8f19c6d1 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:30.351658 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f611e-4565-4d40-8fea-eff19f4aa4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:30.352325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f611e-4565-4d40-8fea-eff19f4aa4ed admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:30.352606 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f611e-4565-4d40-8fea-eff19f4aa4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:30.352898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f611e-4565-4d40-8fea-eff19f4aa4ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:30.353595 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f611e-4565-4d40-8fea-eff19f4aa4ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:30.355530 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f611e-4565-4d40-8fea-eff19f4aa4ed admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:30.380399 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1412/2842] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:43:30 2021] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:43:30.384877 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df571f1d-5839-4fa7-a432-39df75c2fca3 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:30.394508 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df571f1d-5839-4fa7-a432-39df75c2fca3 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:30.447817 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dc5ba-646f-4e0e-b7e6-e2ce6fe3b989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:30.448472 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dc5ba-646f-4e0e-b7e6-e2ce6fe3b989 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:30.448753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dc5ba-646f-4e0e-b7e6-e2ce6fe3b989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:30.449137 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dc5ba-646f-4e0e-b7e6-e2ce6fe3b989 admin admin] PATH_INFO: `/v3/users` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:30.449849 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dc5ba-646f-4e0e-b7e6-e2ce6fe3b989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:30.451775 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dc5ba-646f-4e0e-b7e6-e2ce6fe3b989 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:30.471008 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1431/2843] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:43:30 2021] POST /identity/v3/users => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:43:30.475121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f611e-4565-4d40-8fea-eff19f4aa4ed admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:30.485384 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f611e-4565-4d40-8fea-eff19f4aa4ed admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:30.489994 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a313-60d0-4d9e-8e68-c999de6507de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:30.493977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a313-60d0-4d9e-8e68-c999de6507de admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:30.493977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a313-60d0-4d9e-8e68-c999de6507de admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:30.493977 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a313-60d0-4d9e-8e68-c999de6507de admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:30.495184 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5a313-60d0-4d9e-8e68-c999de6507de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:30.497783 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5a313-60d0-4d9e-8e68-c999de6507de admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:30.510717 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1413/2844] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:43:30 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:43:30.515626 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dc5ba-646f-4e0e-b7e6-e2ce6fe3b989 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:30.525578 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dc5ba-646f-4e0e-b7e6-e2ce6fe3b989 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:30.530248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc6ffb-c8bf-4708-b272-be8ca07e95ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:30.530967 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc6ffb-c8bf-4708-b272-be8ca07e95ed admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:30.531268 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc6ffb-c8bf-4708-b272-be8ca07e95ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:30.531545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc6ffb-c8bf-4708-b272-be8ca07e95ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:30.532281 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc6ffb-c8bf-4708-b272-be8ca07e95ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:30.533883 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc6ffb-c8bf-4708-b272-be8ca07e95ed admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:30.543683 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1432/2845] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:43:30 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:43:30.547701 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a313-60d0-4d9e-8e68-c999de6507de admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:30.557889 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a313-60d0-4d9e-8e68-c999de6507de admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:30.562462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747a9e5-16d1-4cad-9c2d-3e8cdf73986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:30.563360 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a9e5-16d1-4cad-9c2d-3e8cdf73986c admin admin] REQUEST_METHOD: `PUT` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:30.563648 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a9e5-16d1-4cad-9c2d-3e8cdf73986c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:30.563923 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a9e5-16d1-4cad-9c2d-3e8cdf73986c admin admin] PATH_INFO: `/v3/projects/37441b2835294e6bbad06c9964fc3ee3/users/1a53594b5fa74defbf11b50d1fd6a325/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:30.578453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747a9e5-16d1-4cad-9c2d-3e8cdf73986c admin admin] RBAC: Authorizing `identity:create_grant(project_id=37441b2835294e6bbad06c9964fc3ee3, user_id=1a53594b5fa74defbf11b50d1fd6a325, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:30.581194 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747a9e5-16d1-4cad-9c2d-3e8cdf73986c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:30.594354 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1414/2846] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:43:30 2021] PUT /identity/v3/projects/37441b2835294e6bbad06c9964fc3ee3/users/1a53594b5fa74defbf11b50d1fd6a325/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:43:30.604296 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f52440-e18a-45c4-ad47-68d3e7892fa9 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:30.604604 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f52440-e18a-45c4-ad47-68d3e7892fa9 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:30.604898 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f52440-e18a-45c4-ad47-68d3e7892fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:30.631670 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-53f52440-e18a-45c4-ad47-68d3e7892fa9 None None] MFA Rules not processed for user `1a53594b5fa74defbf11b50d1fd6a325`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:30.632873 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-53f52440-e18a-45c4-ad47-68d3e7892fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:30.693815 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1433/2847] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:43:30 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:30.703743 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747a9e5-16d1-4cad-9c2d-3e8cdf73986c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:30.705448 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-0747a9e5-16d1-4cad-9c2d-3e8cdf73986c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:30.759671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747a9e5-16d1-4cad-9c2d-3e8cdf73986c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:30.763325 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196354b-dfa5-4364-9fa6-a0f30d3edbeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:30.763891 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196354b-dfa5-4364-9fa6-a0f30d3edbeb service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:30.764173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196354b-dfa5-4364-9fa6-a0f30d3edbeb service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:30.764449 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196354b-dfa5-4364-9fa6-a0f30d3edbeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:30.772429 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196354b-dfa5-4364-9fa6-a0f30d3edbeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:30.773843 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196354b-dfa5-4364-9fa6-a0f30d3edbeb service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:30.782248 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1415/2848] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:43:30 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:43:32.101233 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962365b-8991-4ee6-89e4-09cad728483b None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:32.101748 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962365b-8991-4ee6-89e4-09cad728483b None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:32.101850 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962365b-8991-4ee6-89e4-09cad728483b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:32.121380 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-c962365b-8991-4ee6-89e4-09cad728483b None None] MFA Rules not processed for user `1a53594b5fa74defbf11b50d1fd6a325`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:32.122597 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c962365b-8991-4ee6-89e4-09cad728483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:32.135309 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1434/2849] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:43:32 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:45.605718 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101e9a5-6457-49bd-a6d4-5965b25c1641 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:45.606221 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101e9a5-6457-49bd-a6d4-5965b25c1641 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:45.606355 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101e9a5-6457-49bd-a6d4-5965b25c1641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:45.623251 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-6101e9a5-6457-49bd-a6d4-5965b25c1641 None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:45.624436 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-6101e9a5-6457-49bd-a6d4-5965b25c1641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:45.678044 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1416/2850] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:43:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:45.724047 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962365b-8991-4ee6-89e4-09cad728483b None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:45.725446 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-c962365b-8991-4ee6-89e4-09cad728483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:45.790263 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962365b-8991-4ee6-89e4-09cad728483b None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:45.795053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe8a9e-5f1a-4001-9985-c5c0a1ee1331 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:45.795691 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe8a9e-5f1a-4001-9985-c5c0a1ee1331 service swift] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:45.795971 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe8a9e-5f1a-4001-9985-c5c0a1ee1331 service swift] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:45.796248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe8a9e-5f1a-4001-9985-c5c0a1ee1331 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:45.804143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe8a9e-5f1a-4001-9985-c5c0a1ee1331 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:45.805723 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe8a9e-5f1a-4001-9985-c5c0a1ee1331 service swift] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:45.814572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1435/2851] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:43:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:43:46.316536 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c3b5c-68ec-40d6-82ea-c1cacf1046ee None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:46.316824 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c3b5c-68ec-40d6-82ea-c1cacf1046ee None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:46.317149 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c3b5c-68ec-40d6-82ea-c1cacf1046ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:46.334616 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-df5c3b5c-68ec-40d6-82ea-c1cacf1046ee None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:46.336329 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-df5c3b5c-68ec-40d6-82ea-c1cacf1046ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:46.343311 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1417/2852] 10.222.0.60 () {58 vars in 967 bytes} [Wed Dec 15 13:43:46 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:46.356844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe8a9e-5f1a-4001-9985-c5c0a1ee1331 service swift] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:46.367053 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe8a9e-5f1a-4001-9985-c5c0a1ee1331 service swift] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:46.371970 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23762e39-8d22-421b-a67c-92057bdfacd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:46.372596 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762e39-8d22-421b-a67c-92057bdfacd3 service swift] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:46.372879 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762e39-8d22-421b-a67c-92057bdfacd3 service swift] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:46.373155 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762e39-8d22-421b-a67c-92057bdfacd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:46.380895 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23762e39-8d22-421b-a67c-92057bdfacd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:46.382970 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23762e39-8d22-421b-a67c-92057bdfacd3 service swift] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:46.390737 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1436/2853] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:43:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:43:46.580121 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e186c0-5f5f-4929-a054-1e53a2d393bf None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:46.580411 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e186c0-5f5f-4929-a054-1e53a2d393bf None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:46.580687 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e186c0-5f5f-4929-a054-1e53a2d393bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:46.598986 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-21e186c0-5f5f-4929-a054-1e53a2d393bf None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:46.600164 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-21e186c0-5f5f-4929-a054-1e53a2d393bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:46.608168 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1418/2854] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Dec 15 13:43:46 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:46.620844 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23762e39-8d22-421b-a67c-92057bdfacd3 service swift] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:46.631212 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23762e39-8d22-421b-a67c-92057bdfacd3 service swift] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:46.638039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55192ce-9dfe-4ec4-80b3-78b585b46320 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:46.638683 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55192ce-9dfe-4ec4-80b3-78b585b46320 service swift] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:46.639005 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55192ce-9dfe-4ec4-80b3-78b585b46320 service swift] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:46.639288 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55192ce-9dfe-4ec4-80b3-78b585b46320 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:46.647402 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55192ce-9dfe-4ec4-80b3-78b585b46320 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:46.649474 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55192ce-9dfe-4ec4-80b3-78b585b46320 service swift] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:46.657497 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1437/2855] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:43:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:43:46.967898 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9acc0-2349-4904-bc7f-96a7333b86c2 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:46.968218 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9acc0-2349-4904-bc7f-96a7333b86c2 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:46.968517 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9acc0-2349-4904-bc7f-96a7333b86c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:46.985911 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-3bc9acc0-2349-4904-bc7f-96a7333b86c2 None None] MFA Rules not processed for user `77744968b6b14415b5b85423db1cfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:46.987202 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-3bc9acc0-2349-4904-bc7f-96a7333b86c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:46.994720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1419/2856] 10.222.0.60 () {58 vars in 967 bytes} [Wed Dec 15 13:43:46 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:47.007866 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55192ce-9dfe-4ec4-80b3-78b585b46320 service swift] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:47.018287 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55192ce-9dfe-4ec4-80b3-78b585b46320 service swift] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:47.023270 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879c475-fccb-45d3-b47b-e0d1504b8137 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27fd1a6075694b2c833b345485d5319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:47.023990 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879c475-fccb-45d3-b47b-e0d1504b8137 service swift] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:47.024272 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879c475-fccb-45d3-b47b-e0d1504b8137 service swift] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:47.024551 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879c475-fccb-45d3-b47b-e0d1504b8137 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:47.032366 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879c475-fccb-45d3-b47b-e0d1504b8137 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:47.033926 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879c475-fccb-45d3-b47b-e0d1504b8137 service swift] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:47.041709 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1438/2857] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Dec 15 13:43:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:43:48.993351 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9acc0-2349-4904-bc7f-96a7333b86c2 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:49.052651 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9acc0-2349-4904-bc7f-96a7333b86c2 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:49.057642 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b935e-7062-4674-82b9-b473232e5ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:49.058498 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b935e-7062-4674-82b9-b473232e5ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:49.058781 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b935e-7062-4674-82b9-b473232e5ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:49.059086 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b935e-7062-4674-82b9-b473232e5ecd admin admin] PATH_INFO: `/v3/users/1a53594b5fa74defbf11b50d1fd6a325` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:49.060279 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b935e-7062-4674-82b9-b473232e5ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a53594b5fa74defbf11b50d1fd6a325)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:49.062188 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b935e-7062-4674-82b9-b473232e5ecd admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:49.105475 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-c73b935e-7062-4674-82b9-b473232e5ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a53594b5fa74defbf11b50d1fd6a325'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:49.117020 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-c73b935e-7062-4674-82b9-b473232e5ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a53594b5fa74defbf11b50d1fd6a325'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:49.123885 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-c73b935e-7062-4674-82b9-b473232e5ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a53594b5fa74defbf11b50d1fd6a325'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:49.130668 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-c73b935e-7062-4674-82b9-b473232e5ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a53594b5fa74defbf11b50d1fd6a325'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:49.131328 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-c73b935e-7062-4674-82b9-b473232e5ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a53594b5fa74defbf11b50d1fd6a325'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:49.138025 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1420/2858] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:43:48 2021] DELETE /identity/v3/users/1a53594b5fa74defbf11b50d1fd6a325 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:43:49.142572 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a9b49-9d4a-472f-a3fd-7f7dec92c921 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:49.143082 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a9b49-9d4a-472f-a3fd-7f7dec92c921 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:49.143202 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a9b49-9d4a-472f-a3fd-7f7dec92c921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:49.160731 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-7c3a9b49-9d4a-472f-a3fd-7f7dec92c921 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:49.161919 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-7c3a9b49-9d4a-472f-a3fd-7f7dec92c921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:49.218065 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1439/2859] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:43:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:49.228237 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b935e-7062-4674-82b9-b473232e5ecd admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:49.229581 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-c73b935e-7062-4674-82b9-b473232e5ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:49.285038 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b935e-7062-4674-82b9-b473232e5ecd admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:49.288767 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29c608-5324-46a3-8b7a-75bfb61ad33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:49.289402 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29c608-5324-46a3-8b7a-75bfb61ad33d service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:49.289690 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29c608-5324-46a3-8b7a-75bfb61ad33d service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:49.289971 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29c608-5324-46a3-8b7a-75bfb61ad33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:49.298758 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29c608-5324-46a3-8b7a-75bfb61ad33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:49.300220 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29c608-5324-46a3-8b7a-75bfb61ad33d service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:49.309984 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1421/2860] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:43:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:43:49.484089 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a9b49-9d4a-472f-a3fd-7f7dec92c921 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:49.485817 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-7c3a9b49-9d4a-472f-a3fd-7f7dec92c921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:49.498806 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a9b49-9d4a-472f-a3fd-7f7dec92c921 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:49.503832 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:49.504702 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:49.504981 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:49.505257 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c admin admin] PATH_INFO: `/v3/projects/37441b2835294e6bbad06c9964fc3ee3` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:49.506465 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c admin admin] RBAC: Authorizing `identity:delete_project(project_id=37441b2835294e6bbad06c9964fc3ee3)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:49.508425 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:49.553520 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37441b2835294e6bbad06c9964fc3ee3', 'request_id': 'req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:49.561373 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37441b2835294e6bbad06c9964fc3ee3', 'request_id': 'req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:49.567573 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37441b2835294e6bbad06c9964fc3ee3', 'request_id': 'req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:49.577242 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c admin admin] The token cache is being invalidate because project 37441b2835294e6bbad06c9964fc3ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:43:49.577527 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:49.578141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-ac572ab0-d258-44c2-9ec1-3e1c93c5e08c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:49.579680 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1440/2861] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:43:49 2021] DELETE /identity/v3/projects/37441b2835294e6bbad06c9964fc3ee3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:43:49.585425 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430427e5-6d3f-42a9-b410-d1704b8d7d35 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:49.585720 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430427e5-6d3f-42a9-b410-d1704b8d7d35 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:49.586008 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430427e5-6d3f-42a9-b410-d1704b8d7d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:49.604019 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-430427e5-6d3f-42a9-b410-d1704b8d7d35 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:49.605199 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-430427e5-6d3f-42a9-b410-d1704b8d7d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:49.662543 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1422/2862] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:43:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:49.670793 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d10a4-422b-4860-b6a9-8f0ce4394e73 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:49.671111 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d10a4-422b-4860-b6a9-8f0ce4394e73 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:49.671411 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d10a4-422b-4860-b6a9-8f0ce4394e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:49.691091 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-b75d10a4-422b-4860-b6a9-8f0ce4394e73 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:49.692361 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-b75d10a4-422b-4860-b6a9-8f0ce4394e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:49.700175 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1441/2863] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:43:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:49.704173 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430427e5-6d3f-42a9-b410-d1704b8d7d35 None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:49.713700 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430427e5-6d3f-42a9-b410-d1704b8d7d35 None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:49.718288 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9caed6-b0c1-4578-a01f-3c6bed60b06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:49.718988 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9caed6-b0c1-4578-a01f-3c6bed60b06f admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:49.719291 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9caed6-b0c1-4578-a01f-3c6bed60b06f admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:49.719819 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9caed6-b0c1-4578-a01f-3c6bed60b06f admin admin] PATH_INFO: `/v3/domains` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:49.720553 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9caed6-b0c1-4578-a01f-3c6bed60b06f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:43:49.720859 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9caed6-b0c1-4578-a01f-3c6bed60b06f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:49.722490 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9caed6-b0c1-4578-a01f-3c6bed60b06f admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:49.734451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1423/2864] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Dec 15 13:43:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:43:49.738314 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d10a4-422b-4860-b6a9-8f0ce4394e73 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:49.747661 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d10a4-422b-4860-b6a9-8f0ce4394e73 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:49.752184 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39999c-1cca-4e88-a791-de10aa436b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:49.752812 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39999c-1cca-4e88-a791-de10aa436b40 admin admin] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:49.753088 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39999c-1cca-4e88-a791-de10aa436b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:49.753360 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39999c-1cca-4e88-a791-de10aa436b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:49.754055 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39999c-1cca-4e88-a791-de10aa436b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:49.755956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39999c-1cca-4e88-a791-de10aa436b40 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:49.780546 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1442/2865] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Dec 15 13:43:49 2021] POST /identity/v3/projects => generated 391 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:43:49.784621 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9caed6-b0c1-4578-a01f-3c6bed60b06f admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:49.800450 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9caed6-b0c1-4578-a01f-3c6bed60b06f admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:49.856526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9635-3ba7-4eb2-b8f1-10e04fa1b16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:49.857192 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9635-3ba7-4eb2-b8f1-10e04fa1b16c admin admin] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:49.857482 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9635-3ba7-4eb2-b8f1-10e04fa1b16c admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:49.857764 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9635-3ba7-4eb2-b8f1-10e04fa1b16c admin admin] PATH_INFO: `/v3/users` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:49.858479 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b9635-3ba7-4eb2-b8f1-10e04fa1b16c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:49.860458 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b9635-3ba7-4eb2-b8f1-10e04fa1b16c admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:49.879151 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1424/2866] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Dec 15 13:43:49 2021] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:43:49.883467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39999c-1cca-4e88-a791-de10aa436b40 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:49.893416 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39999c-1cca-4e88-a791-de10aa436b40 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:49.898478 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de2aa4-30b1-460b-b8f3-c778505a2cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:49.899174 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de2aa4-30b1-460b-b8f3-c778505a2cbc admin admin] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:49.899456 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de2aa4-30b1-460b-b8f3-c778505a2cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:49.899730 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de2aa4-30b1-460b-b8f3-c778505a2cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:49.900519 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de2aa4-30b1-460b-b8f3-c778505a2cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:49.902282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de2aa4-30b1-460b-b8f3-c778505a2cbc admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:49.912585 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1443/2867] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:43:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:43:49.916797 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9635-3ba7-4eb2-b8f1-10e04fa1b16c admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:49.926419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9635-3ba7-4eb2-b8f1-10e04fa1b16c admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:49.931041 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52f50a-0ac6-43d8-b3c3-df00b2394cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:49.931677 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52f50a-0ac6-43d8-b3c3-df00b2394cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:49.931953 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52f50a-0ac6-43d8-b3c3-df00b2394cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:49.932222 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52f50a-0ac6-43d8-b3c3-df00b2394cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:49.932953 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52f50a-0ac6-43d8-b3c3-df00b2394cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:49.934523 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52f50a-0ac6-43d8-b3c3-df00b2394cb8 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:49.944068 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1425/2868] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Dec 15 13:43:49 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:43:49.948039 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de2aa4-30b1-460b-b8f3-c778505a2cbc admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:49.957466 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de2aa4-30b1-460b-b8f3-c778505a2cbc admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:49.962561 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4119fc-f022-402f-9dc9-2cb8a9bb94e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:49.963444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4119fc-f022-402f-9dc9-2cb8a9bb94e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:49.963723 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4119fc-f022-402f-9dc9-2cb8a9bb94e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:49.963996 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4119fc-f022-402f-9dc9-2cb8a9bb94e9 admin admin] PATH_INFO: `/v3/projects/b6465c19c1514939961dabc086aa87f6/users/408214a472a844adb6f82303b3551116/roles/e734a22c1b2c40feb0147271d002bdee` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:49.979380 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4119fc-f022-402f-9dc9-2cb8a9bb94e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6465c19c1514939961dabc086aa87f6, user_id=408214a472a844adb6f82303b3551116, role_id=e734a22c1b2c40feb0147271d002bdee)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:49.982076 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4119fc-f022-402f-9dc9-2cb8a9bb94e9 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:49.994685 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1444/2869] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Dec 15 13:43:49 2021] PUT /identity/v3/projects/b6465c19c1514939961dabc086aa87f6/users/408214a472a844adb6f82303b3551116/roles/e734a22c1b2c40feb0147271d002bdee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:43:50.004558 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4712e-f090-4661-8b9c-1568b8a0f6ee None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:50.005071 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4712e-f090-4661-8b9c-1568b8a0f6ee None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:50.005174 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4712e-f090-4661-8b9c-1568b8a0f6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:50.032747 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-73b4712e-f090-4661-8b9c-1568b8a0f6ee None None] MFA Rules not processed for user `408214a472a844adb6f82303b3551116`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:50.033959 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-73b4712e-f090-4661-8b9c-1568b8a0f6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:50.094918 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1426/2870] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:43:50 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:43:50.106289 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4119fc-f022-402f-9dc9-2cb8a9bb94e9 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:50.107990 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-4a4119fc-f022-402f-9dc9-2cb8a9bb94e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:50.162773 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4119fc-f022-402f-9dc9-2cb8a9bb94e9 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:50.166789 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb61fa-8385-4b53-8786-ef827a9be034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:50.167464 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb61fa-8385-4b53-8786-ef827a9be034 service cinder] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:50.167752 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb61fa-8385-4b53-8786-ef827a9be034 service cinder] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:50.168035 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb61fa-8385-4b53-8786-ef827a9be034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:50.176148 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb61fa-8385-4b53-8786-ef827a9be034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:50.177573 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb61fa-8385-4b53-8786-ef827a9be034 service cinder] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:50.186109 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1445/2871] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:43:50 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:44:12.280289 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4712e-f090-4661-8b9c-1568b8a0f6ee None None] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:12.380870 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4712e-f090-4661-8b9c-1568b8a0f6ee None None] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:12.385461 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7f4b-70de-4b22-b97d-bcc154843267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:12.386317 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7f4b-70de-4b22-b97d-bcc154843267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:12.386598 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7f4b-70de-4b22-b97d-bcc154843267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:12.386902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7f4b-70de-4b22-b97d-bcc154843267 admin admin] PATH_INFO: `/v3/users/408214a472a844adb6f82303b3551116` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:12.388107 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe7f4b-70de-4b22-b97d-bcc154843267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=408214a472a844adb6f82303b3551116)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:12.390029 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe7f4b-70de-4b22-b97d-bcc154843267 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:12.433487 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-edbe7f4b-70de-4b22-b97d-bcc154843267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408214a472a844adb6f82303b3551116'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:12.445374 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-edbe7f4b-70de-4b22-b97d-bcc154843267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408214a472a844adb6f82303b3551116'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:12.453492 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-edbe7f4b-70de-4b22-b97d-bcc154843267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408214a472a844adb6f82303b3551116'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:12.460443 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-edbe7f4b-70de-4b22-b97d-bcc154843267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408214a472a844adb6f82303b3551116'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:12.461068 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-edbe7f4b-70de-4b22-b97d-bcc154843267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408214a472a844adb6f82303b3551116'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:12.467599 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1427/2872] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:44:12 2021] DELETE /identity/v3/users/408214a472a844adb6f82303b3551116 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:44:12.472594 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae7b97-0d52-40ac-8de2-a5032f618334 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:12.473099 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae7b97-0d52-40ac-8de2-a5032f618334 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:12.473301 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae7b97-0d52-40ac-8de2-a5032f618334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:12.520000 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-f5ae7b97-0d52-40ac-8de2-a5032f618334 None None] MFA Rules not processed for user `851ea07e9b2c466298b37f0fddcbf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:44:12.521140 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-f5ae7b97-0d52-40ac-8de2-a5032f618334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:12.580351 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1446/2873] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:44:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:44:12.591248 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7f4b-70de-4b22-b97d-bcc154843267 admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:12.592684 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-edbe7f4b-70de-4b22-b97d-bcc154843267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:12.683660 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7f4b-70de-4b22-b97d-bcc154843267 admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:12.687272 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e86e45-707f-4d22-81ca-af1202dc3695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:12.687902 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e86e45-707f-4d22-81ca-af1202dc3695 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:12.688179 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e86e45-707f-4d22-81ca-af1202dc3695 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:12.688451 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e86e45-707f-4d22-81ca-af1202dc3695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:12.698309 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e86e45-707f-4d22-81ca-af1202dc3695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:12.699768 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e86e45-707f-4d22-81ca-af1202dc3695 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:12.708880 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1428/2874] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:44:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:44:12.962444 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae7b97-0d52-40ac-8de2-a5032f618334 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:12.964449 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-f5ae7b97-0d52-40ac-8de2-a5032f618334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:12.976583 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae7b97-0d52-40ac-8de2-a5032f618334 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:12.981185 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:12.982031 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:12.982314 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:12.982591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab admin admin] PATH_INFO: `/v3/projects/b6465c19c1514939961dabc086aa87f6` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:12.983835 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6465c19c1514939961dabc086aa87f6)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:12.985771 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:13.032631 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6465c19c1514939961dabc086aa87f6', 'request_id': 'req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:13.039197 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6465c19c1514939961dabc086aa87f6', 'request_id': 'req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:13.045308 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6465c19c1514939961dabc086aa87f6', 'request_id': 'req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:13.055318 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab admin admin] The token cache is being invalidate because project b6465c19c1514939961dabc086aa87f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:44:13.055549 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:13.056165 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-7a0f1fdb-50a7-4d7d-8c96-a147b5bc97ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:13.058234 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1447/2875] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:44:12 2021] DELETE /identity/v3/projects/b6465c19c1514939961dabc086aa87f6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:44:18.518113 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e86e45-707f-4d22-81ca-af1202dc3695 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:18.519516 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-20e86e45-707f-4d22-81ca-af1202dc3695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:18.613244 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e86e45-707f-4d22-81ca-af1202dc3695 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:18.670438 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a125ab-9af3-455d-b5dd-c1adee58fd06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e05695f0d91463bae1f2a67a58cb54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:18.671115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a125ab-9af3-455d-b5dd-c1adee58fd06 service placement] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:18.671397 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a125ab-9af3-455d-b5dd-c1adee58fd06 service placement] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:18.671673 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a125ab-9af3-455d-b5dd-c1adee58fd06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:18.673416 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-12a125ab-9af3-455d-b5dd-c1adee58fd06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:18.684223 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a125ab-9af3-455d-b5dd-c1adee58fd06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:18.685827 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a125ab-9af3-455d-b5dd-c1adee58fd06 service placement] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:18.695537 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1429/2876] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:44:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:52.210455 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175d1ef-be3d-4c1c-bd79-3918fe53c461 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:52.211024 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175d1ef-be3d-4c1c-bd79-3918fe53c461 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:52.211024 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175d1ef-be3d-4c1c-bd79-3918fe53c461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:52.229160 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-7175d1ef-be3d-4c1c-bd79-3918fe53c461 None None] MFA Rules not processed for user `484a37a0154a4f709815c5935aef8ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:52.230625 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-7175d1ef-be3d-4c1c-bd79-3918fe53c461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:52.286467 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1448/2877] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:45:52 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:52.596118 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a125ab-9af3-455d-b5dd-c1adee58fd06 service placement] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:52.597507 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-12a125ab-9af3-455d-b5dd-c1adee58fd06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:52.651050 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a125ab-9af3-455d-b5dd-c1adee58fd06 service placement] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:52.654671 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a97c3-75fe-4a0e-9eb2-df1aa67d6ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:52.655305 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a97c3-75fe-4a0e-9eb2-df1aa67d6ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:52.655587 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a97c3-75fe-4a0e-9eb2-df1aa67d6ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:52.655861 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a97c3-75fe-4a0e-9eb2-df1aa67d6ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:52.657613 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-a55a97c3-75fe-4a0e-9eb2-df1aa67d6ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:52.667029 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a97c3-75fe-4a0e-9eb2-df1aa67d6ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:52.668448 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a97c3-75fe-4a0e-9eb2-df1aa67d6ea1 service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:52.676678 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1430/2878] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:52 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:59.525303 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175d1ef-be3d-4c1c-bd79-3918fe53c461 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:59.535241 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175d1ef-be3d-4c1c-bd79-3918fe53c461 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:59.539881 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1607e-7d4a-4a2f-ae4c-c9f41b3a6a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:59.540888 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1607e-7d4a-4a2f-ae4c-c9f41b3a6a94 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:59.541393 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1607e-7d4a-4a2f-ae4c-c9f41b3a6a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:59.541674 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1607e-7d4a-4a2f-ae4c-c9f41b3a6a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:59.543645 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-faf1607e-7d4a-4a2f-ae4c-c9f41b3a6a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:59.651277 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1607e-7d4a-4a2f-ae4c-c9f41b3a6a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:59.657130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1607e-7d4a-4a2f-ae4c-c9f41b3a6a94 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:59.682622 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1449/2879] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:59 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:46:09.056995 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a97c3-75fe-4a0e-9eb2-df1aa67d6ea1 service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:09.065574 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a97c3-75fe-4a0e-9eb2-df1aa67d6ea1 service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:09.069216 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec41107-8ca6-431f-a869-955c6ecf73db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:09.069856 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec41107-8ca6-431f-a869-955c6ecf73db service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:09.070139 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec41107-8ca6-431f-a869-955c6ecf73db service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:09.070419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec41107-8ca6-431f-a869-955c6ecf73db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:09.072227 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-cec41107-8ca6-431f-a869-955c6ecf73db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:09.085740 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec41107-8ca6-431f-a869-955c6ecf73db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:09.087216 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec41107-8ca6-431f-a869-955c6ecf73db service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:09.098444 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1431/2880] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:46:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:47:20.628471 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1607e-7d4a-4a2f-ae4c-c9f41b3a6a94 service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:47:20.629920 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-faf1607e-7d4a-4a2f-ae4c-c9f41b3a6a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:47:20.640343 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1607e-7d4a-4a2f-ae4c-c9f41b3a6a94 service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:47:20.643937 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b777b-ecdc-4b2a-8b57-f8026c60a079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:47:20.644570 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b777b-ecdc-4b2a-8b57-f8026c60a079 service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:47:20.644853 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b777b-ecdc-4b2a-8b57-f8026c60a079 service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:47:20.645132 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b777b-ecdc-4b2a-8b57-f8026c60a079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:47:20.646807 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-a57b777b-ecdc-4b2a-8b57-f8026c60a079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:47:20.655989 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b777b-ecdc-4b2a-8b57-f8026c60a079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:47:20.657424 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b777b-ecdc-4b2a-8b57-f8026c60a079 service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:47:20.665980 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1450/2881] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:47:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:48:15.992483 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec41107-8ca6-431f-a869-955c6ecf73db service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:48:15.993854 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-cec41107-8ca6-431f-a869-955c6ecf73db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:48:16.068375 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec41107-8ca6-431f-a869-955c6ecf73db service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:48:16.071941 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be7921-46de-4006-ad07-cb9d279ead6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69bf09fafcb24a13a1ef14cba8da380a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:48:16.072569 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be7921-46de-4006-ad07-cb9d279ead6d service cinder] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:48:16.072872 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be7921-46de-4006-ad07-cb9d279ead6d service cinder] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:48:16.073143 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be7921-46de-4006-ad07-cb9d279ead6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:48:16.074891 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e5be7921-46de-4006-ad07-cb9d279ead6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:48:16.085108 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be7921-46de-4006-ad07-cb9d279ead6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:48:16.086529 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be7921-46de-4006-ad07-cb9d279ead6d service cinder] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:48:16.095189 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1432/2882] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:48:15 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:48:26.995790 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4fd35-72d1-4a90-bbaa-2764f2a375e8 None None] REQUEST_METHOD: `POST` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:48:26.996286 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4fd35-72d1-4a90-bbaa-2764f2a375e8 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:48:26.996390 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4fd35-72d1-4a90-bbaa-2764f2a375e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:48:27.014449 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.auth.core [None req-1ca4fd35-72d1-4a90-bbaa-2764f2a375e8 None None] MFA Rules not processed for user `484a37a0154a4f709815c5935aef8ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=79064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:48:27.015745 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-1ca4fd35-72d1-4a90-bbaa-2764f2a375e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:48:27.022493 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1451/2883] 10.222.0.60 () {58 vars in 957 bytes} [Wed Dec 15 13:48:26 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:48:27.733601 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be7921-46de-4006-ad07-cb9d279ead6d service cinder] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:48:27.735069 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e5be7921-46de-4006-ad07-cb9d279ead6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:48:27.750419 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be7921-46de-4006-ad07-cb9d279ead6d service cinder] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:48:27.755414 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4709c61-90ef-4d9b-a98a-94b3f7cceca6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e05695f0d91463bae1f2a67a58cb54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:48:27.756053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4709c61-90ef-4d9b-a98a-94b3f7cceca6 service placement] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:48:27.756341 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4709c61-90ef-4d9b-a98a-94b3f7cceca6 service placement] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:48:27.756620 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4709c61-90ef-4d9b-a98a-94b3f7cceca6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:48:27.758906 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b4709c61-90ef-4d9b-a98a-94b3f7cceca6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:48:27.771504 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4709c61-90ef-4d9b-a98a-94b3f7cceca6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:48:27.773103 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4709c61-90ef-4d9b-a98a-94b3f7cceca6 service placement] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:48:27.783592 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1433/2884] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:48:27 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:48:29.962798 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4fd35-72d1-4a90-bbaa-2764f2a375e8 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:48:29.964308 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-1ca4fd35-72d1-4a90-bbaa-2764f2a375e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:48:29.982367 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4fd35-72d1-4a90-bbaa-2764f2a375e8 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:48:29.989210 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9cafb-b6b9-40c5-b954-64ff0102d3dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:48:29.990532 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9cafb-b6b9-40c5-b954-64ff0102d3dd service nova] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:48:29.991312 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9cafb-b6b9-40c5-b954-64ff0102d3dd service nova] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:48:29.991824 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9cafb-b6b9-40c5-b954-64ff0102d3dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:48:29.994248 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-69f9cafb-b6b9-40c5-b954-64ff0102d3dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:48:30.014211 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9cafb-b6b9-40c5-b954-64ff0102d3dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:48:30.016856 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9cafb-b6b9-40c5-b954-64ff0102d3dd service nova] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:48:30.030062 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1452/2885] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:48:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:48:41.738356 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4709c61-90ef-4d9b-a98a-94b3f7cceca6 service placement] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:48:41.752031 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4709c61-90ef-4d9b-a98a-94b3f7cceca6 service placement] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:48:41.757679 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a54c00-9318-4777-bc87-ae73ff967170 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:48:41.758453 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a54c00-9318-4777-bc87-ae73ff967170 service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:48:41.758742 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a54c00-9318-4777-bc87-ae73ff967170 service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:48:41.759054 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a54c00-9318-4777-bc87-ae73ff967170 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:48:41.760851 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-98a54c00-9318-4777-bc87-ae73ff967170 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:48:41.783508 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a54c00-9318-4777-bc87-ae73ff967170 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:48:41.785109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a54c00-9318-4777-bc87-ae73ff967170 service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:48:41.795978 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1434/2886] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:48:41 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:48:44.435108 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9cafb-b6b9-40c5-b954-64ff0102d3dd service nova] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:48:44.444130 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9cafb-b6b9-40c5-b954-64ff0102d3dd service nova] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:48:44.447932 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cc60a-9e7b-46e5-bd0d-0edad462efce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:48:44.448591 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cc60a-9e7b-46e5-bd0d-0edad462efce service neutron] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:48:44.448869 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cc60a-9e7b-46e5-bd0d-0edad462efce service neutron] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:48:44.449143 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cc60a-9e7b-46e5-bd0d-0edad462efce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:48:44.450938 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-259cc60a-9e7b-46e5-bd0d-0edad462efce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:48:44.512282 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cc60a-9e7b-46e5-bd0d-0edad462efce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:48:44.513617 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cc60a-9e7b-46e5-bd0d-0edad462efce service neutron] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:48:44.522993 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1453/2887] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:48:44 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:48:46.096495 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a54c00-9318-4777-bc87-ae73ff967170 service nova] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:48:46.107812 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a54c00-9318-4777-bc87-ae73ff967170 service nova] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:48:46.113542 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9488244-e427-4812-a07a-ff6217faca0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61a8e4d64664e68a5710fdf766e4685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:48:46.114200 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9488244-e427-4812-a07a-ff6217faca0c service nova] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:48:46.114480 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9488244-e427-4812-a07a-ff6217faca0c service nova] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:48:46.114755 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9488244-e427-4812-a07a-ff6217faca0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:48:46.116575 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-e9488244-e427-4812-a07a-ff6217faca0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:48:46.130275 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9488244-e427-4812-a07a-ff6217faca0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:48:46.131917 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9488244-e427-4812-a07a-ff6217faca0c service nova] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:48:46.143273 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1435/2888] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:48:46 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:49:22.900129 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cc60a-9e7b-46e5-bd0d-0edad462efce service neutron] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:49:22.911068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cc60a-9e7b-46e5-bd0d-0edad462efce service neutron] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:49:22.915985 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99c284-bb3f-4ced-b876-28c5bf909436 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e05695f0d91463bae1f2a67a58cb54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:49:22.916621 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99c284-bb3f-4ced-b876-28c5bf909436 service placement] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:49:22.916905 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99c284-bb3f-4ced-b876-28c5bf909436 service placement] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:49:22.917183 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99c284-bb3f-4ced-b876-28c5bf909436 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:49:22.925689 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99c284-bb3f-4ced-b876-28c5bf909436 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:49:22.927299 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99c284-bb3f-4ced-b876-28c5bf909436 service placement] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:49:22.937438 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1454/2889] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:49:22 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:50:50.228387 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9488244-e427-4812-a07a-ff6217faca0c service nova] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:50:50.238083 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9488244-e427-4812-a07a-ff6217faca0c service nova] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:50:50.241858 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cf80e-cd5e-4e99-9188-8d07c38f25ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9a44a13e31941b5af9579d8bec345ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:50:50.242496 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cf80e-cd5e-4e99-9188-8d07c38f25ea service neutron] REQUEST_METHOD: `GET` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:50:50.242980 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cf80e-cd5e-4e99-9188-8d07c38f25ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:50:50.243109 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cf80e-cd5e-4e99-9188-8d07c38f25ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:50:50.244827 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-b60cf80e-cd5e-4e99-9188-8d07c38f25ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:50:50.307336 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60cf80e-cd5e-4e99-9188-8d07c38f25ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:50:50.309272 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60cf80e-cd5e-4e99-9188-8d07c38f25ea service neutron] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:50:50.318647 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1436/2890] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:50:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:50:56.357141 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99c284-bb3f-4ced-b876-28c5bf909436 service placement] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:50:56.358703 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-8b99c284-bb3f-4ced-b876-28c5bf909436 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:50:56.372387 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99c284-bb3f-4ced-b876-28c5bf909436 service placement] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:50:56.376945 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0737a-c793-443b-ae8c-2d13f46c9695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:50:56.377796 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0737a-c793-443b-ae8c-2d13f46c9695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:50:56.378075 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0737a-c793-443b-ae8c-2d13f46c9695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:50:56.378349 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0737a-c793-443b-ae8c-2d13f46c9695 admin admin] PATH_INFO: `/v3/users/484a37a0154a4f709815c5935aef8ec2` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:50:56.379650 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0737a-c793-443b-ae8c-2d13f46c9695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=484a37a0154a4f709815c5935aef8ec2)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:50:56.381585 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0737a-c793-443b-ae8c-2d13f46c9695 admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:50:56.426694 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5bc0737a-c793-443b-ae8c-2d13f46c9695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '484a37a0154a4f709815c5935aef8ec2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.438068 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5bc0737a-c793-443b-ae8c-2d13f46c9695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '484a37a0154a4f709815c5935aef8ec2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.445439 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5bc0737a-c793-443b-ae8c-2d13f46c9695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '484a37a0154a4f709815c5935aef8ec2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.452038 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5bc0737a-c793-443b-ae8c-2d13f46c9695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '484a37a0154a4f709815c5935aef8ec2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.452654 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-5bc0737a-c793-443b-ae8c-2d13f46c9695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '484a37a0154a4f709815c5935aef8ec2'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.458460 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1455/2891] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:50:56 2021] DELETE /identity/v3/users/484a37a0154a4f709815c5935aef8ec2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:50:56.625438 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cf80e-cd5e-4e99-9188-8d07c38f25ea service neutron] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:50:56.635587 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cf80e-cd5e-4e99-9188-8d07c38f25ea service neutron] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:50:56.705983 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:50:56.706874 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:50:56.707187 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:50:56.707462 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] PATH_INFO: `/v3/projects/ff117078def64108b7829db8db9baf7f` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:50:56.708753 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff117078def64108b7829db8db9baf7f)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:50:56.710650 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:50:56.756468 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff117078def64108b7829db8db9baf7f', 'request_id': 'req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.763554 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff117078def64108b7829db8db9baf7f', 'request_id': 'req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.769053 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff117078def64108b7829db8db9baf7f', 'request_id': 'req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.780424 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] The token cache is being invalidate because project ff117078def64108b7829db8db9baf7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:50:56.780814 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.781456 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.783005 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1437/2892] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:50:56 2021] DELETE /identity/v3/projects/ff117078def64108b7829db8db9baf7f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:50:56.787153 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0737a-c793-443b-ae8c-2d13f46c9695 admin admin] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:50:56.788649 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-5bc0737a-c793-443b-ae8c-2d13f46c9695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:50:56.801279 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0737a-c793-443b-ae8c-2d13f46c9695 admin admin] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:50:56.855138 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed8e1c-c472-4e8d-91b9-56c435dde18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:50:56.855990 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed8e1c-c472-4e8d-91b9-56c435dde18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:50:56.856274 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed8e1c-c472-4e8d-91b9-56c435dde18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:50:56.856551 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed8e1c-c472-4e8d-91b9-56c435dde18e admin admin] PATH_INFO: `/v3/users/30bc244e99974ff0aea7826b1ab36cec` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:50:56.857740 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed8e1c-c472-4e8d-91b9-56c435dde18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=30bc244e99974ff0aea7826b1ab36cec)` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:50:56.859682 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed8e1c-c472-4e8d-91b9-56c435dde18e admin admin] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:50:56.902650 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-51ed8e1c-c472-4e8d-91b9-56c435dde18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30bc244e99974ff0aea7826b1ab36cec'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.913925 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-51ed8e1c-c472-4e8d-91b9-56c435dde18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30bc244e99974ff0aea7826b1ab36cec'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.920873 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-51ed8e1c-c472-4e8d-91b9-56c435dde18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30bc244e99974ff0aea7826b1ab36cec'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.927472 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-51ed8e1c-c472-4e8d-91b9-56c435dde18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30bc244e99974ff0aea7826b1ab36cec'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.928087 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.notifications [None req-51ed8e1c-c472-4e8d-91b9-56c435dde18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30bc244e99974ff0aea7826b1ab36cec'} {{(pid=79064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:56.933753 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1456/2893] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Dec 15 13:50:56 2021] DELETE /identity/v3/users/30bc244e99974ff0aea7826b1ab36cec => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:50:57.100455 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] Authenticating user token {{(pid=79063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:50:57.101875 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:50:57.114772 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2ab04-196b-46a9-bfb3-4f26680bfecf admin admin] Validating token access rules against request {{(pid=79063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:50:57.169675 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851ea07e9b2c466298b37f0fddcbf9c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8bb67e688614ccb9ee5454c18356750', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:50:57.170526 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:50:57.170808 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:50:57.171115 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7 admin admin] PATH_INFO: `/v3/projects/218221016f9842ce9b372ba5aa638ff8` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:50:57.172303 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=218221016f9842ce9b372ba5aa638ff8)` {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:50:57.174218 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7 admin admin] RBAC: Authorization granted {{(pid=79063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:50:57.218110 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '218221016f9842ce9b372ba5aa638ff8', 'request_id': 'req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:57.224794 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '218221016f9842ce9b372ba5aa638ff8', 'request_id': 'req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:57.231047 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '218221016f9842ce9b372ba5aa638ff8', 'request_id': 'req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7'} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:57.241555 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7 admin admin] The token cache is being invalidate because project 218221016f9842ce9b372ba5aa638ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79063) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:50:57.241853 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:57.242541 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.notifications [None req-f00592af-2b98-4e73-ab9c-ef2b4d0abdd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79063) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:50:57.244136 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1438/2894] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Dec 15 13:50:57 2021] DELETE /identity/v3/projects/218221016f9842ce9b372ba5aa638ff8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:54:26.799703 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e6f5-60db-4608-b550-1ad02f9f9b91 None None] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:54:26.800209 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e6f5-60db-4608-b550-1ad02f9f9b91 None None] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:54:26.800321 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e6f5-60db-4608-b550-1ad02f9f9b91 None None] PATH_INFO: `/` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:54:26.802085 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1457/2895] 10.222.0.60 () {54 vars in 960 bytes} [Wed Dec 15 13:54:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:54:26.807536 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73dd83-a106-46d7-b17c-7294e2a71e94 None None] REQUEST_METHOD: `POST` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:54:26.808035 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73dd83-a106-46d7-b17c-7294e2a71e94 None None] SCRIPT_NAME: `/identity` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:54:26.808191 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73dd83-a106-46d7-b17c-7294e2a71e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:54:26.883163 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.auth.core [None req-7a73dd83-a106-46d7-b17c-7294e2a71e94 None None] MFA Rules not processed for user `8e05695f0d91463bae1f2a67a58cb54b`. Rule list: `[]` (Enabled: `True`). {{(pid=79063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:54:26.884382 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: DEBUG keystone.common.fernet_utils [None req-7a73dd83-a106-46d7-b17c-7294e2a71e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:54:26.989642 dv-cinder-813227-4-iscsi devstack@keystone.service[79063]: [pid: 79063|app: 0|req: 1439/2896] 10.222.0.60 () {58 vars in 1057 bytes} [Wed Dec 15 13:54:26 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:54:26.997545 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06e6f5-60db-4608-b550-1ad02f9f9b91 None None] Authenticating user token {{(pid=79064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:54:27.010870 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06e6f5-60db-4608-b550-1ad02f9f9b91 None None] Validating token access rules against request {{(pid=79064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:54:27.015918 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b336f3-e2b0-481f-b299-3b77d1584e59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e05695f0d91463bae1f2a67a58cb54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f200887ca764a72b0640476fe3eb41b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:54:27.016641 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b336f3-e2b0-481f-b299-3b77d1584e59 service placement] REQUEST_METHOD: `GET` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:54:27.016956 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b336f3-e2b0-481f-b299-3b77d1584e59 service placement] SCRIPT_NAME: `/identity` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:54:27.017240 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b336f3-e2b0-481f-b299-3b77d1584e59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:54:27.019041 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.fernet_utils [None req-85b336f3-e2b0-481f-b299-3b77d1584e59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:54:27.030637 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b336f3-e2b0-481f-b299-3b77d1584e59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:54:27.032252 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b336f3-e2b0-481f-b299-3b77d1584e59 service placement] RBAC: Authorization granted {{(pid=79064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:54:27.042331 dv-cinder-813227-4-iscsi devstack@keystone.service[79064]: [pid: 79064|app: 0|req: 1458/2897] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Dec 15 13:54:26 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0)